[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:15:15.919478  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:39233
I20260709 13:15:15.920936  8939 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:15:15.921896  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:15.938010  8946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:15.938063  8945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:15.938064  8948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:15.939790  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:17.062471  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.062839  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.063125  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602917063101 us; error 0 us; skew 500 ppm
I20260709 13:15:17.064029  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.069670  8939 webserver.cc:533] Webserver started at http://127.8.186.254:33071/ using document root <none> and password file <none>
I20260709 13:15:17.070567  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.070783  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.071235  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.077162  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "b40da444da134211a8b92dccc1c45860"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.085418  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:15:17.090888  8954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.092182  8939 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:17.092553  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "b40da444da134211a8b92dccc1c45860"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.092900  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.142382  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.144035  8939 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:15:17.144498  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.217620  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:39233
I20260709 13:15:17.217700  9005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:39233 every 8 connection(s)
I20260709 13:15:17.225428  9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.247483  9006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860: Bootstrap starting.
I20260709 13:15:17.253391  9006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.255268  9006 log.cc:826] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860: Log is configured to *not* fsync() on all Append() calls
I20260709 13:15:17.260030  9006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860: No bootstrap required, opened a new log
I20260709 13:15:17.282065  9006 raft_consensus.cc:359] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40da444da134211a8b92dccc1c45860" member_type: VOTER }
I20260709 13:15:17.282619  9006 raft_consensus.cc:385] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.282886  9006 raft_consensus.cc:740] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b40da444da134211a8b92dccc1c45860, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.283812  9006 consensus_queue.cc:260] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40da444da134211a8b92dccc1c45860" member_type: VOTER }
I20260709 13:15:17.284333  9006 raft_consensus.cc:399] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:17.284622  9006 raft_consensus.cc:493] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:17.284965  9006 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.289181  9006 raft_consensus.cc:515] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40da444da134211a8b92dccc1c45860" member_type: VOTER }
I20260709 13:15:17.289968  9006 leader_election.cc:304] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b40da444da134211a8b92dccc1c45860; no voters: 
I20260709 13:15:17.291667  9006 leader_election.cc:290] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:17.292064  9009 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.294512  9009 raft_consensus.cc:697] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 1 LEADER]: Becoming Leader. State: Replica: b40da444da134211a8b92dccc1c45860, State: Running, Role: LEADER
I20260709 13:15:17.295485  9009 consensus_queue.cc:237] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40da444da134211a8b92dccc1c45860" member_type: VOTER }
I20260709 13:15:17.296639  9006 sys_catalog.cc:565] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:17.306557  9011 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b40da444da134211a8b92dccc1c45860. Latest consensus state: current_term: 1 leader_uuid: "b40da444da134211a8b92dccc1c45860" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40da444da134211a8b92dccc1c45860" member_type: VOTER } }
I20260709 13:15:17.307422  9011 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:17.309677  9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b40da444da134211a8b92dccc1c45860" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40da444da134211a8b92dccc1c45860" member_type: VOTER } }
I20260709 13:15:17.310470  9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:17.314049  9018 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:17.326038  9018 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:17.328476  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:17.345923  9018 catalog_manager.cc:1383] Generated new cluster ID: dada38db2a3e452eb1a5b990add7141b
I20260709 13:15:17.346266  9018 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:17.375598  9018 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:17.377228  9018 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:17.391672  9018 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860: Generated new TSK 0
I20260709 13:15:17.392694  9018 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:17.459503  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.467772  9028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.469337  9029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.472175  9031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.472802  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:17.473536  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.473738  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.473891  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602917473874 us; error 0 us; skew 500 ppm
I20260709 13:15:17.474464  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.478544  8939 webserver.cc:533] Webserver started at http://127.8.186.193:33573/ using document root <none> and password file <none>
I20260709 13:15:17.479101  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.479296  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.479584  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.480738  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "5fb74c4bf625489bb656f80e9b16f374"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.486490  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:15:17.491251  9036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.492089  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:17.492393  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "5fb74c4bf625489bb656f80e9b16f374"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.492682  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.513775  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.515208  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.517939  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.522595  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.522832  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.523123  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.523298  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.622174  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:33111
I20260709 13:15:17.622328  9098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:33111 every 8 connection(s)
I20260709 13:15:17.628899  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.644519  9103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.646137  9104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.654733  8939 server_base.cc:1061] running on GCE node
W20260709 13:15:17.657438  9106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.658650  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.658977  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.659197  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602917659179 us; error 0 us; skew 500 ppm
I20260709 13:15:17.660161  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.664342  8939 webserver.cc:533] Webserver started at http://127.8.186.194:43103/ using document root <none> and password file <none>
I20260709 13:15:17.665081  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.665344  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.665697  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.666584  9099 heartbeater.cc:344] Connected to a master server at 127.8.186.254:39233
I20260709 13:15:17.667064  9099 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.667268  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.668154  9099 heartbeater.cc:507] Master 127.8.186.254:39233 requested a full tablet report, sending...
I20260709 13:15:17.671406  8971 ts_manager.cc:194] Registered new tserver with Master: 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111)
I20260709 13:15:17.674424  8971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58848
I20260709 13:15:17.674688  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:15:17.680054  9111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.680953  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:17.681299  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.681670  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.704803  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.706517  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.709128  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.713078  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.713378  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.713670  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.713881  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.802714  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:43207
I20260709 13:15:17.802904  9173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:43207 every 8 connection(s)
I20260709 13:15:17.809823  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.819653  9177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.822552  9180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.824265  9178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.826929  9174 heartbeater.cc:344] Connected to a master server at 127.8.186.254:39233
I20260709 13:15:17.827293  9174 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.828112  9174 heartbeater.cc:507] Master 127.8.186.254:39233 requested a full tablet report, sending...
I20260709 13:15:17.830168  8971 ts_manager.cc:194] Registered new tserver with Master: 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:17.831496  8971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58856
I20260709 13:15:17.832652  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:17.833734  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.834003  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.834204  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602917834185 us; error 0 us; skew 500 ppm
I20260709 13:15:17.834796  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.837296  8939 webserver.cc:533] Webserver started at http://127.8.186.195:35965/ using document root <none> and password file <none>
I20260709 13:15:17.837754  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.837929  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.838177  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.839176  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "606fcd51583f4c888742712ca0d8084c"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.843926  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:17.847363  9185 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.848294  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:17.848776  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "606fcd51583f4c888742712ca0d8084c"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-mq27"
I20260709 13:15:17.849084  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.861025  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.862244  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.864428  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.867368  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.867584  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.867842  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.868000  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.955392  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:34981
I20260709 13:15:17.955457  9247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:34981 every 8 connection(s)
I20260709 13:15:17.972445  9248 heartbeater.cc:344] Connected to a master server at 127.8.186.254:39233
I20260709 13:15:17.972865  9248 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.973665  9248 heartbeater.cc:507] Master 127.8.186.254:39233 requested a full tablet report, sending...
I20260709 13:15:17.975778  8971 ts_manager.cc:194] Registered new tserver with Master: 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:17.976243  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015250321s
I20260709 13:15:17.977140  8971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58866
I20260709 13:15:18.029556  8971 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58878:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:18.033298  8971 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:18.141026  9213 tablet_service.cc:1511] Processing CreateTablet for tablet ef2dbca51575438198f33e7d7cfdc619 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:18.142295  9212 tablet_service.cc:1511] Processing CreateTablet for tablet d1e8b2076ad0455f9d8e82e90aee6860 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:18.143082  9213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2dbca51575438198f33e7d7cfdc619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.142320  9208 tablet_service.cc:1511] Processing CreateTablet for tablet abf4465ae8ec4897b8c2d6b979bd333e (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:18.150159  9212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e8b2076ad0455f9d8e82e90aee6860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.151695  9209 tablet_service.cc:1511] Processing CreateTablet for tablet e510245a97bd4897aca0c7f16250126a (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:18.154136  9208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf4465ae8ec4897b8c2d6b979bd333e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.154453  9139 tablet_service.cc:1511] Processing CreateTablet for tablet ef2dbca51575438198f33e7d7cfdc619 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:18.155572  9210 tablet_service.cc:1511] Processing CreateTablet for tablet 4422731a39954731a7cba02df0fe7f42 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:18.163024  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2dbca51575438198f33e7d7cfdc619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.161971  9209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e510245a97bd4897aca0c7f16250126a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.156128  9138 tablet_service.cc:1511] Processing CreateTablet for tablet d1e8b2076ad0455f9d8e82e90aee6860 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:18.156598  9211 tablet_service.cc:1511] Processing CreateTablet for tablet db4cda0519cb428ab1ca8db0caf4d3d5 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:18.169550  9136 tablet_service.cc:1511] Processing CreateTablet for tablet 4422731a39954731a7cba02df0fe7f42 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:18.176578  9210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4422731a39954731a7cba02df0fe7f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.176848  9134 tablet_service.cc:1511] Processing CreateTablet for tablet abf4465ae8ec4897b8c2d6b979bd333e (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:18.181399  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e8b2076ad0455f9d8e82e90aee6860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.172513  9137 tablet_service.cc:1511] Processing CreateTablet for tablet db4cda0519cb428ab1ca8db0caf4d3d5 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:18.178994  9062 tablet_service.cc:1511] Processing CreateTablet for tablet db4cda0519cb428ab1ca8db0caf4d3d5 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:18.179848  9064 tablet_service.cc:1511] Processing CreateTablet for tablet ef2dbca51575438198f33e7d7cfdc619 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:18.182696  9063 tablet_service.cc:1511] Processing CreateTablet for tablet d1e8b2076ad0455f9d8e82e90aee6860 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:18.181696  9061 tablet_service.cc:1511] Processing CreateTablet for tablet 4422731a39954731a7cba02df0fe7f42 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:18.213768  9062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4cda0519cb428ab1ca8db0caf4d3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.210991  9060 tablet_service.cc:1511] Processing CreateTablet for tablet e510245a97bd4897aca0c7f16250126a (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:18.213490  9211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4cda0519cb428ab1ca8db0caf4d3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.222581  9059 tablet_service.cc:1511] Processing CreateTablet for tablet abf4465ae8ec4897b8c2d6b979bd333e (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:18.225006  9058 tablet_service.cc:1511] Processing CreateTablet for tablet 234d857a76c647c9aed130167ea55577 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:18.231843  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2dbca51575438198f33e7d7cfdc619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.225986  9135 tablet_service.cc:1511] Processing CreateTablet for tablet e510245a97bd4897aca0c7f16250126a (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:18.227624  9136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4422731a39954731a7cba02df0fe7f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.200753  9133 tablet_service.cc:1511] Processing CreateTablet for tablet 234d857a76c647c9aed130167ea55577 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:18.247082  9061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4422731a39954731a7cba02df0fe7f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.254532  9060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e510245a97bd4897aca0c7f16250126a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.255368  9058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234d857a76c647c9aed130167ea55577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.256068  9059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf4465ae8ec4897b8c2d6b979bd333e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.257423  9134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf4465ae8ec4897b8c2d6b979bd333e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.259136  9133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234d857a76c647c9aed130167ea55577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.261333  9135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e510245a97bd4897aca0c7f16250126a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.262631  9137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4cda0519cb428ab1ca8db0caf4d3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.264091  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e8b2076ad0455f9d8e82e90aee6860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.281123  9057 tablet_service.cc:1511] Processing CreateTablet for tablet 0031bd81cc07461da8ccca552ac004ff (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:18.282644  9057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0031bd81cc07461da8ccca552ac004ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.284036  9056 tablet_service.cc:1511] Processing CreateTablet for tablet d12e6c805b8c4ff5bc21ceeaaceb070c (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:18.286517  9132 tablet_service.cc:1511] Processing CreateTablet for tablet 0031bd81cc07461da8ccca552ac004ff (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:18.292214  9056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12e6c805b8c4ff5bc21ceeaaceb070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.292322  9132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0031bd81cc07461da8ccca552ac004ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.316754  9131 tablet_service.cc:1511] Processing CreateTablet for tablet d12e6c805b8c4ff5bc21ceeaaceb070c (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:18.366590  9207 tablet_service.cc:1511] Processing CreateTablet for tablet 234d857a76c647c9aed130167ea55577 (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 13:15:18.381599  9019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:18.392354  9207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 234d857a76c647c9aed130167ea55577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.395704  9131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12e6c805b8c4ff5bc21ceeaaceb070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.405377  9206 tablet_service.cc:1511] Processing CreateTablet for tablet 0031bd81cc07461da8ccca552ac004ff (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:18.410323  9206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0031bd81cc07461da8ccca552ac004ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.438625  9205 tablet_service.cc:1511] Processing CreateTablet for tablet d12e6c805b8c4ff5bc21ceeaaceb070c (DEFAULT_TABLE table=test-workload [id=2635017f9e504943903eeee086aa42de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:18.441797  9205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12e6c805b8c4ff5bc21ceeaaceb070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.456568  9266 tablet_bootstrap.cc:492] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:18.566424  9266 tablet_bootstrap.cc:654] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.640082  9268 tablet_bootstrap.cc:492] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:18.658772  9266 tablet_bootstrap.cc:492] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:18.671531  9266 ts_tablet_manager.cc:1403] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.011s
I20260709 13:15:18.682789  9099 heartbeater.cc:499] Master 127.8.186.254:39233 was elected leader, sending a full tablet report...
I20260709 13:15:18.683271  9266 raft_consensus.cc:359] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.685770  9266 raft_consensus.cc:385] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.686065  9266 raft_consensus.cc:740] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.707613  9269 tablet_bootstrap.cc:492] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:18.714521  9268 tablet_bootstrap.cc:654] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.713232  9266 consensus_queue.cc:260] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.727165  9269 tablet_bootstrap.cc:654] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.735319  9266 ts_tablet_manager.cc:1434] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.010s
I20260709 13:15:18.737403  9248 heartbeater.cc:499] Master 127.8.186.254:39233 was elected leader, sending a full tablet report...
I20260709 13:15:18.737828  9266 tablet_bootstrap.cc:492] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:18.744835  9266 tablet_bootstrap.cc:654] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.763489  9268 tablet_bootstrap.cc:492] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:18.764011  9268 ts_tablet_manager.cc:1403] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.025s
I20260709 13:15:18.764853  9269 tablet_bootstrap.cc:492] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:18.765630  9266 tablet_bootstrap.cc:492] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:18.765763  9269 ts_tablet_manager.cc:1403] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.092s	user 0.034s	sys 0.012s
I20260709 13:15:18.766065  9266 ts_tablet_manager.cc:1403] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.005s
I20260709 13:15:18.766883  9268 raft_consensus.cc:359] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:18.767619  9268 raft_consensus.cc:385] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.767983  9268 raft_consensus.cc:740] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.768692  9269 raft_consensus.cc:359] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.768738  9268 consensus_queue.cc:260] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:18.769470  9269 raft_consensus.cc:385] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.769562  9266 raft_consensus.cc:359] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.769809  9269 raft_consensus.cc:740] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.770211  9266 raft_consensus.cc:385] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.770484  9266 raft_consensus.cc:740] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.770676  9269 consensus_queue.cc:260] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.771121  9266 consensus_queue.cc:260] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.773231  9266 ts_tablet_manager.cc:1434] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:18.774236  9266 tablet_bootstrap.cc:492] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:18.778510  9268 ts_tablet_manager.cc:1434] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:15:18.782218  9268 tablet_bootstrap.cc:492] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:18.792362  9268 tablet_bootstrap.cc:654] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.792953  9266 tablet_bootstrap.cc:654] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.796198  9174 heartbeater.cc:499] Master 127.8.186.254:39233 was elected leader, sending a full tablet report...
I20260709 13:15:18.796810  9269 ts_tablet_manager.cc:1434] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.031s	user 0.016s	sys 0.015s
I20260709 13:15:18.798063  9269 tablet_bootstrap.cc:492] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:18.804813  9269 tablet_bootstrap.cc:654] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.805090  9268 tablet_bootstrap.cc:492] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:18.805558  9268 ts_tablet_manager.cc:1403] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 13:15:18.807972  9266 tablet_bootstrap.cc:492] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:18.808480  9266 ts_tablet_manager.cc:1403] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:15:18.808569  9268 raft_consensus.cc:359] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.809398  9268 raft_consensus.cc:385] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.809697  9268 raft_consensus.cc:740] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
W20260709 13:15:18.809885  9175 tablet.cc:2406] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:18.810781  9268 consensus_queue.cc:260] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.813643  9266 raft_consensus.cc:359] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:18.814424  9266 raft_consensus.cc:385] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.814710  9266 raft_consensus.cc:740] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.815383  9268 ts_tablet_manager.cc:1434] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:15:18.816346  9268 tablet_bootstrap.cc:492] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:18.816573  9269 tablet_bootstrap.cc:492] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:18.816996  9269 ts_tablet_manager.cc:1403] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:15:18.815433  9266 consensus_queue.cc:260] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:18.819927  9269 raft_consensus.cc:359] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.820662  9269 raft_consensus.cc:385] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.820994  9269 raft_consensus.cc:740] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.822203  9266 ts_tablet_manager.cc:1434] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:18.821920  9269 consensus_queue.cc:260] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.822721  9268 tablet_bootstrap.cc:654] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.823153  9266 tablet_bootstrap.cc:492] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:18.824005  9269 ts_tablet_manager.cc:1434] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:18.824935  9269 tablet_bootstrap.cc:492] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:18.832204  9269 tablet_bootstrap.cc:654] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.835183  9268 tablet_bootstrap.cc:492] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:18.835788  9268 ts_tablet_manager.cc:1403] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:15:18.838989  9268 raft_consensus.cc:359] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.839895  9268 raft_consensus.cc:385] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.840240  9268 raft_consensus.cc:740] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.841612  9266 tablet_bootstrap.cc:654] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.841141  9268 consensus_queue.cc:260] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.843693  9268 ts_tablet_manager.cc:1434] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:18.843842  9269 tablet_bootstrap.cc:492] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:18.844282  9269 ts_tablet_manager.cc:1403] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:15:18.844923  9268 tablet_bootstrap.cc:492] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:18.847136  9269 raft_consensus.cc:359] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.847891  9269 raft_consensus.cc:385] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.848210  9269 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.848994  9269 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.851580  9269 ts_tablet_manager.cc:1434] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:18.851902  9268 tablet_bootstrap.cc:654] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.852605  9269 tablet_bootstrap.cc:492] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:18.855777  9266 tablet_bootstrap.cc:492] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:18.856283  9266 ts_tablet_manager.cc:1403] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:15:18.859625  9269 tablet_bootstrap.cc:654] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.859354  9266 raft_consensus.cc:359] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.860100  9266 raft_consensus.cc:385] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.860424  9266 raft_consensus.cc:740] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.861146  9266 consensus_queue.cc:260] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.864207  9268 tablet_bootstrap.cc:492] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:18.864749  9268 ts_tablet_manager.cc:1403] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:15:18.867842  9268 raft_consensus.cc:359] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.868674  9268 raft_consensus.cc:385] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.869001  9268 raft_consensus.cc:740] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.869726  9268 consensus_queue.cc:260] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.871977  9268 ts_tablet_manager.cc:1434] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:15:18.872450  9269 tablet_bootstrap.cc:492] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:18.873097  9269 ts_tablet_manager.cc:1403] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:15:18.873127  9268 tablet_bootstrap.cc:492] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:18.873477  9266 ts_tablet_manager.cc:1434] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:18.874424  9266 tablet_bootstrap.cc:492] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:18.876232  9269 raft_consensus.cc:359] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.876988  9269 raft_consensus.cc:385] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.877285  9269 raft_consensus.cc:740] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.878527  9274 raft_consensus.cc:493] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.879026  9274 raft_consensus.cc:515] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:18.880381  9268 tablet_bootstrap.cc:654] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.880626  9266 tablet_bootstrap.cc:654] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.882198  9274 leader_election.cc:290] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:18.878157  9269 consensus_queue.cc:260] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.890791  9269 ts_tablet_manager.cc:1434] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:15:18.891992  9269 tablet_bootstrap.cc:492] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:18.932474  9269 tablet_bootstrap.cc:654] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.933964  9275 raft_consensus.cc:493] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.934461  9275 raft_consensus.cc:515] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.937541  9275 leader_election.cc:290] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:18.942195  9274 raft_consensus.cc:493] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.942667  9274 raft_consensus.cc:515] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.951851  9274 leader_election.cc:290] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:18.978873  9268 tablet_bootstrap.cc:492] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:18.979605  9268 ts_tablet_manager.cc:1403] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.014s
I20260709 13:15:18.985318  9268 raft_consensus.cc:359] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.986347  9268 raft_consensus.cc:385] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.984658  9274 raft_consensus.cc:493] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.986658  9268 raft_consensus.cc:740] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.987093  9274 raft_consensus.cc:515] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.987350  9268 consensus_queue.cc:260] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:18.984911  9270 raft_consensus.cc:493] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.991220  9270 raft_consensus.cc:515] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.011472  9274 leader_election.cc:290] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.013652  9270 leader_election.cc:290] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.029331  9266 tablet_bootstrap.cc:492] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:19.031186  9269 tablet_bootstrap.cc:492] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:19.032023  9266 ts_tablet_manager.cc:1403] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.158s	user 0.033s	sys 0.039s
I20260709 13:15:19.033990  9269 ts_tablet_manager.cc:1403] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.012s
I20260709 13:15:19.033042  9270 raft_consensus.cc:493] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.035722  9270 raft_consensus.cc:515] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.043138  9149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.043948  9270 leader_election.cc:290] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.044780  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.048979  9269 raft_consensus.cc:359] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:19.054433  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12e6c805b8c4ff5bc21ceeaaceb070c" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
W20260709 13:15:19.058143  9039 leader_election.cc:343] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.059216  9266 raft_consensus.cc:359] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.060011  9266 raft_consensus.cc:385] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.060304  9266 raft_consensus.cc:740] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.054976  9269 raft_consensus.cc:385] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.060990  9266 consensus_queue.cc:260] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.062842  9268 ts_tablet_manager.cc:1434] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.083s	user 0.026s	sys 0.010s
I20260709 13:15:19.062211  9269 raft_consensus.cc:740] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.072540  9268 tablet_bootstrap.cc:492] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:19.072242  9269 consensus_queue.cc:260] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
W20260709 13:15:19.073863  9039 leader_election.cc:343] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.074666  9149 raft_consensus.cc:2468] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 0.
I20260709 13:15:19.076733  9269 ts_tablet_manager.cc:1434] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.011s
I20260709 13:15:19.078209  9266 ts_tablet_manager.cc:1434] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 13:15:19.079834  9269 tablet_bootstrap.cc:492] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:19.081851  9266 tablet_bootstrap.cc:492] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:19.082254  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.082676  9039 leader_election.cc:304] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
W20260709 13:15:19.084784  9114 leader_election.cc:343] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.087839  9223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.088496  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.089459  9295 raft_consensus.cc:2804] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.092555  9295 raft_consensus.cc:493] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.092983  9295 raft_consensus.cc:3060] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.094355  9223 raft_consensus.cc:2468] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 0.
I20260709 13:15:19.095537  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12e6c805b8c4ff5bc21ceeaaceb070c" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.092090  9222 raft_consensus.cc:2468] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 0.
W20260709 13:15:19.100489  9038 leader_election.cc:343] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.100965  9038 leader_election.cc:304] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:19.101771  9274 raft_consensus.cc:2749] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.102185  9038 leader_election.cc:304] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:19.102939  9274 raft_consensus.cc:2804] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.103286  9274 raft_consensus.cc:493] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.103696  9274 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.111644  9269 tablet_bootstrap.cc:654] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.114964  9268 tablet_bootstrap.cc:654] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.116870  9274 raft_consensus.cc:515] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.119948  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.120081  9295 raft_consensus.cc:515] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:19.120600  9222 raft_consensus.cc:2468] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 0.
I20260709 13:15:19.122967  9113 leader_election.cc:304] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:19.124972  9275 raft_consensus.cc:2804] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.125429  9275 raft_consensus.cc:493] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.125797  9275 raft_consensus.cc:3060] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.129216  9295 leader_election.cc:290] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.132015  9149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:19.132619  9149 raft_consensus.cc:3060] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.135473  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:19.136076  9222 raft_consensus.cc:3060] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.136504  9266 tablet_bootstrap.cc:654] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.138049  9274 leader_election.cc:290] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.139206  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:19.139814  9221 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.140650  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
W20260709 13:15:19.142505  9039 leader_election.cc:343] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.146159  9275 raft_consensus.cc:515] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.148257  9275 leader_election.cc:290] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.150502  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.150959  9223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:19.151506  9223 raft_consensus.cc:3060] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.157120  9270 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.160981  9269 tablet_bootstrap.cc:492] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:19.160606  9270 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
W20260709 13:15:19.161274  9114 leader_election.cc:343] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.162743  9270 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.164253  9269 ts_tablet_manager.cc:1403] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.005s
I20260709 13:15:19.151049  9222 raft_consensus.cc:2468] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 1.
I20260709 13:15:19.168313  9223 raft_consensus.cc:2468] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 1.
I20260709 13:15:19.169839  9038 leader_election.cc:304] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.171393  9113 leader_election.cc:304] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:19.171481  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.171159  9149 raft_consensus.cc:2468] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 1.
I20260709 13:15:19.172474  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.173899  9275 raft_consensus.cc:2804] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.174443  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.175429  9072 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 0.
I20260709 13:15:19.176939  9074 raft_consensus.cc:2393] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 606fcd51583f4c888742712ca0d8084c in current term 1: Already voted for candidate 5fb74c4bf625489bb656f80e9b16f374 in this term.
W20260709 13:15:19.178606  9188 leader_election.cc:343] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.172235  9274 raft_consensus.cc:2804] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.180477  9268 tablet_bootstrap.cc:492] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:19.181705  9268 ts_tablet_manager.cc:1403] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.032s
I20260709 13:15:19.181576  9188 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.182467  9270 raft_consensus.cc:2804] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.181049  9274 raft_consensus.cc:697] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:19.182801  9270 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.183140  9270 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.183761  9274 consensus_queue.cc:237] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:19.188911  9221 raft_consensus.cc:2468] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 1.
I20260709 13:15:19.177911  9269 raft_consensus.cc:359] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.190012  9275 raft_consensus.cc:697] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:19.191370  9275 consensus_queue.cc:237] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.192360  9268 raft_consensus.cc:359] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.193167  9268 raft_consensus.cc:385] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.193506  9268 raft_consensus.cc:740] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.195983  9038 leader_election.cc:304] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:19.196836  9295 raft_consensus.cc:2804] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.190114  9269 raft_consensus.cc:385] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.202752  9302 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.203281  9302 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.206389  9268 consensus_queue.cc:260] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.207175  9302 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.208475  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.209113  9072 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 0.
I20260709 13:15:19.210903  9114 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:19.211817  9302 raft_consensus.cc:2804] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.212078  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.212248  9302 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.212903  9302 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.213388  9295 raft_consensus.cc:697] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:19.214308  9295 consensus_queue.cc:237] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.194804  9270 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.217085  9221 raft_consensus.cc:2393] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in current term 1: Already voted for candidate 606fcd51583f4c888742712ca0d8084c in this term.
I20260709 13:15:19.220142  9269 raft_consensus.cc:740] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.221055  9269 consensus_queue.cc:260] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.222060  9302 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.226284  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.226862  9072 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.228308  9302 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.232210  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.234128  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:19.236156  9149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.237533  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.239131  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.240010  9147 raft_consensus.cc:2393] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 606fcd51583f4c888742712ca0d8084c in current term 1: Already voted for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in this term.
W20260709 13:15:19.241292  9188 leader_election.cc:343] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.241670  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:19.241927  9188 leader_election.cc:304] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 606fcd51583f4c888742712ca0d8084c; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:19.242439  9147 raft_consensus.cc:2393] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 606fcd51583f4c888742712ca0d8084c in current term 1: Already voted for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in this term.
I20260709 13:15:19.248878  9072 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 1.
I20260709 13:15:19.225159  9270 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.224761  9268 ts_tablet_manager.cc:1434] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.006s
I20260709 13:15:19.253857  9270 raft_consensus.cc:2749] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.254484  9268 tablet_bootstrap.cc:492] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:19.256115  9266 tablet_bootstrap.cc:492] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:19.256580  9266 ts_tablet_manager.cc:1403] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.021s
I20260709 13:15:19.259649  9269 ts_tablet_manager.cc:1434] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.001s
I20260709 13:15:19.260797  9269 tablet_bootstrap.cc:492] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:19.261541  9268 tablet_bootstrap.cc:654] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.273111  9302 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.274004  9302 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.275913  9113 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5; no voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:19.276392  9302 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.276921  9302 raft_consensus.cc:2749] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.277186  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.278601  9188 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
W20260709 13:15:19.278817  9114 leader_election.cc:343] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.271451  9266 raft_consensus.cc:359] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.286070  9307 raft_consensus.cc:2804] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.286684  9307 raft_consensus.cc:697] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:19.284063  9266 raft_consensus.cc:385] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.287552  9307 consensus_queue.cc:237] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.287925  9266 raft_consensus.cc:740] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.296708  9266 consensus_queue.cc:260] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.304728  8971 catalog_manager.cc:5697] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.307541  9270 raft_consensus.cc:493] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.308284  9268 tablet_bootstrap.cc:492] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:19.307994  9270 raft_consensus.cc:515] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.308753  9268 ts_tablet_manager.cc:1403] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.006s
I20260709 13:15:19.307348  9266 ts_tablet_manager.cc:1434] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:15:19.310582  9270 leader_election.cc:290] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.312363  9266 tablet_bootstrap.cc:492] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:19.314366  9268 raft_consensus.cc:359] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.305881  9188 leader_election.cc:304] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 606fcd51583f4c888742712ca0d8084c; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:19.315080  9268 raft_consensus.cc:385] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.315390  9268 raft_consensus.cc:740] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.315838  9270 raft_consensus.cc:2749] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.323670  9275 raft_consensus.cc:493] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.324175  9275 raft_consensus.cc:515] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.320407  9268 consensus_queue.cc:260] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.322153  8969 catalog_manager.cc:5697] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.328715  9275 leader_election.cc:290] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.328788  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.329365  9266 tablet_bootstrap.cc:654] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.329425  9072 raft_consensus.cc:2468] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 0.
I20260709 13:15:19.331604  9114 leader_election.cc:304] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:19.331204  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.332686  9275 raft_consensus.cc:2804] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.333106  9275 raft_consensus.cc:493] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.333199  9072 raft_consensus.cc:2468] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 0.
I20260709 13:15:19.333441  9275 raft_consensus.cc:3060] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.335971  9188 leader_election.cc:304] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.336088  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.335461  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.336483  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.337219  9222 raft_consensus.cc:2468] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 0.
W20260709 13:15:19.337602  9113 leader_election.cc:343] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.338037  9113 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5; no voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:19.339097  9302 raft_consensus.cc:2749] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.339531  9269 tablet_bootstrap.cc:654] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.340132  9307 raft_consensus.cc:2804] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.340559  9307 raft_consensus.cc:493] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.339253  9268 ts_tablet_manager.cc:1434] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:15:19.342896  9307 raft_consensus.cc:3060] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:19.343189  9188 leader_election.cc:343] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.344061  9268 tablet_bootstrap.cc:492] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:19.348212  9275 raft_consensus.cc:515] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.354678  9307 raft_consensus.cc:515] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.355221  9268 tablet_bootstrap.cc:654] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.357513  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.358201  9072 raft_consensus.cc:3060] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.357112  9275 leader_election.cc:290] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.358506  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:19.361099  9222 raft_consensus.cc:3060] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.361564  9269 tablet_bootstrap.cc:492] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:19.362109  9269 ts_tablet_manager.cc:1403] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.005s
I20260709 13:15:19.366464  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.366798  9307 leader_election.cc:290] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.367202  9074 raft_consensus.cc:3060] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.368595  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
W20260709 13:15:19.370065  9188 leader_election.cc:343] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:19.372607  9222 raft_consensus.cc:2468] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 1.
I20260709 13:15:19.373896  9113 leader_election.cc:304] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.374637  9072 raft_consensus.cc:2468] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 1.
I20260709 13:15:19.374859  9275 raft_consensus.cc:2804] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.375402  9275 raft_consensus.cc:697] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:19.376994  9275 consensus_queue.cc:237] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.378031  9266 tablet_bootstrap.cc:492] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:19.378522  9266 ts_tablet_manager.cc:1403] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.006s
I20260709 13:15:19.385825  9074 raft_consensus.cc:2468] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 1.
I20260709 13:15:19.389302  9266 raft_consensus.cc:359] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.390502  9266 raft_consensus.cc:385] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.390662  9188 leader_election.cc:304] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:19.391045  9266 raft_consensus.cc:740] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.394013  9307 raft_consensus.cc:2804] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.394518  9307 raft_consensus.cc:697] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:19.394858  9266 consensus_queue.cc:260] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.395303  9307 consensus_queue.cc:237] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.398926  9269 raft_consensus.cc:359] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.399760  9269 raft_consensus.cc:385] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.400131  9269 raft_consensus.cc:740] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.401031  9269 consensus_queue.cc:260] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
W20260709 13:15:19.405202  9019 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:19.395682  8970 catalog_manager.cc:5697] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 0 to 1, leader changed from <none> to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 1 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.407220  9266 ts_tablet_manager.cc:1434] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:15:19.409847  9266 tablet_bootstrap.cc:492] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:19.410187  9269 ts_tablet_manager.cc:1434] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:15:19.411152  9269 tablet_bootstrap.cc:492] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:19.417749  9269 tablet_bootstrap.cc:654] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.419799  9268 tablet_bootstrap.cc:492] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:19.420243  9268 ts_tablet_manager.cc:1403] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.013s
I20260709 13:15:19.421365  9266 tablet_bootstrap.cc:654] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.422796  9268 raft_consensus.cc:359] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.426925  9268 raft_consensus.cc:385] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.427353  9268 raft_consensus.cc:740] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.428158  9268 consensus_queue.cc:260] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.430382  9268 ts_tablet_manager.cc:1434] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:19.431272  9268 tablet_bootstrap.cc:492] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: Bootstrap starting.
I20260709 13:15:19.433212  8970 catalog_manager.cc:5697] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.439249  9268 tablet_bootstrap.cc:654] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.440848  9266 tablet_bootstrap.cc:492] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:19.441587  9266 ts_tablet_manager.cc:1403] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.008s
I20260709 13:15:19.443174  9269 tablet_bootstrap.cc:492] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:19.443650  9269 ts_tablet_manager.cc:1403] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.008s
I20260709 13:15:19.444185  9266 raft_consensus.cc:359] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.444849  9266 raft_consensus.cc:385] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.445160  9266 raft_consensus.cc:740] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.445930  9266 consensus_queue.cc:260] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.446441  9269 raft_consensus.cc:359] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.447868  9269 raft_consensus.cc:385] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.448115  9266 ts_tablet_manager.cc:1434] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:19.447419  8971 catalog_manager.cc:5697] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 0 to 1, leader changed from <none> to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 1 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.448187  9269 raft_consensus.cc:740] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.449654  9266 tablet_bootstrap.cc:492] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: Bootstrap starting.
I20260709 13:15:19.450057  9269 consensus_queue.cc:260] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.452294  9269 ts_tablet_manager.cc:1434] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:19.453157  9269 tablet_bootstrap.cc:492] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Bootstrap starting.
I20260709 13:15:19.456221  9266 tablet_bootstrap.cc:654] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.459779  8969 catalog_manager.cc:5697] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.474073  9268 tablet_bootstrap.cc:492] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: No bootstrap required, opened a new log
I20260709 13:15:19.474651  9268 ts_tablet_manager.cc:1403] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.014s
I20260709 13:15:19.477365  9268 raft_consensus.cc:359] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.478080  9268 raft_consensus.cc:385] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.478384  9268 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.478999  9268 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.481212  9268 ts_tablet_manager.cc:1434] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:15:19.482816  9269 tablet_bootstrap.cc:654] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.492043  9266 tablet_bootstrap.cc:492] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: No bootstrap required, opened a new log
I20260709 13:15:19.492610  9266 ts_tablet_manager.cc:1403] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.020s
I20260709 13:15:19.495848  9269 tablet_bootstrap.cc:492] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5: No bootstrap required, opened a new log
I20260709 13:15:19.496270  9269 ts_tablet_manager.cc:1403] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.010s
I20260709 13:15:19.495405  9266 raft_consensus.cc:359] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.496560  9266 raft_consensus.cc:385] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.496836  9266 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.497534  9266 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.498256  9269 raft_consensus.cc:359] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.498751  9269 raft_consensus.cc:385] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.498955  9269 raft_consensus.cc:740] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.499495  9269 consensus_queue.cc:260] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.501974  9266 ts_tablet_manager.cc:1434] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:15:19.507293  9269 ts_tablet_manager.cc:1434] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:19.559361  9307 raft_consensus.cc:493] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.559845  9307 raft_consensus.cc:515] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.561633  9307 leader_election.cc:290] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.562345  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.562752  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.562955  9074 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 0.
I20260709 13:15:19.563326  9148 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 0.
I20260709 13:15:19.564007  9188 leader_election.cc:304] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.564651  9307 raft_consensus.cc:2804] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.564997  9307 raft_consensus.cc:493] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.565289  9307 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.569433  9307 raft_consensus.cc:515] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.571007  9307 leader_election.cc:290] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.571802  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.572010  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:19.572278  9074 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.572621  9148 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.576790  9074 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 1.
I20260709 13:15:19.577754  9188 leader_election.cc:304] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.578374  9307 raft_consensus.cc:2804] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.579077  9307 raft_consensus.cc:697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:19.579205  9148 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 1.
I20260709 13:15:19.581897  9307 consensus_queue.cc:237] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.589505  8970 catalog_manager.cc:5697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 0 to 1, leader changed from <none> to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 1 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.653669  9295 raft_consensus.cc:493] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.654137  9295 raft_consensus.cc:515] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.655795  9295 leader_election.cc:290] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.656575  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.656831  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.657428  9222 raft_consensus.cc:2393] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fb74c4bf625489bb656f80e9b16f374 in current term 1: Already voted for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in this term.
I20260709 13:15:19.658288  9038 leader_election.cc:304] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374; no voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:19.658845  9295 raft_consensus.cc:3060] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.663252  9295 raft_consensus.cc:2749] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.665360  9295 consensus_queue.cc:1048] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.669718  9275 raft_consensus.cc:493] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.670173  9275 raft_consensus.cc:515] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.672132  9275 leader_election.cc:290] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.674028  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.674926  9074 raft_consensus.cc:2393] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in current term 1: Already voted for candidate 606fcd51583f4c888742712ca0d8084c in this term.
I20260709 13:15:19.674134  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.677783  9304 consensus_queue.cc:1048] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:19.683000  9113 leader_election.cc:304] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5; no voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:19.684851  9275 raft_consensus.cc:3060] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.685930  9304 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.686400  9304 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.689733  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c" is_pre_election: true
I20260709 13:15:19.690367  9221 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 0.
I20260709 13:15:19.691587  9038 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.692461  9274 raft_consensus.cc:2804] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.692827  9274 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.693159  9274 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.694517  9304 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.700066  9274 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.702951  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:19.703504  9147 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.705372  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.708281  9275 raft_consensus.cc:2749] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:19.709887  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:19.710476  9221 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.711036  9147 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 1.
I20260709 13:15:19.711567  9274 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:19.712898  9039 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:19.713743  9274 raft_consensus.cc:2804] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.714478  9274 raft_consensus.cc:697] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:19.715315  9274 consensus_queue.cc:237] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.718150  9221 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 1.
I20260709 13:15:19.719250  9307 raft_consensus.cc:493] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.719684  9307 raft_consensus.cc:515] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.721638  9307 leader_election.cc:290] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.722091  9307 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.722684  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12e6c805b8c4ff5bc21ceeaaceb070c" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374" is_pre_election: true
I20260709 13:15:19.723290  9074 raft_consensus.cc:2468] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 0.
I20260709 13:15:19.726737  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12e6c805b8c4ff5bc21ceeaaceb070c" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" is_pre_election: true
I20260709 13:15:19.727458  9147 raft_consensus.cc:2468] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 0.
I20260709 13:15:19.728703  9188 leader_election.cc:304] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.729562  9307 raft_consensus.cc:2804] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:19.729900  9307 raft_consensus.cc:493] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.730296  9307 raft_consensus.cc:3060] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.729988  8969 catalog_manager.cc:5697] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.746008  9307 raft_consensus.cc:515] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.748312  9307 leader_election.cc:290] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:19.750818  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12e6c805b8c4ff5bc21ceeaaceb070c" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:19.751034  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12e6c805b8c4ff5bc21ceeaaceb070c" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:19.751462  9074 raft_consensus.cc:3060] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.751590  9147 raft_consensus.cc:3060] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.758291  9147 raft_consensus.cc:2468] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 1.
I20260709 13:15:19.758741  9074 raft_consensus.cc:2468] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 1.
I20260709 13:15:19.759357  9188 leader_election.cc:304] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:19.760288  9313 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:19.761091  9307 raft_consensus.cc:2804] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.762849  9307 raft_consensus.cc:697] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:19.763783  9307 consensus_queue.cc:237] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:19.769652  9148 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.778795  9274 consensus_queue.cc:1048] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.788107  8969 catalog_manager.cc:5697] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 0 to 1, leader changed from <none> to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 1 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.790213  9275 consensus_queue.cc:1048] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:19.805495  9295 consensus_queue.cc:1048] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.814162  9302 consensus_queue.cc:1048] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:19.818850  9302 consensus_queue.cc:1048] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.865921  9307 consensus_queue.cc:1048] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.889801  9313 consensus_queue.cc:1048] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:19.949940  9113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:34981, user_credentials={real_user=slave}} blocked reactor thread for 102477us
W20260709 13:15:19.955653  9114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:33111, user_credentials={real_user=slave}} blocked reactor thread for 117411us
I20260709 13:15:19.959156  9221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
mode: GRACEFUL
new_leader_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:15:19.958863  9345 consensus_queue.cc:1048] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:19.959865  9221 raft_consensus.cc:606] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Received request to transfer leadership to TS 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:19.967183  9221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
mode: GRACEFUL
new_leader_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:15:19.967823  9221 raft_consensus.cc:606] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Received request to transfer leadership to TS 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:19.998737  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:36204
I20260709 13:15:19.999208  9072 raft_consensus.cc:606] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:20.004405  9221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:15:20.004864  9221 raft_consensus.cc:606] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:20.035349  9307 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.047399  9313 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.055317  9270 raft_consensus.cc:993] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: : Instructing follower 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:20.055814  9313 raft_consensus.cc:1081] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Signalling peer 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:20.057534  9072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:36196
I20260709 13:15:20.058040  9072 raft_consensus.cc:493] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.058291  9072 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.062355  9072 raft_consensus.cc:515] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.063966  9072 leader_election.cc:290] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:20.065516  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:20.065459  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:20.066109  9221 raft_consensus.cc:3055] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.066299  9147 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.066496  9221 raft_consensus.cc:740] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:20.067330  9221 consensus_queue.cc:260] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.068720  9221 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.070722  9147 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:20.071734  9039 leader_election.cc:304] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:20.072575  9295 raft_consensus.cc:2804] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.073038  9295 raft_consensus.cc:697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:20.073820  9295 consensus_queue.cc:237] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.074915  9221 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:20.080391  8969 catalog_manager.cc:5697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 1 to 2, leader changed from 606fcd51583f4c888742712ca0d8084c (127.8.186.195) to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.136641  9304 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.148132  9295 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.162217  9295 raft_consensus.cc:993] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:20.162657  9304 raft_consensus.cc:1081] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:20.164625  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54740
I20260709 13:15:20.165297  9147 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.165723  9147 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.170907  9147 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.173560  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:20.173801  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:20.174150  9072 raft_consensus.cc:3055] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.174374  9222 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.174499  9072 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:20.175330  9072 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.176496  9072 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.177826  9147 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 2 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:20.180624  9222 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 2.
I20260709 13:15:20.181806  9113 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:20.182600  9345 raft_consensus.cc:2804] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.183041  9072 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 2.
I20260709 13:15:20.183059  9345 raft_consensus.cc:697] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:20.184145  9345 consensus_queue.cc:237] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.191089  8971 catalog_manager.cc:5697] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 1 to 2, leader changed from 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.215927  9313 consensus_queue.cc:1048] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.226613  9270 consensus_queue.cc:1048] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:20.289978  9307 raft_consensus.cc:993] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:20.290381  9270 raft_consensus.cc:1081] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:20.291682  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:20.292187  9147 raft_consensus.cc:493] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.292454  9147 raft_consensus.cc:3060] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.296770  9147 raft_consensus.cc:515] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.298404  9147 leader_election.cc:290] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 2 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:20.299172  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:20.299651  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0031bd81cc07461da8ccca552ac004ff" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:20.299731  9072 raft_consensus.cc:3060] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.300237  9222 raft_consensus.cc:3055] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.300549  9222 raft_consensus.cc:740] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:20.301345  9222 consensus_queue.cc:260] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.302527  9222 raft_consensus.cc:3060] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.306036  9072 raft_consensus.cc:2468] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 2.
I20260709 13:15:20.307278  9114 leader_election.cc:304] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:20.308113  9345 raft_consensus.cc:2804] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.308578  9222 raft_consensus.cc:2468] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 2.
I20260709 13:15:20.308583  9345 raft_consensus.cc:697] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:20.309579  9345 consensus_queue.cc:237] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.316519  8971 catalog_manager.cc:5697] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 1 to 2, leader changed from 606fcd51583f4c888742712ca0d8084c (127.8.186.195) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.328174  9270 raft_consensus.cc:993] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: : Instructing follower 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:20.328649  9307 raft_consensus.cc:1081] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Signalling peer 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:20.330184  9072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:36196
I20260709 13:15:20.330706  9072 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.331060  9072 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.337543  9072 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.340436  9072 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:20.340905  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:20.341781  9222 raft_consensus.cc:3055] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.342106  9222 raft_consensus.cc:740] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:20.340494  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:20.343116  9147 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.343003  9222 consensus_queue.cc:260] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.344254  9222 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.349700  9147 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:20.350418  9222 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:20.350924  9039 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:20.351811  9356 raft_consensus.cc:2804] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.352172  9356 raft_consensus.cc:697] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:20.352926  9356 consensus_queue.cc:237] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:20.358655  8971 catalog_manager.cc:5697] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 1 to 2, leader changed from 606fcd51583f4c888742712ca0d8084c (127.8.186.195) to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.477699  9147 raft_consensus.cc:1275] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.478932  9356 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.491081  9222 raft_consensus.cc:1275] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.492581  9356 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.734226  9072 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.735424  9302 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.742596  9222 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.744076  9345 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.753309  9147 raft_consensus.cc:1275] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.754700  9356 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.762456  9222 raft_consensus.cc:1275] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.763937  9304 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.810469  9072 raft_consensus.cc:1275] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.812016  9345 consensus_queue.cc:1048] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.819952  9221 raft_consensus.cc:1275] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.821528  9345 consensus_queue.cc:1048] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.037597  8939 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:15:23.038563  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:23.057127  9147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
mode: GRACEFUL
new_leader_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:35050
I20260709 13:15:23.057646  9147 raft_consensus.cc:606] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Received request to transfer leadership to TS 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:23.067960  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
mode: GRACEFUL
new_leader_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:15:23.068499  9072 raft_consensus.cc:606] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Received request to transfer leadership to TS 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:23.069504  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:23.069955  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:23.529446  9304 raft_consensus.cc:993] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: : Instructing follower 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:23.529851  9364 raft_consensus.cc:1081] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Signalling peer 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:23.531256  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:51942
I20260709 13:15:23.531847  9222 raft_consensus.cc:493] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.532127  9222 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.536576  9222 raft_consensus.cc:515] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:23.538235  9222 leader_election.cc:290] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 2 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:23.538955  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:23.539366  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:23.539532  9072 raft_consensus.cc:3055] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.539851  9147 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.539861  9072 raft_consensus.cc:740] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:23.540688  9072 consensus_queue.cc:260] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:23.541555  9072 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.544636  9147 raft_consensus.cc:2468] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 2.
I20260709 13:15:23.545766  9188 leader_election.cc:304] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:23.546505  9307 raft_consensus.cc:2804] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.546669  9072 raft_consensus.cc:2468] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 2.
I20260709 13:15:23.548178  9307 raft_consensus.cc:697] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:23.549048  9307 consensus_queue.cc:237] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:23.557582  8969 catalog_manager.cc:5697] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 1 to 2, leader changed from 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193) to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 2 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.618216  9372 raft_consensus.cc:993] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: : Instructing follower 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:23.618734  9372 raft_consensus.cc:1081] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Signalling peer 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:23.620167  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:51944
I20260709 13:15:23.620620  9222 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.620885  9222 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.625528  9222 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:23.627214  9222 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 3 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:23.628084  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:23.628285  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:23.628705  9072 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.628801  9147 raft_consensus.cc:3055] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.629135  9147 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:23.629908  9147 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:23.631079  9147 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.635282  9072 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 3.
I20260709 13:15:23.636715  9188 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:23.637369  9307 raft_consensus.cc:2804] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:23.637346  9147 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 3.
I20260709 13:15:23.637971  9307 raft_consensus.cc:697] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:23.638773  9307 consensus_queue.cc:237] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:23.645825  8969 catalog_manager.cc:5697] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 2 to 3, leader changed from 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194) to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 3 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.983664  9147 raft_consensus.cc:1275] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.985124  9307 consensus_queue.cc:1048] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.994585  9072 raft_consensus.cc:1275] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.996304  9365 consensus_queue.cc:1048] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.070803  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:24.080511  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:36204
I20260709 13:15:24.081034  9072 raft_consensus.cc:606] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:24.086295  9222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:15:24.086818  9222 raft_consensus.cc:606] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:24.092020  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:36204
I20260709 13:15:24.092515  9072 raft_consensus.cc:606] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:24.097625  9072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:36204
I20260709 13:15:24.098114  9072 raft_consensus.cc:606] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:24.108721  9221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
mode: GRACEFUL
new_leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:51948
I20260709 13:15:24.109263  9221 raft_consensus.cc:606] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 LEADER]: Received request to transfer leadership to TS 4d4c8e9a6b184e459ba4cca5b74d90f5
I20260709 13:15:24.111389  9072 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.112553  9365 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.122406  9147 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.123589  9366 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.130124  9307 raft_consensus.cc:993] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.130545  9366 raft_consensus.cc:1081] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.132282  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:24.132707  9147 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.132972  9147 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.137260  9147 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.139070  9147 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 4 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:24.140002  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:24.140149  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:24.140597  9072 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.140663  9221 raft_consensus.cc:3055] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:24.141202  9221 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:24.142225  9221 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.143429  9221 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.147192  9072 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 4.
I20260709 13:15:24.148312  9114 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:24.149013  9372 raft_consensus.cc:2804] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:24.149335  9221 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 4.
I20260709 13:15:24.150158  9372 raft_consensus.cc:697] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:24.151046  9372 consensus_queue.cc:237] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.156802  8971 catalog_manager.cc:5697] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 3 to 4, leader changed from 606fcd51583f4c888742712ca0d8084c (127.8.186.195) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.209182  9364 raft_consensus.cc:993] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.209578  9304 raft_consensus.cc:1081] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.210893  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54740
I20260709 13:15:24.211275  9147 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.211493  9147 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.215459  9147 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.216876  9147 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 3 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:24.217877  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:24.217877  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:24.218557  9072 raft_consensus.cc:3055] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.218642  9221 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.218921  9072 raft_consensus.cc:740] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:24.219628  9072 consensus_queue.cc:260] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.220741  9072 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.225222  9221 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 3.
I20260709 13:15:24.226467  9072 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 3.
I20260709 13:15:24.226500  9113 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:24.227358  9372 raft_consensus.cc:2804] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.227828  9372 raft_consensus.cc:697] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:24.228505  9372 consensus_queue.cc:237] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.235121  8971 catalog_manager.cc:5697] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 2 to 3, leader changed from 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.401378  9307 raft_consensus.cc:993] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.401831  9366 raft_consensus.cc:1081] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.403234  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54754
I20260709 13:15:24.403666  9147 raft_consensus.cc:493] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.403960  9147 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.407835  9147 raft_consensus.cc:515] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.409255  9147 leader_election.cc:290] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 3 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:24.410171  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:24.410274  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e8b2076ad0455f9d8e82e90aee6860" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:24.410614  9072 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.410833  9221 raft_consensus.cc:3055] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.411237  9221 raft_consensus.cc:740] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:24.412009  9221 consensus_queue.cc:260] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.412897  9221 raft_consensus.cc:3060] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.414819  9072 raft_consensus.cc:2468] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 3.
I20260709 13:15:24.415774  9114 leader_election.cc:304] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:24.416404  9382 raft_consensus.cc:2804] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.416755  9382 raft_consensus.cc:697] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:24.417601  9221 raft_consensus.cc:2468] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 3.
I20260709 13:15:24.417452  9382 consensus_queue.cc:237] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.423254  8971 catalog_manager.cc:5697] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 2 to 3, leader changed from 606fcd51583f4c888742712ca0d8084c (127.8.186.195) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.588956  9364 raft_consensus.cc:993] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.589354  9304 raft_consensus.cc:1081] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.590732  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54740
I20260709 13:15:24.591128  9147 raft_consensus.cc:493] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.591364  9147 raft_consensus.cc:3060] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.595363  9147 raft_consensus.cc:515] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:24.596766  9147 leader_election.cc:290] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 2 election: Requested vote from peers 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981), 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111)
I20260709 13:15:24.597601  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:24.597713  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2dbca51575438198f33e7d7cfdc619" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:24.598170  9221 raft_consensus.cc:3060] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.598224  9072 raft_consensus.cc:3055] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.598511  9072 raft_consensus.cc:740] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:24.599189  9072 consensus_queue.cc:260] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:24.600000  9072 raft_consensus.cc:3060] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.602726  9221 raft_consensus.cc:2468] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 2.
I20260709 13:15:24.603894  9113 leader_election.cc:304] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:24.604583  9382 raft_consensus.cc:2804] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:24.604594  9072 raft_consensus.cc:2468] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 2.
I20260709 13:15:24.605167  9382 raft_consensus.cc:697] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:24.605964  9382 consensus_queue.cc:237] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } }
I20260709 13:15:24.606808  9364 raft_consensus.cc:993] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: : Instructing follower 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.607234  9304 raft_consensus.cc:1081] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Signalling peer 4d4c8e9a6b184e459ba4cca5b74d90f5 to start an election
I20260709 13:15:24.608748  9147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
 from {username='slave'} at 127.0.0.1:54740
I20260709 13:15:24.609189  9147 raft_consensus.cc:493] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.609459  9147 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.614148  8971 catalog_manager.cc:5697] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 1 to 2, leader changed from 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.615473  9147 raft_consensus.cc:515] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.617753  9147 leader_election.cc:290] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 3 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:24.618014  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:24.618544  9072 raft_consensus.cc:3055] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.618851  9072 raft_consensus.cc:740] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:24.619262  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:24.619926  9221 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.619549  9072 consensus_queue.cc:260] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.621047  9072 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.625913  9072 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 3.
I20260709 13:15:24.625905  9221 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4c8e9a6b184e459ba4cca5b74d90f5 in term 3.
I20260709 13:15:24.626948  9114 leader_election.cc:304] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:24.627583  9382 raft_consensus.cc:2804] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.628077  9382 raft_consensus.cc:697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Becoming Leader. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:24.628762  9382 consensus_queue.cc:237] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:24.634994  8971 catalog_manager.cc:5697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 reported cstate change: term changed from 2 to 3, leader changed from 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193) to 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.647979  9221 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.649087  9382 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.654706  9072 raft_consensus.cc:1275] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.657878  9390 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.658128  9072 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.659878  9382 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.668735  9221 raft_consensus.cc:1275] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.670228  9390 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.892369  9072 raft_consensus.cc:1275] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.893654  9372 consensus_queue.cc:1048] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.904337  9221 raft_consensus.cc:1275] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.905731  9372 consensus_queue.cc:1048] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:25.034695  9072 raft_consensus.cc:1275] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:25.035969  9372 consensus_queue.cc:1048] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:25.045428  9221 raft_consensus.cc:1275] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:25.047456  9372 consensus_queue.cc:1048] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:25.092760  9072 raft_consensus.cc:1275] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:25.093847  9382 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:25.103304  9221 raft_consensus.cc:1275] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Refusing update from remote peer 4d4c8e9a6b184e459ba4cca5b74d90f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:25.104592  9382 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.116701  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:27.125073  9147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
mode: GRACEFUL
new_leader_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:35050
I20260709 13:15:27.125880  9147 raft_consensus.cc:606] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 LEADER]: Received request to transfer leadership to TS 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:27.128635  9147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
mode: GRACEFUL
new_leader_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:35050
I20260709 13:15:27.129055  9147 raft_consensus.cc:606] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Received request to transfer leadership to TS 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:27.131163  9147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
mode: GRACEFUL
new_leader_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:35050
I20260709 13:15:27.131579  9147 raft_consensus.cc:606] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Received request to transfer leadership to TS 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:27.133692  9147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
mode: GRACEFUL
new_leader_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:35050
I20260709 13:15:27.134121  9147 raft_consensus.cc:606] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Received request to transfer leadership to TS 606fcd51583f4c888742712ca0d8084c
I20260709 13:15:27.136350  9147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a"
dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
mode: GRACEFUL
new_leader_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:35050
I20260709 13:15:27.136816  9147 raft_consensus.cc:606] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Received request to transfer leadership to TS 5fb74c4bf625489bb656f80e9b16f374
I20260709 13:15:27.137827  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:27.138221  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:27.307722  9396 raft_consensus.cc:993] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: : Instructing follower 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:27.308346  9401 raft_consensus.cc:1081] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Signalling peer 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:27.310084  9221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:51944
I20260709 13:15:27.310531  9221 raft_consensus.cc:493] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.310817  9221 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.317376  9221 raft_consensus.cc:515] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.319401  9401 raft_consensus.cc:993] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: : Instructing follower 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:27.319983  9401 raft_consensus.cc:1081] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Signalling peer 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:27.320254  9221 leader_election.cc:290] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 4 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:27.320418  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:27.321287  9074 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.321420  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4cda0519cb428ab1ca8db0caf4d3d5" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:27.321943  9147 raft_consensus.cc:3055] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:27.322157  9147 raft_consensus.cc:740] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:27.323137  9401 raft_consensus.cc:993] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: : Instructing follower 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:27.322894  9147 consensus_queue.cc:260] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.323559  9072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:36190
I20260709 13:15:27.324191  9072 raft_consensus.cc:493] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.324376  9147 raft_consensus.cc:3060] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.324615  9072 raft_consensus.cc:3060] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.326639  9396 raft_consensus.cc:1081] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Signalling peer 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:27.328923  9073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:36190
I20260709 13:15:27.329546  9073 raft_consensus.cc:493] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.328943  9074 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 4.
I20260709 13:15:27.329933  9073 raft_consensus.cc:3060] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.331264  9188 leader_election.cc:304] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:27.331357  9147 raft_consensus.cc:2468] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 4.
I20260709 13:15:27.332178  9366 raft_consensus.cc:2804] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:27.333174  9366 raft_consensus.cc:697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 4 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:27.334082  9366 consensus_queue.cc:237] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.336423  9072 raft_consensus.cc:515] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.336490  9073 raft_consensus.cc:515] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.340142  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:27.340552  9072 leader_election.cc:290] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:27.340674  9149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:27.340878  9148 raft_consensus.cc:3055] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:27.341240  9148 raft_consensus.cc:740] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:27.339781  9073 leader_election.cc:290] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:27.342092  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e510245a97bd4897aca0c7f16250126a" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:27.342137  9148 consensus_queue.cc:260] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.342808  9222 raft_consensus.cc:3060] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.341300  9149 raft_consensus.cc:3055] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:27.343616  9149 raft_consensus.cc:740] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:27.344205  9221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf4465ae8ec4897b8c2d6b979bd333e" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:27.343617  9148 raft_consensus.cc:3060] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.344705  9221 raft_consensus.cc:3060] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.344635  9149 consensus_queue.cc:260] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.346040  9149 raft_consensus.cc:3060] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.343672  8971 catalog_manager.cc:5697] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 3 to 4, leader changed from 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194) to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 4 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.350153  9222 raft_consensus.cc:2468] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:27.351917  9221 raft_consensus.cc:2468] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:27.351990  9038 leader_election.cc:304] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:27.353477  9149 raft_consensus.cc:2468] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:27.354831  9039 leader_election.cc:304] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4c8e9a6b184e459ba4cca5b74d90f5, 5fb74c4bf625489bb656f80e9b16f374; no voters: 
I20260709 13:15:27.355919  9148 raft_consensus.cc:2468] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 2.
I20260709 13:15:27.357837  9406 raft_consensus.cc:2804] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:27.359048  9407 raft_consensus.cc:2804] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:27.360160  9406 raft_consensus.cc:697] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:27.361194  9406 consensus_queue.cc:237] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.366753  9407 raft_consensus.cc:697] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:27.369056  9407 consensus_queue.cc:237] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.371460  8969 catalog_manager.cc:5697] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 1 to 2, leader changed from 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194) to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.383630  8969 catalog_manager.cc:5697] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 1 to 2, leader changed from 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194) to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.408382  9401 raft_consensus.cc:993] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: : Instructing follower 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:27.408919  9402 raft_consensus.cc:1081] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 LEADER]: Signalling peer 606fcd51583f4c888742712ca0d8084c to start an election
I20260709 13:15:27.410370  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "234d857a76c647c9aed130167ea55577"
dest_uuid: "606fcd51583f4c888742712ca0d8084c"
 from {username='slave'} at 127.0.0.1:51944
I20260709 13:15:27.410790  9222 raft_consensus.cc:493] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.411054  9222 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.415009  9222 raft_consensus.cc:515] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.416567  9222 leader_election.cc:290] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 5 election: Requested vote from peers 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111), 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207)
I20260709 13:15:27.417501  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
I20260709 13:15:27.417610  9149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "234d857a76c647c9aed130167ea55577" candidate_uuid: "606fcd51583f4c888742712ca0d8084c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:27.418057  9073 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.418143  9149 raft_consensus.cc:3055] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:27.418550  9149 raft_consensus.cc:740] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:27.419203  9149 consensus_queue.cc:260] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.420181  9149 raft_consensus.cc:3060] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.423048  9073 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 5.
I20260709 13:15:27.424572  9188 leader_election.cc:304] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:27.425164  9149 raft_consensus.cc:2468] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 606fcd51583f4c888742712ca0d8084c in term 5.
I20260709 13:15:27.425648  9366 raft_consensus.cc:2804] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:27.426096  9366 raft_consensus.cc:697] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 5 LEADER]: Becoming Leader. State: Replica: 606fcd51583f4c888742712ca0d8084c, State: Running, Role: LEADER
I20260709 13:15:27.426929  9366 consensus_queue.cc:237] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.433954  8969 catalog_manager.cc:5697] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c reported cstate change: term changed from 4 to 5, leader changed from 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194) to 606fcd51583f4c888742712ca0d8084c (127.8.186.195). New cstate: current_term: 5 leader_uuid: "606fcd51583f4c888742712ca0d8084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.459654  9401 raft_consensus.cc:993] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: : Instructing follower 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:27.460125  9402 raft_consensus.cc:1081] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Signalling peer 5fb74c4bf625489bb656f80e9b16f374 to start an election
I20260709 13:15:27.462015  9073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42"
dest_uuid: "5fb74c4bf625489bb656f80e9b16f374"
 from {username='slave'} at 127.0.0.1:36190
I20260709 13:15:27.462584  9073 raft_consensus.cc:493] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.462869  9073 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.467656  9073 raft_consensus.cc:515] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.469429  9073 leader_election.cc:290] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 4 election: Requested vote from peers 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194:43207), 606fcd51583f4c888742712ca0d8084c (127.8.186.195:34981)
I20260709 13:15:27.470368  9149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5"
I20260709 13:15:27.470536  9222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4422731a39954731a7cba02df0fe7f42" candidate_uuid: "5fb74c4bf625489bb656f80e9b16f374" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "606fcd51583f4c888742712ca0d8084c"
I20260709 13:15:27.470866  9149 raft_consensus.cc:3055] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:27.471050  9222 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.471174  9149 raft_consensus.cc:740] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d4c8e9a6b184e459ba4cca5b74d90f5, State: Running, Role: LEADER
I20260709 13:15:27.471994  9149 consensus_queue.cc:260] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.472956  9149 raft_consensus.cc:3060] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.475471  9222 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 4.
I20260709 13:15:27.476461  9038 leader_election.cc:304] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb74c4bf625489bb656f80e9b16f374, 606fcd51583f4c888742712ca0d8084c; no voters: 
I20260709 13:15:27.477134  9407 raft_consensus.cc:2804] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:27.477543  9407 raft_consensus.cc:697] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 LEADER]: Becoming Leader. State: Replica: 5fb74c4bf625489bb656f80e9b16f374, State: Running, Role: LEADER
I20260709 13:15:27.477753  9149 raft_consensus.cc:2468] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb74c4bf625489bb656f80e9b16f374 in term 4.
I20260709 13:15:27.478446  9407 consensus_queue.cc:237] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } }
I20260709 13:15:27.485523  8969 catalog_manager.cc:5697] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 reported cstate change: term changed from 3 to 4, leader changed from 4d4c8e9a6b184e459ba4cca5b74d90f5 (127.8.186.194) to 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193). New cstate: current_term: 4 leader_uuid: "5fb74c4bf625489bb656f80e9b16f374" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.729552  9149 raft_consensus.cc:1275] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:27.730949  9366 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:27.743070  9073 raft_consensus.cc:1275] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:27.744637  9419 consensus_queue.cc:1048] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:27.773931  9222 raft_consensus.cc:1275] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.775152  9407 consensus_queue.cc:1048] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.784060  9149 raft_consensus.cc:1275] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.785449  9407 consensus_queue.cc:1048] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.802824  9149 raft_consensus.cc:1275] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.804010  9407 consensus_queue.cc:1048] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.812429  9222 raft_consensus.cc:1275] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.814316  9409 consensus_queue.cc:1048] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:27.876281  9149 raft_consensus.cc:1275] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:27.877454  9409 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:27.886008  9222 raft_consensus.cc:1275] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Refusing update from remote peer 5fb74c4bf625489bb656f80e9b16f374: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:27.887768  9406 consensus_queue.cc:1048] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [LEADER]: Connected to new peer: Peer: permanent_uuid: "606fcd51583f4c888742712ca0d8084c" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:27.922464  9149 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 5 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:27.923630  9403 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4c8e9a6b184e459ba4cca5b74d90f5" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:27.932278  9073 raft_consensus.cc:1275] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 5 FOLLOWER]: Refusing update from remote peer 606fcd51583f4c888742712ca0d8084c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:27.935216  9366 consensus_queue.cc:1048] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb74c4bf625489bb656f80e9b16f374" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:28.139107  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:28.144434  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
I20260709 13:15:28.167631  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:28.168476  8939 tablet_replica.cc:333] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.169155  8939 raft_consensus.cc:2243] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.169694  8939 raft_consensus.cc:2272] T db4cda0519cb428ab1ca8db0caf4d3d5 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.172364  8939 tablet_replica.cc:333] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.172885  8939 raft_consensus.cc:2243] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.173303  8939 raft_consensus.cc:2272] T 0031bd81cc07461da8ccca552ac004ff P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.174958  8939 tablet_replica.cc:333] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.175426  8939 raft_consensus.cc:2243] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.176177  8939 raft_consensus.cc:2272] T abf4465ae8ec4897b8c2d6b979bd333e P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.178318  8939 tablet_replica.cc:333] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.178843  8939 raft_consensus.cc:2243] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.179541  8939 raft_consensus.cc:2272] T 4422731a39954731a7cba02df0fe7f42 P 5fb74c4bf625489bb656f80e9b16f374 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.181469  8939 tablet_replica.cc:333] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.181937  8939 raft_consensus.cc:2243] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.182384  8939 raft_consensus.cc:2272] T d12e6c805b8c4ff5bc21ceeaaceb070c P 5fb74c4bf625489bb656f80e9b16f374 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.184201  8939 tablet_replica.cc:333] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.184653  8939 raft_consensus.cc:2243] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.185058  8939 raft_consensus.cc:2272] T d1e8b2076ad0455f9d8e82e90aee6860 P 5fb74c4bf625489bb656f80e9b16f374 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.186640  8939 tablet_replica.cc:333] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.187119  8939 raft_consensus.cc:2243] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.187549  8939 raft_consensus.cc:2272] T 234d857a76c647c9aed130167ea55577 P 5fb74c4bf625489bb656f80e9b16f374 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.189535  8939 tablet_replica.cc:333] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.190014  8939 raft_consensus.cc:2243] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.190737  8939 raft_consensus.cc:2272] T e510245a97bd4897aca0c7f16250126a P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.192534  8939 tablet_replica.cc:333] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374: stopping tablet replica
I20260709 13:15:28.192993  8939 raft_consensus.cc:2243] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.193404  8939 raft_consensus.cc:2272] T ef2dbca51575438198f33e7d7cfdc619 P 5fb74c4bf625489bb656f80e9b16f374 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:28.288678  9114 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.186.193:33111: connect: Connection refused (error 111)
I20260709 13:15:28.289532  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
W20260709 13:15:28.292258  9114 consensus_peers.cc:597] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 -> Peer 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111): Couldn't send request to peer 5fb74c4bf625489bb656f80e9b16f374. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:33111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.308403  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
I20260709 13:15:28.329053  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:28.329694  8939 tablet_replica.cc:333] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.330215  8939 raft_consensus.cc:2243] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.330981  8939 raft_consensus.cc:2272] T 0031bd81cc07461da8ccca552ac004ff P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.332767  8939 tablet_replica.cc:333] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.333312  8939 raft_consensus.cc:2243] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.334036  8939 raft_consensus.cc:2272] T d1e8b2076ad0455f9d8e82e90aee6860 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.335693  8939 tablet_replica.cc:333] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.336213  8939 raft_consensus.cc:2243] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.336591  8939 raft_consensus.cc:2272] T d12e6c805b8c4ff5bc21ceeaaceb070c P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.338106  8939 tablet_replica.cc:333] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.338570  8939 raft_consensus.cc:2243] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.338924  8939 raft_consensus.cc:2272] T db4cda0519cb428ab1ca8db0caf4d3d5 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.340797  8939 tablet_replica.cc:333] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.341281  8939 raft_consensus.cc:2243] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.341665  8939 raft_consensus.cc:2272] T abf4465ae8ec4897b8c2d6b979bd333e P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.343952  8939 tablet_replica.cc:333] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.344434  8939 raft_consensus.cc:2243] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.344812  8939 raft_consensus.cc:2272] T e510245a97bd4897aca0c7f16250126a P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.346793  8939 tablet_replica.cc:333] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.347260  8939 raft_consensus.cc:2243] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.348021  8939 raft_consensus.cc:2272] T ef2dbca51575438198f33e7d7cfdc619 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.349651  8939 tablet_replica.cc:333] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.350063  8939 raft_consensus.cc:2243] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.350427  8939 raft_consensus.cc:2272] T 234d857a76c647c9aed130167ea55577 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.352470  8939 tablet_replica.cc:333] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5: stopping tablet replica
I20260709 13:15:28.352895  8939 raft_consensus.cc:2243] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.353260  8939 raft_consensus.cc:2272] T 4422731a39954731a7cba02df0fe7f42 P 4d4c8e9a6b184e459ba4cca5b74d90f5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:28.367715  9188 consensus_peers.cc:597] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c -> Peer 5fb74c4bf625489bb656f80e9b16f374 (127.8.186.193:33111): Couldn't send request to peer 5fb74c4bf625489bb656f80e9b16f374. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:33111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.383240  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
I20260709 13:15:28.399381  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
I20260709 13:15:28.419977  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:28.420603  8939 tablet_replica.cc:333] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.421136  8939 raft_consensus.cc:2243] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.421893  8939 raft_consensus.cc:2272] T db4cda0519cb428ab1ca8db0caf4d3d5 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.424186  8939 tablet_replica.cc:333] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.424669  8939 raft_consensus.cc:2243] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.425060  8939 raft_consensus.cc:2272] T abf4465ae8ec4897b8c2d6b979bd333e P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.427057  8939 tablet_replica.cc:333] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.427580  8939 raft_consensus.cc:2243] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.428198  8939 raft_consensus.cc:2272] T 4422731a39954731a7cba02df0fe7f42 P 606fcd51583f4c888742712ca0d8084c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.430534  8939 tablet_replica.cc:333] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.431032  8939 raft_consensus.cc:2243] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.431458  8939 raft_consensus.cc:2272] T 0031bd81cc07461da8ccca552ac004ff P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.433144  8939 tablet_replica.cc:333] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.433660  8939 raft_consensus.cc:2243] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.434427  8939 raft_consensus.cc:2272] T 234d857a76c647c9aed130167ea55577 P 606fcd51583f4c888742712ca0d8084c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.436422  8939 tablet_replica.cc:333] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.436913  8939 raft_consensus.cc:2243] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.437323  8939 raft_consensus.cc:2272] T e510245a97bd4897aca0c7f16250126a P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.439334  8939 tablet_replica.cc:333] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.439847  8939 raft_consensus.cc:2243] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.440233  8939 raft_consensus.cc:2272] T ef2dbca51575438198f33e7d7cfdc619 P 606fcd51583f4c888742712ca0d8084c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.441828  8939 tablet_replica.cc:333] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.442247  8939 raft_consensus.cc:2243] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.442934  8939 raft_consensus.cc:2272] T d12e6c805b8c4ff5bc21ceeaaceb070c P 606fcd51583f4c888742712ca0d8084c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.444557  8939 tablet_replica.cc:333] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c: stopping tablet replica
I20260709 13:15:28.444979  8939 raft_consensus.cc:2243] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.445367  8939 raft_consensus.cc:2272] T d1e8b2076ad0455f9d8e82e90aee6860 P 606fcd51583f4c888742712ca0d8084c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.470669  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:15:28.490609  8939 master.cc:562] Master@127.8.186.254:39233 shutting down...
I20260709 13:15:28.618674  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:28.619256  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.619571  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P b40da444da134211a8b92dccc1c45860: stopping tablet replica
I20260709 13:15:28.638132  8939 master.cc:584] Master@127.8.186.254:39233 shutdown complete.
4d4c8e9a6b184e459ba4cca5b74d90f5  4
5fb74c4bf625489bb656f80e9b16f374  4
606fcd51583f4c888742712ca0d8084c  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12759 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:15:28.676640  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:40713
I20260709 13:15:28.677759  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:28.683332  9435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:28.683971  9436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:28.685082  9438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:28.685802  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:28.686612  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:28.686805  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:28.686946  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602928686927 us; error 0 us; skew 500 ppm
I20260709 13:15:28.687469  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:28.690063  8939 webserver.cc:533] Webserver started at http://127.8.186.254:40985/ using document root <none> and password file <none>
I20260709 13:15:28.690539  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:28.690716  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:28.690968  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:28.692107  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "41d380a15f6945ffbc67671df9269018"
format_stamp: "Formatted at 2026-07-09 13:15:28 on dist-test-slave-mq27"
I20260709 13:15:28.696566  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:15:28.700031  9443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:28.700845  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:28.701107  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "41d380a15f6945ffbc67671df9269018"
format_stamp: "Formatted at 2026-07-09 13:15:28 on dist-test-slave-mq27"
I20260709 13:15:28.701366  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:28.726774  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:28.728030  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:28.767767  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:40713
I20260709 13:15:28.767902  9494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:40713 every 8 connection(s)
I20260709 13:15:28.771564  9495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:28.781008  9495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018: Bootstrap starting.
I20260709 13:15:28.785674  9495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.789842  9495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018: No bootstrap required, opened a new log
I20260709 13:15:28.792004  9495 raft_consensus.cc:359] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d380a15f6945ffbc67671df9269018" member_type: VOTER }
I20260709 13:15:28.792408  9495 raft_consensus.cc:385] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.792631  9495 raft_consensus.cc:740] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d380a15f6945ffbc67671df9269018, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.793183  9495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d380a15f6945ffbc67671df9269018" member_type: VOTER }
I20260709 13:15:28.793622  9495 raft_consensus.cc:399] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:28.793838  9495 raft_consensus.cc:493] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:28.794081  9495 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.798218  9495 raft_consensus.cc:515] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d380a15f6945ffbc67671df9269018" member_type: VOTER }
I20260709 13:15:28.798749  9495 leader_election.cc:304] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41d380a15f6945ffbc67671df9269018; no voters: 
I20260709 13:15:28.800035  9495 leader_election.cc:290] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:28.800489  9498 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.802054  9498 raft_consensus.cc:697] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 1 LEADER]: Becoming Leader. State: Replica: 41d380a15f6945ffbc67671df9269018, State: Running, Role: LEADER
I20260709 13:15:28.802920  9495 sys_catalog.cc:565] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:28.802796  9498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d380a15f6945ffbc67671df9269018" member_type: VOTER }
I20260709 13:15:28.808717  9499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41d380a15f6945ffbc67671df9269018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d380a15f6945ffbc67671df9269018" member_type: VOTER } }
I20260709 13:15:28.808964  9500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41d380a15f6945ffbc67671df9269018. Latest consensus state: current_term: 1 leader_uuid: "41d380a15f6945ffbc67671df9269018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d380a15f6945ffbc67671df9269018" member_type: VOTER } }
I20260709 13:15:28.809521  9499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:28.809544  9500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:28.814177  9507 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:28.821630  9507 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:28.822638  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:28.830533  9507 catalog_manager.cc:1383] Generated new cluster ID: 13ee0b3e64224712a64b97db13f01499
I20260709 13:15:28.830813  9507 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:28.856961  9507 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:28.858158  9507 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:28.870234  9507 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018: Generated new TSK 0
I20260709 13:15:28.870846  9507 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:28.889740  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:28.896347  9517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:28.895577  9516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:28.898303  8939 server_base.cc:1061] running on GCE node
W20260709 13:15:28.898324  9519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:28.899425  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:28.899618  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:28.899768  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602928899725 us; error 0 us; skew 500 ppm
I20260709 13:15:28.900334  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:28.902576  8939 webserver.cc:533] Webserver started at http://127.8.186.193:43681/ using document root <none> and password file <none>
I20260709 13:15:28.903074  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:28.903241  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:28.903453  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:28.904543  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
format_stamp: "Formatted at 2026-07-09 13:15:28 on dist-test-slave-mq27"
I20260709 13:15:28.908986  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:28.912144  9524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:28.912859  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:28.913136  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
format_stamp: "Formatted at 2026-07-09 13:15:28 on dist-test-slave-mq27"
I20260709 13:15:28.913403  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:28.929978  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:28.931257  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:28.932873  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:28.935226  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:28.935441  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:28.935670  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:28.935884  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:28.975709  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:36809
I20260709 13:15:28.976003  9586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:36809 every 8 connection(s)
I20260709 13:15:28.980924  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:28.987679  9591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:28.988829  9592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:28.990887  9594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:28.991977  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:28.993389  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:28.993818  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:28.994050  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602928994029 us; error 0 us; skew 500 ppm
I20260709 13:15:28.994495  9587 heartbeater.cc:344] Connected to a master server at 127.8.186.254:40713
I20260709 13:15:28.994817  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:28.994841  9587 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:28.995925  9587 heartbeater.cc:507] Master 127.8.186.254:40713 requested a full tablet report, sending...
I20260709 13:15:28.998020  8939 webserver.cc:533] Webserver started at http://127.8.186.194:45519/ using document root <none> and password file <none>
I20260709 13:15:28.998184  9460 ts_manager.cc:194] Registered new tserver with Master: 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809)
I20260709 13:15:28.998584  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:28.998805  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:28.999056  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:29.000219  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
format_stamp: "Formatted at 2026-07-09 13:15:28 on dist-test-slave-mq27"
I20260709 13:15:29.000469  9460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46692
I20260709 13:15:29.005116  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:29.008713  9599 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.009438  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:29.009718  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
format_stamp: "Formatted at 2026-07-09 13:15:28 on dist-test-slave-mq27"
I20260709 13:15:29.009996  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:29.035225  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:29.036795  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:29.038425  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:29.040839  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:29.041036  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.041299  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:29.041440  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.080636  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:34347
I20260709 13:15:29.080788  9661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:34347 every 8 connection(s)
I20260709 13:15:29.085194  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:29.092602  9665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:29.093008  9666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:29.096655  9669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:29.097396  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:29.097666  9662 heartbeater.cc:344] Connected to a master server at 127.8.186.254:40713
I20260709 13:15:29.098060  9662 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:29.098336  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:29.098557  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:29.098709  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602929098693 us; error 0 us; skew 500 ppm
I20260709 13:15:29.098779  9662 heartbeater.cc:507] Master 127.8.186.254:40713 requested a full tablet report, sending...
I20260709 13:15:29.099272  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:29.100991  9460 ts_manager.cc:194] Registered new tserver with Master: b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.102164  8939 webserver.cc:533] Webserver started at http://127.8.186.195:44787/ using document root <none> and password file <none>
I20260709 13:15:29.102828  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:29.102804  9460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46698
I20260709 13:15:29.103323  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:29.103713  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:29.105146  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "91d09da48d6040cbaf9ab247f0cab47a"
format_stamp: "Formatted at 2026-07-09 13:15:29 on dist-test-slave-mq27"
I20260709 13:15:29.109661  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:29.112998  9673 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.113772  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:29.114102  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "91d09da48d6040cbaf9ab247f0cab47a"
format_stamp: "Formatted at 2026-07-09 13:15:29 on dist-test-slave-mq27"
I20260709 13:15:29.114424  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:29.136945  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:29.138232  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:29.139786  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:29.142061  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:29.142263  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.142498  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:29.142642  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:29.183887  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:44595
I20260709 13:15:29.183991  9735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:44595 every 8 connection(s)
I20260709 13:15:29.197508  9736 heartbeater.cc:344] Connected to a master server at 127.8.186.254:40713
I20260709 13:15:29.197871  9736 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:29.198590  9736 heartbeater.cc:507] Master 127.8.186.254:40713 requested a full tablet report, sending...
I20260709 13:15:29.200501  9460 ts_manager.cc:194] Registered new tserver with Master: 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.200579  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013574954s
I20260709 13:15:29.201831  9460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46712
I20260709 13:15:29.226028  9460 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46724:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:29.228935  9460 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:29.307902  9699 tablet_service.cc:1511] Processing CreateTablet for tablet 01b9ca4e70ae4357a3be5c7dab250f16 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:29.309068  9700 tablet_service.cc:1511] Processing CreateTablet for tablet fb4ab0c19a254a6cb841c918138e6c24 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:29.310806  9698 tablet_service.cc:1511] Processing CreateTablet for tablet 26c3b9f26fa847da83c7f263b48e2186 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:29.311287  9701 tablet_service.cc:1511] Processing CreateTablet for tablet 10f93462f9c9481ab1c9acd7b81c5e07 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:29.309490  9699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b9ca4e70ae4357a3be5c7dab250f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.313048  9697 tablet_service.cc:1511] Processing CreateTablet for tablet 721c3209a34a4fa7840b6163ba6e4c94 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:29.313338  9627 tablet_service.cc:1511] Processing CreateTablet for tablet 10f93462f9c9481ab1c9acd7b81c5e07 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:29.314368  9697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721c3209a34a4fa7840b6163ba6e4c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.314644  9627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f93462f9c9481ab1c9acd7b81c5e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.315064  9700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4ab0c19a254a6cb841c918138e6c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.315951  9701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f93462f9c9481ab1c9acd7b81c5e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.316484  9696 tablet_service.cc:1511] Processing CreateTablet for tablet 38f90449075f4a5bb5ef60b03c2bd994 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:29.316883  9626 tablet_service.cc:1511] Processing CreateTablet for tablet fb4ab0c19a254a6cb841c918138e6c24 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:29.317787  9696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f90449075f4a5bb5ef60b03c2bd994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.318158  9626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4ab0c19a254a6cb841c918138e6c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.320386  9698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3b9f26fa847da83c7f263b48e2186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.320904  9625 tablet_service.cc:1511] Processing CreateTablet for tablet 01b9ca4e70ae4357a3be5c7dab250f16 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:29.322257  9625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b9ca4e70ae4357a3be5c7dab250f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.324579  9624 tablet_service.cc:1511] Processing CreateTablet for tablet 26c3b9f26fa847da83c7f263b48e2186 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:29.325353  9695 tablet_service.cc:1511] Processing CreateTablet for tablet 583bf45858c748d5963211b28fb9b6e0 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:29.326668  9695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583bf45858c748d5963211b28fb9b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.326989  9623 tablet_service.cc:1511] Processing CreateTablet for tablet 721c3209a34a4fa7840b6163ba6e4c94 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:29.329151  9622 tablet_service.cc:1511] Processing CreateTablet for tablet 38f90449075f4a5bb5ef60b03c2bd994 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:29.330453  9619 tablet_service.cc:1511] Processing CreateTablet for tablet edae947f5ff14bef80eb1882ef34d4b0 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:29.331284  9621 tablet_service.cc:1511] Processing CreateTablet for tablet 583bf45858c748d5963211b28fb9b6e0 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:29.333410  9620 tablet_service.cc:1511] Processing CreateTablet for tablet b0fb410524e743638bc2578b6b666b82 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:29.333407  9694 tablet_service.cc:1511] Processing CreateTablet for tablet b0fb410524e743638bc2578b6b666b82 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:29.335522  9621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583bf45858c748d5963211b28fb9b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.337102  9619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edae947f5ff14bef80eb1882ef34d4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.337807  9693 tablet_service.cc:1511] Processing CreateTablet for tablet edae947f5ff14bef80eb1882ef34d4b0 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:29.338639  9623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721c3209a34a4fa7840b6163ba6e4c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.339485  9693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edae947f5ff14bef80eb1882ef34d4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.340113  9622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f90449075f4a5bb5ef60b03c2bd994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.341035  9694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fb410524e743638bc2578b6b666b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.341210  9618 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef4fcff49154fd6a7d64347c6fede0b (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:29.341663  9620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fb410524e743638bc2578b6b666b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.343026  9624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3b9f26fa847da83c7f263b48e2186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.345628  9692 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef4fcff49154fd6a7d64347c6fede0b (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:29.346903  9692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef4fcff49154fd6a7d64347c6fede0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.368158  9618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef4fcff49154fd6a7d64347c6fede0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.384857  9551 tablet_service.cc:1511] Processing CreateTablet for tablet fb4ab0c19a254a6cb841c918138e6c24 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:29.386231  9551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4ab0c19a254a6cb841c918138e6c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.388914  9550 tablet_service.cc:1511] Processing CreateTablet for tablet 01b9ca4e70ae4357a3be5c7dab250f16 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:29.390281  9550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b9ca4e70ae4357a3be5c7dab250f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.392867  9549 tablet_service.cc:1511] Processing CreateTablet for tablet 26c3b9f26fa847da83c7f263b48e2186 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:29.394198  9549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c3b9f26fa847da83c7f263b48e2186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.396971  9548 tablet_service.cc:1511] Processing CreateTablet for tablet 721c3209a34a4fa7840b6163ba6e4c94 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:29.398352  9548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721c3209a34a4fa7840b6163ba6e4c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.398097  9547 tablet_service.cc:1511] Processing CreateTablet for tablet 38f90449075f4a5bb5ef60b03c2bd994 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:29.399284  9547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38f90449075f4a5bb5ef60b03c2bd994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.401274  9546 tablet_service.cc:1511] Processing CreateTablet for tablet 583bf45858c748d5963211b28fb9b6e0 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:29.402611  9546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583bf45858c748d5963211b28fb9b6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.406617  9552 tablet_service.cc:1511] Processing CreateTablet for tablet 10f93462f9c9481ab1c9acd7b81c5e07 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:29.408012  9552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f93462f9c9481ab1c9acd7b81c5e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.396947  9751 tablet_bootstrap.cc:492] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.417007  9545 tablet_service.cc:1511] Processing CreateTablet for tablet b0fb410524e743638bc2578b6b666b82 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:29.418414  9545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fb410524e743638bc2578b6b666b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.421603  9544 tablet_service.cc:1511] Processing CreateTablet for tablet edae947f5ff14bef80eb1882ef34d4b0 (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:29.423280  9544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edae947f5ff14bef80eb1882ef34d4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.424961  9751 tablet_bootstrap.cc:654] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.427559  9543 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef4fcff49154fd6a7d64347c6fede0b (DEFAULT_TABLE table=test-workload [id=782c22b04751465797a3d645ca0f0256]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:29.429143  9543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef4fcff49154fd6a7d64347c6fede0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:29.430440  9753 tablet_bootstrap.cc:492] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.434971  9751 tablet_bootstrap.cc:492] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.435467  9751 ts_tablet_manager.cc:1403] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.008s
I20260709 13:15:29.438439  9751 raft_consensus.cc:359] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.439162  9751 raft_consensus.cc:385] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.439467  9751 raft_consensus.cc:740] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.446503  9753 tablet_bootstrap.cc:654] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.450129  9751 consensus_queue.cc:260] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.461782  9751 ts_tablet_manager.cc:1434] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.006s
I20260709 13:15:29.463119  9736 heartbeater.cc:499] Master 127.8.186.254:40713 was elected leader, sending a full tablet report...
I20260709 13:15:29.474267  9751 tablet_bootstrap.cc:492] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.481468  9751 tablet_bootstrap.cc:654] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.484170  9753 tablet_bootstrap.cc:492] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.484663  9753 ts_tablet_manager.cc:1403] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.005s
I20260709 13:15:29.487442  9753 raft_consensus.cc:359] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.488893  9753 raft_consensus.cc:385] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.489185  9753 raft_consensus.cc:740] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.490031  9753 consensus_queue.cc:260] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.492734  9587 heartbeater.cc:499] Master 127.8.186.254:40713 was elected leader, sending a full tablet report...
I20260709 13:15:29.493724  9753 ts_tablet_manager.cc:1434] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:29.494850  9753 tablet_bootstrap.cc:492] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.521266  9753 tablet_bootstrap.cc:654] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.524523  9752 tablet_bootstrap.cc:492] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.526027  9751 tablet_bootstrap.cc:492] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.526515  9751 ts_tablet_manager.cc:1403] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.053s	user 0.028s	sys 0.019s
I20260709 13:15:29.529453  9751 raft_consensus.cc:359] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.530731  9751 raft_consensus.cc:385] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.531090  9751 raft_consensus.cc:740] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.531985  9751 consensus_queue.cc:260] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.532723  9753 tablet_bootstrap.cc:492] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.533207  9753 ts_tablet_manager.cc:1403] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.012s
I20260709 13:15:29.534122  9751 ts_tablet_manager.cc:1434] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:15:29.534991  9751 tablet_bootstrap.cc:492] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.535535  9753 raft_consensus.cc:359] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.536273  9753 raft_consensus.cc:385] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.536576  9753 raft_consensus.cc:740] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.536971  9752 tablet_bootstrap.cc:654] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.537395  9753 consensus_queue.cc:260] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.541908  9751 tablet_bootstrap.cc:654] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.544344  9753 ts_tablet_manager.cc:1434] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:29.545392  9753 tablet_bootstrap.cc:492] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.551616  9753 tablet_bootstrap.cc:654] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.557086  9752 tablet_bootstrap.cc:492] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.557554  9752 ts_tablet_manager.cc:1403] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.016s
I20260709 13:15:29.557715  9751 tablet_bootstrap.cc:492] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.557889  9753 tablet_bootstrap.cc:492] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.558404  9751 ts_tablet_manager.cc:1403] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 13:15:29.558413  9753 ts_tablet_manager.cc:1403] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:15:29.560025  9752 raft_consensus.cc:359] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.560570  9752 raft_consensus.cc:385] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.560804  9752 raft_consensus.cc:740] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.561419  9752 consensus_queue.cc:260] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.561451  9751 raft_consensus.cc:359] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.561635  9753 raft_consensus.cc:359] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.562258  9751 raft_consensus.cc:385] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.562338  9753 raft_consensus.cc:385] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.562633  9751 raft_consensus.cc:740] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.562685  9753 raft_consensus.cc:740] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.563827  9662 heartbeater.cc:499] Master 127.8.186.254:40713 was elected leader, sending a full tablet report...
I20260709 13:15:29.564237  9752 ts_tablet_manager.cc:1434] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:29.563659  9753 consensus_queue.cc:260] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.563659  9751 consensus_queue.cc:260] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.566031  9751 ts_tablet_manager.cc:1434] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:29.567019  9751 tablet_bootstrap.cc:492] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.567546  9752 tablet_bootstrap.cc:492] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.569667  9753 ts_tablet_manager.cc:1434] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:15:29.570714  9753 tablet_bootstrap.cc:492] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.573473  9751 tablet_bootstrap.cc:654] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.574240  9752 tablet_bootstrap.cc:654] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.577008  9753 tablet_bootstrap.cc:654] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.582901  9752 tablet_bootstrap.cc:492] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.583415  9752 ts_tablet_manager.cc:1403] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:15:29.587815  9756 raft_consensus.cc:493] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.588306  9756 raft_consensus.cc:515] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.591645  9758 raft_consensus.cc:493] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.592249  9758 raft_consensus.cc:515] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.601734  9756 leader_election.cc:290] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.587019  9752 raft_consensus.cc:359] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.619801  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.596982  9758 leader_election.cc:290] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.613822  9752 raft_consensus.cc:385] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.630674  9753 tablet_bootstrap.cc:492] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.631255  9753 ts_tablet_manager.cc:1403] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.009s
I20260709 13:15:29.629163  9752 raft_consensus.cc:740] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.635308  9751 tablet_bootstrap.cc:492] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.634886  9752 consensus_queue.cc:260] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.635321  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:29.636039  9751 ts_tablet_manager.cc:1403] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.037s
I20260709 13:15:29.635998  9637 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
W20260709 13:15:29.637159  9676 leader_election.cc:343] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.639846  9677 leader_election.cc:304] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:29.640360  9753 raft_consensus.cc:359] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.641047  9756 raft_consensus.cc:2804] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.641104  9753 raft_consensus.cc:385] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.642275  9756 raft_consensus.cc:493] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.642670  9756 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.643061  9753 raft_consensus.cc:740] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.643858  9753 consensus_queue.cc:260] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.646102  9753 ts_tablet_manager.cc:1434] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:15:29.647082  9753 tablet_bootstrap.cc:492] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.639338  9751 raft_consensus.cc:359] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.653043  9756 raft_consensus.cc:515] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.655052  9753 tablet_bootstrap.cc:654] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.655085  9752 ts_tablet_manager.cc:1434] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.001s
I20260709 13:15:29.655902  9751 raft_consensus.cc:385] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.656508  9751 raft_consensus.cc:740] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.657006  9752 tablet_bootstrap.cc:492] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.657245  9751 consensus_queue.cc:260] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.661682  9758 raft_consensus.cc:493] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.661607  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:29.662940  9637 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.662701  9756 leader_election.cc:290] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.662268  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:29.664057  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.664340  9562 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.662217  9758 raft_consensus.cc:515] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.669771  9758 leader_election.cc:290] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.670957  9756 raft_consensus.cc:493] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.671782  9752 tablet_bootstrap.cc:654] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.671443  9756 raft_consensus.cc:515] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.672565  9637 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:29.673934  9677 leader_election.cc:304] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:29.675540  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.677948  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.680047  9753 tablet_bootstrap.cc:492] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.678071  9562 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:29.680550  9753 ts_tablet_manager.cc:1403] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
W20260709 13:15:29.680728  9677 leader_election.cc:343] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.677040  9772 raft_consensus.cc:2804] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.682978  9753 raft_consensus.cc:359] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.678157  9751 ts_tablet_manager.cc:1434] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.042s	user 0.001s	sys 0.007s
I20260709 13:15:29.683673  9756 leader_election.cc:290] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.684708  9751 tablet_bootstrap.cc:492] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.675537  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:29.684721  9753 raft_consensus.cc:385] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.685322  9753 raft_consensus.cc:740] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
W20260709 13:15:29.686478  9676 leader_election.cc:343] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.686044  9753 consensus_queue.cc:260] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.686923  9676 leader_election.cc:304] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a; no voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.688139  9763 raft_consensus.cc:493] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.688613  9763 raft_consensus.cc:515] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.689851  9753 ts_tablet_manager.cc:1434] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:15:29.690882  9753 tablet_bootstrap.cc:492] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
W20260709 13:15:29.675392  9528 leader_election.cc:343] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.692529  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:29.694936  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
W20260709 13:15:29.696596  9528 leader_election.cc:343] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.697377  9528 leader_election.cc:343] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.697593  9753 tablet_bootstrap.cc:654] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.697832  9772 raft_consensus.cc:697] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:29.698716  9772 consensus_queue.cc:237] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.702204  9528 leader_election.cc:304] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.703088  9758 raft_consensus.cc:2749] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:29.704352  9528 leader_election.cc:343] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.705001  9763 leader_election.cc:290] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.706877  9751 tablet_bootstrap.cc:654] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.706030  9756 raft_consensus.cc:2749] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.706176  9528 leader_election.cc:304] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.713505  9758 raft_consensus.cc:2749] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.720094  9752 tablet_bootstrap.cc:492] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.719907  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:29.720618  9752 ts_tablet_manager.cc:1403] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.010s
I20260709 13:15:29.719806  9458 catalog_manager.cc:5697] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 0 to 1, leader changed from <none> to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 1 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:29.721851  9602 leader_election.cc:343] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.723377  9752 raft_consensus.cc:359] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.723999  9752 raft_consensus.cc:385] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.725260  9752 raft_consensus.cc:740] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.725989  9752 consensus_queue.cc:260] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.726739  9753 tablet_bootstrap.cc:492] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.727306  9753 ts_tablet_manager.cc:1403] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.013s
I20260709 13:15:29.730527  9753 raft_consensus.cc:359] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.731283  9753 raft_consensus.cc:385] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.733320  9752 ts_tablet_manager.cc:1434] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:29.733669  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:29.734333  9752 tablet_bootstrap.cc:492] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.731585  9753 raft_consensus.cc:740] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.735692  9758 raft_consensus.cc:493] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.736160  9758 raft_consensus.cc:515] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.736671  9751 tablet_bootstrap.cc:492] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.737151  9751 ts_tablet_manager.cc:1403] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.009s
I20260709 13:15:29.738226  9758 leader_election.cc:290] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.740098  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:29.740315  9753 consensus_queue.cc:260] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.741055  9752 tablet_bootstrap.cc:654] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.740968  9603 leader_election.cc:343] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.741562  9528 leader_election.cc:343] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.742483  9751 raft_consensus.cc:359] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.743269  9751 raft_consensus.cc:385] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.743559  9751 raft_consensus.cc:740] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.744689  9753 ts_tablet_manager.cc:1434] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:15:29.744300  9751 consensus_queue.cc:260] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.745678  9753 tablet_bootstrap.cc:492] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.746708  9751 ts_tablet_manager.cc:1434] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:29.747705  9751 tablet_bootstrap.cc:492] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.741515  9603 leader_election.cc:304] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d5d020b0f8457c8dda0e5d078e0719; no voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:29.748631  9763 raft_consensus.cc:2749] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.752614  9753 tablet_bootstrap.cc:654] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.742513  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.754599  9751 tablet_bootstrap.cc:654] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.755422  9528 leader_election.cc:343] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.755970  9528 leader_election.cc:304] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.756735  9758 raft_consensus.cc:2749] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.765437  9753 tablet_bootstrap.cc:492] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.765893  9752 tablet_bootstrap.cc:492] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.766014  9753 ts_tablet_manager.cc:1403] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:15:29.766580  9752 ts_tablet_manager.cc:1403] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.000s
I20260709 13:15:29.769320  9753 raft_consensus.cc:359] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.770134  9753 raft_consensus.cc:385] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.769752  9752 raft_consensus.cc:359] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.770462  9753 raft_consensus.cc:740] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.770615  9752 raft_consensus.cc:385] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.770727  9763 raft_consensus.cc:493] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.771133  9752 raft_consensus.cc:740] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.771256  9763 raft_consensus.cc:515] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.772277  9752 consensus_queue.cc:260] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.772356  9753 consensus_queue.cc:260] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.773411  9763 leader_election.cc:290] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.774827  9753 ts_tablet_manager.cc:1434] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:15:29.775203  9772 raft_consensus.cc:493] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.775497  9751 tablet_bootstrap.cc:492] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.775889  9753 tablet_bootstrap.cc:492] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.776016  9751 ts_tablet_manager.cc:1403] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.017s
I20260709 13:15:29.776666  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
W20260709 13:15:29.778324  9603 leader_election.cc:343] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.775730  9772 raft_consensus.cc:515] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.780435  9751 raft_consensus.cc:359] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.781157  9751 raft_consensus.cc:385] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.781463  9751 raft_consensus.cc:740] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.782550  9753 tablet_bootstrap.cc:654] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.782248  9751 consensus_queue.cc:260] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.782935  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.785203  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:29.785550  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:29.785873  9561 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
I20260709 13:15:29.786130  9562 raft_consensus.cc:2468] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 0.
I20260709 13:15:29.787173  9676 leader_election.cc:304] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:29.787433  9602 leader_election.cc:304] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 91d09da48d6040cbaf9ab247f0cab47a
I20260709 13:15:29.788039  9756 raft_consensus.cc:2804] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:29.788120  9677 leader_election.cc:343] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.788516  9756 raft_consensus.cc:493] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.788101  9753 tablet_bootstrap.cc:492] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.788874  9756 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.789165  9753 ts_tablet_manager.cc:1403] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:15:29.791198  9763 raft_consensus.cc:2804] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.791574  9763 raft_consensus.cc:493] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.788204  9772 leader_election.cc:290] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.791724  9753 raft_consensus.cc:359] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.792474  9753 raft_consensus.cc:385] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.792570  9763 raft_consensus.cc:3060] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.792774  9753 raft_consensus.cc:740] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.793485  9753 consensus_queue.cc:260] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.795693  9753 ts_tablet_manager.cc:1434] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:29.796610  9753 tablet_bootstrap.cc:492] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.801340  9751 ts_tablet_manager.cc:1434] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 13:15:29.802116  9753 tablet_bootstrap.cc:654] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.802577  9751 tablet_bootstrap.cc:492] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.803109  9763 raft_consensus.cc:515] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.808044  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:29.808254  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:29.808693  9562 raft_consensus.cc:3060] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:29.809725  9603 leader_election.cc:343] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.809998  9751 tablet_bootstrap.cc:654] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.810304  9763 leader_election.cc:290] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
W20260709 13:15:29.815325  9508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:29.817094  9758 raft_consensus.cc:493] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.817677  9758 raft_consensus.cc:515] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.819885  9758 leader_election.cc:290] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.821225  9756 raft_consensus.cc:515] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.821934  9751 tablet_bootstrap.cc:492] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.822898  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.823573  9636 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 0.
I20260709 13:15:29.821880  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:29.823989  9562 raft_consensus.cc:2468] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 1.
I20260709 13:15:29.824512  9711 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 0.
I20260709 13:15:29.824651  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:29.825444  9561 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.825506  9528 leader_election.cc:304] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:29.826387  9758 raft_consensus.cc:2804] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.822440  9751 ts_tablet_manager.cc:1403] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 13:15:29.826749  9758 raft_consensus.cc:493] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.827098  9758 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.829690  9751 raft_consensus.cc:359] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.830443  9751 raft_consensus.cc:385] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.830719  9751 raft_consensus.cc:740] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.831804  9751 consensus_queue.cc:260] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.833158  9602 leader_election.cc:304] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 91d09da48d6040cbaf9ab247f0cab47a
I20260709 13:15:29.834106  9783 raft_consensus.cc:2804] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.834179  9561 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:29.834731  9783 raft_consensus.cc:697] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 LEADER]: Becoming Leader. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:29.835346  9676 leader_election.cc:304] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:29.835624  9783 consensus_queue.cc:237] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.836702  9751 ts_tablet_manager.cc:1434] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:29.836262  9772 raft_consensus.cc:2804] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.837268  9772 raft_consensus.cc:697] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:29.837738  9751 tablet_bootstrap.cc:492] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.838238  9752 ts_tablet_manager.cc:1434] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.071s	user 0.014s	sys 0.013s
I20260709 13:15:29.838057  9772 consensus_queue.cc:237] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.844245  9774 raft_consensus.cc:493] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.844615  9751 tablet_bootstrap.cc:654] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.844813  9774 raft_consensus.cc:515] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.845533  9752 tablet_bootstrap.cc:492] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.847586  9774 leader_election.cc:290] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.839594  9758 raft_consensus.cc:515] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.848364  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.849108  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
W20260709 13:15:29.849885  9677 leader_election.cc:343] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.850422  9676 leader_election.cc:343] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.850863  9676 leader_election.cc:304] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a; no voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.851545  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:29.851981  9774 raft_consensus.cc:2749] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.852196  9636 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.853466  9756 leader_election.cc:290] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.854592  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
W20260709 13:15:29.856076  9677 leader_election.cc:343] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.856657  9753 tablet_bootstrap.cc:492] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.857113  9753 ts_tablet_manager.cc:1403] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.018s
I20260709 13:15:29.860170  9753 raft_consensus.cc:359] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.860508  9636 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 1.
I20260709 13:15:29.860849  9753 raft_consensus.cc:385] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.861366  9753 raft_consensus.cc:740] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.861888  9751 tablet_bootstrap.cc:492] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.861929  9753 consensus_queue.cc:260] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.862493  9751 ts_tablet_manager.cc:1403] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:15:29.864691  9753 ts_tablet_manager.cc:1434] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:29.864421  9459 catalog_manager.cc:5697] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.865182  9751 raft_consensus.cc:359] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.865723  9753 tablet_bootstrap.cc:492] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: Bootstrap starting.
I20260709 13:15:29.865806  9751 raft_consensus.cc:385] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.866143  9751 raft_consensus.cc:740] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.866915  9751 consensus_queue.cc:260] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.869082  9751 ts_tablet_manager.cc:1434] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:29.869949  9751 tablet_bootstrap.cc:492] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.871658  9753 tablet_bootstrap.cc:654] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.875321  9751 tablet_bootstrap.cc:654] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.883664  9753 tablet_bootstrap.cc:492] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: No bootstrap required, opened a new log
I20260709 13:15:29.884243  9753 ts_tablet_manager.cc:1403] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:15:29.885655  9790 raft_consensus.cc:493] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.886722  9528 leader_election.cc:304] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:29.886679  9751 tablet_bootstrap.cc:492] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.887588  9751 ts_tablet_manager.cc:1403] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:15:29.887360  9753 raft_consensus.cc:359] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.888441  9753 raft_consensus.cc:385] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.887428  9790 raft_consensus.cc:515] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.889130  9753 raft_consensus.cc:740] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.890246  9753 consensus_queue.cc:260] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.890722  9751 raft_consensus.cc:359] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.891497  9751 raft_consensus.cc:385] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.891937  9751 raft_consensus.cc:740] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.892096  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:29.892804  9711 raft_consensus.cc:2468] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 0.
I20260709 13:15:29.892967  9751 consensus_queue.cc:260] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.893850  9756 raft_consensus.cc:493] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.894255  9756 raft_consensus.cc:515] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.894574  9528 leader_election.cc:304] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:29.897940  9756 leader_election.cc:290] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.898090  9794 raft_consensus.cc:2804] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.899642  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:29.900229  9751 ts_tablet_manager.cc:1434] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:15:29.900354  9561 raft_consensus.cc:2468] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
I20260709 13:15:29.901099  9753 ts_tablet_manager.cc:1434] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:15:29.901500  9751 tablet_bootstrap.cc:492] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a: Bootstrap starting.
I20260709 13:15:29.901953  9676 leader_election.cc:304] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:29.900275  9758 leader_election.cc:290] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.904680  9758 raft_consensus.cc:2804] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.905055  9794 raft_consensus.cc:697] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:29.906440  9752 tablet_bootstrap.cc:654] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.905951  9794 consensus_queue.cc:237] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.908232  9751 tablet_bootstrap.cc:654] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.905133  9758 raft_consensus.cc:493] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.912046  9772 raft_consensus.cc:2804] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.912520  9772 raft_consensus.cc:493] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.912865  9772 raft_consensus.cc:3060] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.916102  9796 raft_consensus.cc:493] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.915441  9459 catalog_manager.cc:5697] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 0 to 1, leader changed from <none> to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 1 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.916663  9796 raft_consensus.cc:515] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.917514  9751 tablet_bootstrap.cc:492] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a: No bootstrap required, opened a new log
I20260709 13:15:29.918025  9751 ts_tablet_manager.cc:1403] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:15:29.909591  9758 raft_consensus.cc:3060] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.918917  9796 leader_election.cc:290] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.919646  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.920883  9751 raft_consensus.cc:359] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.921988  9751 raft_consensus.cc:385] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.922211  9751 raft_consensus.cc:740] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.924355  9751 consensus_queue.cc:260] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.926781  9751 ts_tablet_manager.cc:1434] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 13:15:29.927803  9677 leader_election.cc:343] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.929881  9790 leader_election.cc:290] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.933197  9772 raft_consensus.cc:515] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.935313  9772 leader_election.cc:290] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.938779  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:29.939008  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:29.939493  9711 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.943990  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:29.935173  9758 raft_consensus.cc:515] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.943478  9460 catalog_manager.cc:5697] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 1 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.944591  9561 raft_consensus.cc:3060] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.946201  9711 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 1.
I20260709 13:15:29.947259  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
W20260709 13:15:29.947973  9528 leader_election.cc:343] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.948711  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
W20260709 13:15:29.949757  9528 leader_election.cc:343] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.951625  9677 leader_election.cc:343] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.953392  9561 raft_consensus.cc:2468] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:29.954527  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:29.954939  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:29.955201  9711 raft_consensus.cc:2468] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 0.
I20260709 13:15:29.956416  9752 tablet_bootstrap.cc:492] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.957062  9752 ts_tablet_manager.cc:1403] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.010s
I20260709 13:15:29.953519  9758 leader_election.cc:290] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Requested vote from peers 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:29.960199  9676 leader_election.cc:304] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.960330  9752 raft_consensus.cc:359] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
W20260709 13:15:29.960844  9528 leader_election.cc:343] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.961066  9752 raft_consensus.cc:385] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.961345  9752 raft_consensus.cc:740] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.961390  9772 raft_consensus.cc:2804] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.961570  9528 leader_election.cc:304] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.961937  9772 raft_consensus.cc:697] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:29.961997  9752 consensus_queue.cc:260] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.962662  9758 raft_consensus.cc:2804] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.963034  9758 raft_consensus.cc:493] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.963461  9758 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.962994  9772 consensus_queue.cc:237] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.964282  9752 ts_tablet_manager.cc:1434] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:29.965263  9752 tablet_bootstrap.cc:492] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.965178  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:29.965775  9711 raft_consensus.cc:3060] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.971972  9752 tablet_bootstrap.cc:654] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.973580  9758 raft_consensus.cc:515] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.977648  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:29.978336  9752 tablet_bootstrap.cc:492] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.978826  9752 ts_tablet_manager.cc:1403] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.007s
W20260709 13:15:29.979375  9528 leader_election.cc:343] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.979893  9458 catalog_manager.cc:5697] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 0 to 1, leader changed from <none> to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 1 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.981781  9752 raft_consensus.cc:359] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.982502  9752 raft_consensus.cc:385] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.982841  9752 raft_consensus.cc:740] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.983765  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:29.983639  9752 consensus_queue.cc:260] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:29.984422  9710 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.985924  9752 ts_tablet_manager.cc:1434] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:15:29.986887  9752 tablet_bootstrap.cc:492] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:29.993147  9710 raft_consensus.cc:2468] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 1.
I20260709 13:15:29.993366  9752 tablet_bootstrap.cc:654] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.993568  9758 leader_election.cc:290] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:29.981920  9711 raft_consensus.cc:2468] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 1.
I20260709 13:15:29.995090  9528 leader_election.cc:304] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.995847  9758 raft_consensus.cc:2804] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.996403  9758 raft_consensus.cc:697] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:29.996340  9528 leader_election.cc:304] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:29.997394  9791 raft_consensus.cc:2804] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.997464  9758 consensus_queue.cc:237] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:29.997938  9791 raft_consensus.cc:697] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:29.998414  9752 tablet_bootstrap.cc:492] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:29.998903  9752 ts_tablet_manager.cc:1403] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:15:29.998839  9791 consensus_queue.cc:237] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.001222  9752 raft_consensus.cc:359] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.001778  9752 raft_consensus.cc:385] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.002074  9752 raft_consensus.cc:740] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.002791  9752 consensus_queue.cc:260] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.005230  9752 ts_tablet_manager.cc:1434] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:15:30.006152  9752 tablet_bootstrap.cc:492] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:30.011401  9458 catalog_manager.cc:5697] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 1 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.012764  9752 tablet_bootstrap.cc:654] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.018589  9752 tablet_bootstrap.cc:492] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:30.019069  9752 ts_tablet_manager.cc:1403] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 13:15:30.018956  9783 raft_consensus.cc:493] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.019529  9783 raft_consensus.cc:515] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.021836  9783 leader_election.cc:290] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.021934  9752 raft_consensus.cc:359] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.022616  9752 raft_consensus.cc:385] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.022624  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:30.023161  9752 raft_consensus.cc:740] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.023490  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef4fcff49154fd6a7d64347c6fede0b" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:30.023715  9561 raft_consensus.cc:2393] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d5d020b0f8457c8dda0e5d078e0719 in current term 1: Already voted for candidate 91d09da48d6040cbaf9ab247f0cab47a in this term.
I20260709 13:15:30.023916  9752 consensus_queue.cc:260] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.025065  9772 raft_consensus.cc:493] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.025545  9772 raft_consensus.cc:515] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.025993  9752 ts_tablet_manager.cc:1434] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:30.026873  9752 tablet_bootstrap.cc:492] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:30.026607  9458 catalog_manager.cc:5697] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 1 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.027769  9772 leader_election.cc:290] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:30.029217  9603 leader_election.cc:304] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d5d020b0f8457c8dda0e5d078e0719; no voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:30.030272  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:30.030637  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:30.031337  9561 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
I20260709 13:15:30.031519  9763 raft_consensus.cc:3060] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.032768  9752 tablet_bootstrap.cc:654] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.033275  9676 leader_election.cc:304] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:30.034164  9772 raft_consensus.cc:2804] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.034534  9772 raft_consensus.cc:493] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.034852  9772 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.038013  9637 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
I20260709 13:15:30.040855  9783 raft_consensus.cc:493] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.041422  9783 raft_consensus.cc:515] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } } peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } }
I20260709 13:15:30.044580  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:30.044471  9772 raft_consensus.cc:515] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.045485  9710 raft_consensus.cc:2393] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d5d020b0f8457c8dda0e5d078e0719 in current term 1: Already voted for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in this term.
I20260709 13:15:30.047461  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:30.046599  9772 leader_election.cc:290] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:30.048074  9561 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.049055  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:30.049633  9637 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.051147  9783 leader_election.cc:290] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595), 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809)
I20260709 13:15:30.052985  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f93462f9c9481ab1c9acd7b81c5e07" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:30.053159  9763 raft_consensus.cc:2749] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.054759  9602 leader_election.cc:304] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d5d020b0f8457c8dda0e5d078e0719; no voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:30.055580  9763 raft_consensus.cc:3060] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.056164  9752 tablet_bootstrap.cc:492] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:30.056596  9752 ts_tablet_manager.cc:1403] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
I20260709 13:15:30.058578  9637 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:30.059279  9752 raft_consensus.cc:359] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.059999  9752 raft_consensus.cc:385] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.059937  9677 leader_election.cc:304] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.060360  9752 raft_consensus.cc:740] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.061112  9772 raft_consensus.cc:2804] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.061229  9752 consensus_queue.cc:260] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.061764  9758 raft_consensus.cc:493] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.062235  9758 raft_consensus.cc:515] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.062490  9772 raft_consensus.cc:697] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:30.063400  9752 ts_tablet_manager.cc:1434] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:30.063462  9772 consensus_queue.cc:237] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.064433  9752 tablet_bootstrap.cc:492] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719: Bootstrap starting.
I20260709 13:15:30.065994  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:30.066617  9710 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 0.
I20260709 13:15:30.068033  9528 leader_election.cc:304] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:30.068099  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:30.068912  9637 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 0.
I20260709 13:15:30.069060  9791 raft_consensus.cc:2804] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.069445  9791 raft_consensus.cc:493] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.069792  9791 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.071425  9752 tablet_bootstrap.cc:654] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.076129  9756 raft_consensus.cc:493] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.076704  9756 raft_consensus.cc:515] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.078145  9763 raft_consensus.cc:2749] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.079118  9756 leader_election.cc:290] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:30.064347  9758 leader_election.cc:290] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.080834  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:30.081064  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edae947f5ff14bef80eb1882ef34d4b0" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:30.082173  9562 raft_consensus.cc:2393] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91d09da48d6040cbaf9ab247f0cab47a in current term 1: Already voted for candidate b8d5d020b0f8457c8dda0e5d078e0719 in this term.
I20260709 13:15:30.083091  9460 catalog_manager.cc:5697] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 0 to 1, leader changed from <none> to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 1 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.083401  9676 leader_election.cc:304] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a; no voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:30.060380  9561 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:30.084342  9756 raft_consensus.cc:3060] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.083314  9791 raft_consensus.cc:515] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.087577  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:30.088207  9637 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.092864  9756 raft_consensus.cc:2749] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.094561  9752 tablet_bootstrap.cc:492] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719: No bootstrap required, opened a new log
I20260709 13:15:30.094966  9752 ts_tablet_manager.cc:1403] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.008s
I20260709 13:15:30.094832  9637 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 1.
I20260709 13:15:30.095875  9791 leader_election.cc:290] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.096568  9528 leader_election.cc:304] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.097203  9791 raft_consensus.cc:2804] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.097460  9752 raft_consensus.cc:359] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.097956  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:30.098155  9752 raft_consensus.cc:385] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.098266  9791 raft_consensus.cc:697] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:30.098479  9752 raft_consensus.cc:740] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.098542  9710 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.099061  9791 consensus_queue.cc:237] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.099452  9752 consensus_queue.cc:260] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.101584  9752 ts_tablet_manager.cc:1434] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:15:30.107564  9710 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 1.
I20260709 13:15:30.108816  9458 catalog_manager.cc:5697] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 1 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.190438  9756 raft_consensus.cc:493] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.190932  9756 raft_consensus.cc:515] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.192858  9756 leader_election.cc:290] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:30.193845  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:30.194075  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" is_pre_election: true
I20260709 13:15:30.194401  9561 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
I20260709 13:15:30.194717  9637 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 0.
I20260709 13:15:30.195559  9676 leader_election.cc:304] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:30.196653  9756 raft_consensus.cc:2804] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.196930  9756 raft_consensus.cc:493] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.197189  9756 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.201874  9756 raft_consensus.cc:515] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.203521  9756 leader_election.cc:290] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:30.204574  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:30.204597  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:30.205236  9561 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.205350  9637 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.210057  9637 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:30.210222  9561 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 1.
I20260709 13:15:30.211225  9677 leader_election.cc:304] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.211961  9756 raft_consensus.cc:2804] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.212440  9756 raft_consensus.cc:697] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:30.213085  9756 consensus_queue.cc:237] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.220494  9458 catalog_manager.cc:5697] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 0 to 1, leader changed from <none> to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 1 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.228750  9756 consensus_queue.cc:1048] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.244167  9763 consensus_queue.cc:1048] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.244525  9756 consensus_queue.cc:1048] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.259629  9763 raft_consensus.cc:493] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.260170  9763 raft_consensus.cc:515] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.262212  9763 leader_election.cc:290] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.262727  9763 consensus_queue.cc:1048] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.263653  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a" is_pre_election: true
I20260709 13:15:30.264546  9710 raft_consensus.cc:2393] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d5d020b0f8457c8dda0e5d078e0719 in current term 1: Already voted for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in this term.
I20260709 13:15:30.265692  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" is_pre_election: true
I20260709 13:15:30.268025  9603 leader_election.cc:304] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d5d020b0f8457c8dda0e5d078e0719; no voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:30.269317  9818 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.277518  9818 raft_consensus.cc:2749] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.293423  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:38658
I20260709 13:15:30.293941  9710 raft_consensus.cc:606] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:30.303668  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:38658
I20260709 13:15:30.304221  9710 raft_consensus.cc:606] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:30.308782  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
mode: GRACEFUL
new_leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:38658
I20260709 13:15:30.309278  9710 raft_consensus.cc:606] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Received request to transfer leadership to TS b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:30.322347  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:49450
I20260709 13:15:30.322875  9561 raft_consensus.cc:606] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Received request to transfer leadership to TS b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:30.328446  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
mode: GRACEFUL
new_leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:38658
I20260709 13:15:30.328974  9710 raft_consensus.cc:606] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Received request to transfer leadership to TS b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:30.391084  9791 consensus_queue.cc:1048] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.401013  9790 consensus_queue.cc:1048] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.411362  9758 consensus_queue.cc:1048] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.420418  9756 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.422708  9791 consensus_queue.cc:1048] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.437348  9637 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.445158  9756 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.452761  9774 raft_consensus.cc:993] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: : Instructing follower b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:30.453197  9756 raft_consensus.cc:1081] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Signalling peer b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:30.454871  9637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:15:30.455452  9637 raft_consensus.cc:493] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.455732  9637 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.460317  9637 raft_consensus.cc:515] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.463039  9637 leader_election.cc:290] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 2 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.464062  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:30.463881  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:30.464699  9561 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.465032  9710 raft_consensus.cc:3055] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:30.465137  9791 consensus_queue.cc:1048] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.465803  9710 raft_consensus.cc:740] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:30.466619  9710 consensus_queue.cc:260] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.467389  9756 consensus_queue.cc:1048] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.467859  9710 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.472226  9561 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 2.
I20260709 13:15:30.473591  9602 leader_election.cc:304] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.474439  9818 raft_consensus.cc:2804] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:30.474858  9710 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 2.
I20260709 13:15:30.474934  9818 raft_consensus.cc:697] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Becoming Leader. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:30.475927  9818 consensus_queue.cc:237] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.484094  9774 consensus_queue.cc:1048] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.487686  9791 consensus_queue.cc:1048] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.489136  9458 catalog_manager.cc:5697] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 reported cstate change: term changed from 1 to 2, leader changed from 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195) to b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.506286  9791 consensus_queue.cc:1048] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.517779  9795 consensus_queue.cc:1048] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.526319  9758 raft_consensus.cc:993] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:30.526772  9791 raft_consensus.cc:1081] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Signalling peer b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:30.528548  9637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:48148
I20260709 13:15:30.529446  9637 raft_consensus.cc:493] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.529853  9637 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.530560  9774 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.535576  9637 raft_consensus.cc:515] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.537935  9772 raft_consensus.cc:993] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: : Instructing follower b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:30.538391  9772 raft_consensus.cc:1081] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Signalling peer b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:30.538654  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:30.539211  9637 leader_election.cc:290] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 2 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.539254  9561 raft_consensus.cc:3055] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:30.539855  9561 raft_consensus.cc:740] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:30.540606  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:30.540676  9561 consensus_queue.cc:260] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.541214  9710 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.542340  9561 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.545545  9756 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.546222  9636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:15:30.546789  9636 raft_consensus.cc:493] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.547083  9636 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.553133  9636 raft_consensus.cc:515] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.556270  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:30.557027  9562 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.557701  9710 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 2.
I20260709 13:15:30.559031  9603 leader_election.cc:304] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.560002  9818 raft_consensus.cc:2804] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:30.560457  9818 raft_consensus.cc:697] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Becoming Leader. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:30.558650  9561 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 2.
I20260709 13:15:30.561343  9818 consensus_queue.cc:237] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.564795  9562 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 2.
I20260709 13:15:30.565534  9636 leader_election.cc:290] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 2 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.566630  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:30.567104  9710 raft_consensus.cc:3055] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:30.567363  9710 raft_consensus.cc:740] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:30.568106  9710 consensus_queue.cc:260] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.569147  9602 leader_election.cc:304] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.569411  9710 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.570061  9818 raft_consensus.cc:2804] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:30.570679  9818 raft_consensus.cc:697] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Becoming Leader. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:30.571516  9818 consensus_queue.cc:237] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.575932  9710 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 2.
I20260709 13:15:30.578720  9458 catalog_manager.cc:5697] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 reported cstate change: term changed from 1 to 2, leader changed from 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195) to b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.579864  9458 catalog_manager.cc:5697] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 reported cstate change: term changed from 1 to 2, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.668437  9756 consensus_queue.cc:1048] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.678488  9772 consensus_queue.cc:1048] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.685660  9774 raft_consensus.cc:993] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:30.686163  9774 raft_consensus.cc:1081] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:30.687722  9562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49436
I20260709 13:15:30.688402  9562 raft_consensus.cc:493] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.688712  9562 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.693462  9562 raft_consensus.cc:515] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.695194  9562 leader_election.cc:290] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 2 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.696111  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:30.696473  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:30.696715  9636 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.696995  9710 raft_consensus.cc:3055] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:30.697285  9710 raft_consensus.cc:740] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:30.697949  9710 consensus_queue.cc:260] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.698832  9710 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.702519  9636 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 2.
I20260709 13:15:30.703555  9528 leader_election.cc:304] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.704200  9791 raft_consensus.cc:2804] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:30.704579  9791 raft_consensus.cc:697] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:30.704802  9710 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 2.
I20260709 13:15:30.705312  9791 consensus_queue.cc:237] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.711957  9459 catalog_manager.cc:5697] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 1 to 2, leader changed from 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 2 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.862244  9772 raft_consensus.cc:993] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:30.862610  9774 raft_consensus.cc:1081] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:30.863897  9561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49436
I20260709 13:15:30.864342  9561 raft_consensus.cc:493] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.864630  9561 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.869760  9561 raft_consensus.cc:515] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.871206  9561 leader_election.cc:290] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 2 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:30.872334  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:30.872548  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:30.873070  9710 raft_consensus.cc:3055] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:30.873211  9636 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.873484  9710 raft_consensus.cc:740] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:30.874554  9710 consensus_queue.cc:260] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.875873  9710 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.881330  9636 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 2.
I20260709 13:15:30.882674  9710 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 2.
I20260709 13:15:30.882843  9528 leader_election.cc:304] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:30.883632  9791 raft_consensus.cc:2804] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:30.884089  9791 raft_consensus.cc:697] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:30.884800  9791 consensus_queue.cc:237] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:30.890868  9459 catalog_manager.cc:5697] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 1 to 2, leader changed from 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 2 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.953425  9561 raft_consensus.cc:1275] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:30.954665  9840 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.965045  9710 raft_consensus.cc:1275] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:30.966382  9783 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.043062  9561 raft_consensus.cc:1275] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.044238  9783 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.052831  9710 raft_consensus.cc:1275] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.054116  9783 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.122934  9710 raft_consensus.cc:1275] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.124217  9783 consensus_queue.cc:1048] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.131809  9561 raft_consensus.cc:1275] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.133186  9840 consensus_queue.cc:1048] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.269495  9636 raft_consensus.cc:1275] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.270918  9758 consensus_queue.cc:1048] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.277988  9710 raft_consensus.cc:1275] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.280122  9791 consensus_queue.cc:1048] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.293690  9636 raft_consensus.cc:1275] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.294811  9791 consensus_queue.cc:1048] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.302377  9710 raft_consensus.cc:1275] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:31.303828  9791 consensus_queue.cc:1048] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.368564  8939 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:33.369262  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:33.386376  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:15:33.386899  9561 raft_consensus.cc:606] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Received request to transfer leadership to TS 91d09da48d6040cbaf9ab247f0cab47a
I20260709 13:15:33.389377  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:15:33.389876  9561 raft_consensus.cc:606] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Received request to transfer leadership to TS 91d09da48d6040cbaf9ab247f0cab47a
I20260709 13:15:33.390900  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:33.391343  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:33.630038  9758 raft_consensus.cc:993] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:33.630504  9845 raft_consensus.cc:1081] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Signalling peer 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:33.632023  9710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:15:33.632421  9710 raft_consensus.cc:493] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.632683  9710 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.636787  9710 raft_consensus.cc:515] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:33.638221  9710 leader_election.cc:290] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 2 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:33.638972  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:33.639202  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:33.639689  9636 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.639796  9561 raft_consensus.cc:3055] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.640153  9561 raft_consensus.cc:740] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:33.640823  9561 consensus_queue.cc:260] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:33.641798  9561 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.645685  9636 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 2.
I20260709 13:15:33.646728  9677 leader_election.cc:304] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:33.647022  9561 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 2.
I20260709 13:15:33.647380  9774 raft_consensus.cc:2804] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:33.648335  9774 raft_consensus.cc:697] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:33.649068  9774 consensus_queue.cc:237] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:33.654893  9458 catalog_manager.cc:5697] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 1 to 2, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 2 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.768095  9758 raft_consensus.cc:993] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:33.768558  9845 raft_consensus.cc:1081] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Signalling peer 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:33.769961  9710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:15:33.770359  9710 raft_consensus.cc:493] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.770581  9710 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.774673  9710 raft_consensus.cc:515] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:33.776033  9710 leader_election.cc:290] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 2 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:33.776942  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:33.777032  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:33.777432  9561 raft_consensus.cc:3055] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.777514  9636 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.777695  9561 raft_consensus.cc:740] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:33.778481  9561 consensus_queue.cc:260] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:33.779690  9561 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.782325  9636 raft_consensus.cc:2468] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 2.
I20260709 13:15:33.783326  9677 leader_election.cc:304] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:33.784083  9774 raft_consensus.cc:2804] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:33.784454  9774 raft_consensus.cc:697] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:33.784598  9561 raft_consensus.cc:2468] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 2.
I20260709 13:15:33.785166  9774 consensus_queue.cc:237] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:33.791483  9458 catalog_manager.cc:5697] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 1 to 2, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 2 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.156292  9561 raft_consensus.cc:1275] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:34.157482  9774 consensus_queue.cc:1048] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.167791  9636 raft_consensus.cc:1275] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:34.169266  9774 consensus_queue.cc:1048] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.212141  9636 raft_consensus.cc:1275] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:34.213361  9774 consensus_queue.cc:1048] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.223541  9561 raft_consensus.cc:1275] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:34.224958  9774 consensus_queue.cc:1048] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.392123  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:34.407882  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:38658
I20260709 13:15:34.408331  9710 raft_consensus.cc:606] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:34.412808  9710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:38658
I20260709 13:15:34.413236  9710 raft_consensus.cc:606] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:34.432453  9636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:44658
I20260709 13:15:34.432981  9636 raft_consensus.cc:606] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:34.437592  9636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:44658
I20260709 13:15:34.438072  9636 raft_consensus.cc:606] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:34.442499  9636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
mode: GRACEFUL
new_leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:44658
I20260709 13:15:34.442974  9636 raft_consensus.cc:606] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Received request to transfer leadership to TS 93cc0019e14c4c81bb85a15aa27c5bcf
I20260709 13:15:34.490327  9865 raft_consensus.cc:993] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.490753  9843 raft_consensus.cc:1081] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.492304  9561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:15:34.492730  9561 raft_consensus.cc:493] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.492988  9561 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.497231  9561 raft_consensus.cc:515] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.498826  9561 leader_election.cc:290] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:34.499526  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:34.500128  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:34.500128  9637 raft_consensus.cc:3055] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:34.500586  9710 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.500607  9637 raft_consensus.cc:740] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:34.501348  9637 consensus_queue.cc:260] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.502252  9637 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.505534  9710 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.506593  9528 leader_election.cc:304] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:34.507052  9637 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.507375  9845 raft_consensus.cc:2804] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.508415  9845 raft_consensus.cc:697] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:34.509086  9845 consensus_queue.cc:237] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.515873  9459 catalog_manager.cc:5697] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 2 to 3, leader changed from b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 3 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.549896  9865 raft_consensus.cc:993] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.550282  9843 raft_consensus.cc:1081] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.551596  9561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:15:34.552026  9561 raft_consensus.cc:493] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.552249  9561 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.556190  9561 raft_consensus.cc:515] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.557515  9561 leader_election.cc:290] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:34.558429  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:34.558640  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583bf45858c748d5963211b28fb9b6e0" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:34.558902  9637 raft_consensus.cc:3055] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:34.559060  9710 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.559211  9637 raft_consensus.cc:740] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:34.559979  9637 consensus_queue.cc:260] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.560873  9637 raft_consensus.cc:3060] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.563190  9710 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.564152  9528 leader_election.cc:304] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:34.564786  9845 raft_consensus.cc:2804] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.565160  9845 raft_consensus.cc:697] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:34.565289  9637 raft_consensus.cc:2468] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.565925  9845 consensus_queue.cc:237] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.572608  9459 catalog_manager.cc:5697] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 2 to 3, leader changed from b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 3 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.623334  9848 raft_consensus.cc:993] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.623724  9774 raft_consensus.cc:1081] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.625029  9561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49436
I20260709 13:15:34.625445  9561 raft_consensus.cc:493] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.625695  9561 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.630062  9561 raft_consensus.cc:515] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.631646  9561 leader_election.cc:290] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:34.632663  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:34.632822  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b9ca4e70ae4357a3be5c7dab250f16" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:34.633167  9637 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.633278  9710 raft_consensus.cc:3055] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:34.633558  9710 raft_consensus.cc:740] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:34.634150  9710 consensus_queue.cc:260] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.634976  9710 raft_consensus.cc:3060] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.638219  9637 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.638917  9710 raft_consensus.cc:2468] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.639406  9528 leader_election.cc:304] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:34.640229  9845 raft_consensus.cc:2804] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.640622  9845 raft_consensus.cc:697] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:34.641355  9845 consensus_queue.cc:237] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.647418  9459 catalog_manager.cc:5697] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 2 to 3, leader changed from 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 3 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.692261  9848 raft_consensus.cc:993] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.692648  9774 raft_consensus.cc:1081] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.693960  9561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49436
I20260709 13:15:34.694375  9561 raft_consensus.cc:493] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.694640  9561 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.698729  9561 raft_consensus.cc:515] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.700089  9561 leader_election.cc:290] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:34.701253  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:34.701253  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c3b9f26fa847da83c7f263b48e2186" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:34.701952  9710 raft_consensus.cc:3055] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:34.702019  9637 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.702304  9710 raft_consensus.cc:740] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:34.703009  9710 consensus_queue.cc:260] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.703467  9865 raft_consensus.cc:993] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: : Instructing follower 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.703981  9843 raft_consensus.cc:1081] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Signalling peer 93cc0019e14c4c81bb85a15aa27c5bcf to start an election
I20260709 13:15:34.704232  9710 raft_consensus.cc:3060] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.705358  9561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:15:34.705775  9561 raft_consensus.cc:493] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.706027  9561 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.708863  9637 raft_consensus.cc:2468] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.710031  9561 raft_consensus.cc:515] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.710071  9528 leader_election.cc:304] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93cc0019e14c4c81bb85a15aa27c5bcf, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:34.710601  9710 raft_consensus.cc:2468] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.711009  9845 raft_consensus.cc:2804] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.711460  9845 raft_consensus.cc:697] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:34.711982  9561 leader_election.cc:290] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Requested vote from peers b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:34.712283  9845 consensus_queue.cc:237] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.713264  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:34.713833  9637 raft_consensus.cc:3055] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:34.714033  9710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:34.714268  9637 raft_consensus.cc:740] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:34.714591  9710 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.715241  9637 consensus_queue.cc:260] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.716455  9637 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.719648  9459 catalog_manager.cc:5697] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 2 to 3, leader changed from 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 3 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.721992  9710 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.722533  9637 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93cc0019e14c4c81bb85a15aa27c5bcf in term 3.
I20260709 13:15:34.723384  9528 leader_election.cc:304] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, 93cc0019e14c4c81bb85a15aa27c5bcf; no voters: 
I20260709 13:15:34.724027  9845 raft_consensus.cc:2804] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.724490  9845 raft_consensus.cc:697] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Leader. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:34.725080  9845 consensus_queue.cc:237] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:34.731475  9459 catalog_manager.cc:5697] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf reported cstate change: term changed from 2 to 3, leader changed from b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194) to 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193). New cstate: current_term: 3 leader_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.941298  9710 raft_consensus.cc:1275] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:34.942390  9845 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:34.950906  9637 raft_consensus.cc:1275] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:34.952626  9875 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.064085  9710 raft_consensus.cc:1275] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.065240  9875 consensus_queue.cc:1048] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.072753  9637 raft_consensus.cc:1275] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.074560  9845 consensus_queue.cc:1048] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.111583  9710 raft_consensus.cc:1275] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.112972  9845 consensus_queue.cc:1048] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.121829  9637 raft_consensus.cc:1275] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.123165  9875 consensus_queue.cc:1048] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.137038  9710 raft_consensus.cc:1275] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.138156  9875 consensus_queue.cc:1048] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.145892  9637 raft_consensus.cc:1275] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.147022  9875 consensus_queue.cc:1048] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:35.240031  9637 raft_consensus.cc:1275] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.241099  9875 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.249176  9710 raft_consensus.cc:1275] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Refusing update from remote peer 93cc0019e14c4c81bb85a15aa27c5bcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.251117  9875 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:37.449695  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:37.458487  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:15:37.459118  9561 raft_consensus.cc:606] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Received request to transfer leadership to TS 91d09da48d6040cbaf9ab247f0cab47a
I20260709 13:15:37.461774  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:15:37.462209  9561 raft_consensus.cc:606] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Received request to transfer leadership to TS 91d09da48d6040cbaf9ab247f0cab47a
I20260709 13:15:37.464506  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:15:37.464931  9561 raft_consensus.cc:606] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Received request to transfer leadership to TS b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:37.467003  9561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24"
dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
mode: GRACEFUL
new_leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:15:37.467404  9561 raft_consensus.cc:606] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Received request to transfer leadership to TS b8d5d020b0f8457c8dda0e5d078e0719
I20260709 13:15:37.468405  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:37.469002  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:37.511188  9845 raft_consensus.cc:993] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:37.511807  9884 raft_consensus.cc:1081] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Signalling peer 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:37.513422  9711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:15:37.513895  9711 raft_consensus.cc:493] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:37.514204  9711 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.520900  9711 raft_consensus.cc:515] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.523289  9711 leader_election.cc:290] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 4 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:37.524541  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:37.524505  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38f90449075f4a5bb5ef60b03c2bd994" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:37.525519  9637 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.525504  9562 raft_consensus.cc:3055] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:37.526019  9562 raft_consensus.cc:740] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:37.526954  9562 consensus_queue.cc:260] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.528323  9562 raft_consensus.cc:3060] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.533049  9637 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 4.
I20260709 13:15:37.534538  9677 leader_election.cc:304] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:37.535383  9774 raft_consensus.cc:2804] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:37.535432  9562 raft_consensus.cc:2468] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 4.
I20260709 13:15:37.536495  9774 raft_consensus.cc:697] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:37.537530  9774 consensus_queue.cc:237] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.544400  9459 catalog_manager.cc:5697] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 3 to 4, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 4 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.607205  9845 raft_consensus.cc:993] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:37.607651  9884 raft_consensus.cc:1081] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Signalling peer 91d09da48d6040cbaf9ab247f0cab47a to start an election
I20260709 13:15:37.609062  9711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94"
dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
 from {username='slave'} at 127.0.0.1:38634
I20260709 13:15:37.609514  9711 raft_consensus.cc:493] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:37.609810  9711 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.614897  9711 raft_consensus.cc:515] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.616626  9711 leader_election.cc:290] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 3 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347)
I20260709 13:15:37.617445  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:37.617586  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721c3209a34a4fa7840b6163ba6e4c94" candidate_uuid: "91d09da48d6040cbaf9ab247f0cab47a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
I20260709 13:15:37.618017  9562 raft_consensus.cc:3055] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:37.618072  9637 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.618342  9562 raft_consensus.cc:740] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:37.619021  9562 consensus_queue.cc:260] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.619997  9562 raft_consensus.cc:3060] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.622570  9637 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 3.
I20260709 13:15:37.623601  9677 leader_election.cc:304] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:37.624503  9774 raft_consensus.cc:2804] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:37.625393  9562 raft_consensus.cc:2468] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d09da48d6040cbaf9ab247f0cab47a in term 3.
I20260709 13:15:37.626569  9774 raft_consensus.cc:697] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 LEADER]: Becoming Leader. State: Replica: 91d09da48d6040cbaf9ab247f0cab47a, State: Running, Role: LEADER
I20260709 13:15:37.627555  9774 consensus_queue.cc:237] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.634804  9459 catalog_manager.cc:5697] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a reported cstate change: term changed from 2 to 3, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195). New cstate: current_term: 3 leader_uuid: "91d09da48d6040cbaf9ab247f0cab47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.665902  9845 raft_consensus.cc:993] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:37.666337  9884 raft_consensus.cc:1081] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Signalling peer b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:37.667809  9637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:48148
I20260709 13:15:37.668231  9637 raft_consensus.cc:493] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:37.668501  9637 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.672562  9637 raft_consensus.cc:515] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.674055  9637 leader_election.cc:290] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 4 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:37.675199  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:37.675196  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fb410524e743638bc2578b6b666b82" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:37.675910  9711 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.676827  9562 raft_consensus.cc:3055] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:37.677109  9562 raft_consensus.cc:740] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:37.677898  9562 consensus_queue.cc:260] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.678907  9562 raft_consensus.cc:3060] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.681648  9711 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 4.
I20260709 13:15:37.682868  9603 leader_election.cc:304] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:37.683612  9843 raft_consensus.cc:2804] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:37.683892  9562 raft_consensus.cc:2468] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 4.
I20260709 13:15:37.684960  9843 raft_consensus.cc:697] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 LEADER]: Becoming Leader. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:37.685796  9843 consensus_queue.cc:237] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.693004  9459 catalog_manager.cc:5697] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 reported cstate change: term changed from 3 to 4, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.723676  9845 raft_consensus.cc:993] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: : Instructing follower b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:37.724153  9884 raft_consensus.cc:1081] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Signalling peer b8d5d020b0f8457c8dda0e5d078e0719 to start an election
I20260709 13:15:37.725476  9637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24"
dest_uuid: "b8d5d020b0f8457c8dda0e5d078e0719"
 from {username='slave'} at 127.0.0.1:48148
I20260709 13:15:37.725872  9637 raft_consensus.cc:493] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:37.726092  9637 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.730197  9637 raft_consensus.cc:515] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.731565  9637 leader_election.cc:290] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 3 election: Requested vote from peers 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809), 91d09da48d6040cbaf9ab247f0cab47a (127.8.186.195:44595)
I20260709 13:15:37.732389  9562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf"
I20260709 13:15:37.732625  9711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4ab0c19a254a6cb841c918138e6c24" candidate_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91d09da48d6040cbaf9ab247f0cab47a"
I20260709 13:15:37.732911  9562 raft_consensus.cc:3055] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:37.733124  9711 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.733202  9562 raft_consensus.cc:740] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93cc0019e14c4c81bb85a15aa27c5bcf, State: Running, Role: LEADER
I20260709 13:15:37.733959  9562 consensus_queue.cc:260] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.734882  9562 raft_consensus.cc:3060] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.738521  9711 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 3.
I20260709 13:15:37.739408  9603 leader_election.cc:304] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91d09da48d6040cbaf9ab247f0cab47a, b8d5d020b0f8457c8dda0e5d078e0719; no voters: 
I20260709 13:15:37.740104  9843 raft_consensus.cc:2804] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:37.740573  9843 raft_consensus.cc:697] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 LEADER]: Becoming Leader. State: Replica: b8d5d020b0f8457c8dda0e5d078e0719, State: Running, Role: LEADER
I20260709 13:15:37.741700  9562 raft_consensus.cc:2468] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d5d020b0f8457c8dda0e5d078e0719 in term 3.
I20260709 13:15:37.741465  9843 consensus_queue.cc:237] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } }
I20260709 13:15:37.749569  9459 catalog_manager.cc:5697] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 reported cstate change: term changed from 2 to 3, leader changed from 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193) to b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.068795  9637 raft_consensus.cc:1275] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:38.070027  9774 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:38.073853  9562 raft_consensus.cc:1275] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:38.075601  9843 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:38.077874  9636 raft_consensus.cc:1275] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:38.080554  9885 consensus_queue.cc:1048] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d5d020b0f8457c8dda0e5d078e0719" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.085259  9562 raft_consensus.cc:1275] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:38.087167  9885 consensus_queue.cc:1048] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:38.112401  9711 raft_consensus.cc:1275] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:38.112946  9561 raft_consensus.cc:1275] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Refusing update from remote peer 91d09da48d6040cbaf9ab247f0cab47a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:38.114486  9893 consensus_queue.cc:1048] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:38.117303  9899 consensus_queue.cc:1048] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.286679  9561 raft_consensus.cc:1275] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:38.287771  9893 consensus_queue.cc:1048] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93cc0019e14c4c81bb85a15aa27c5bcf" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:38.291463  9711 raft_consensus.cc:1275] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Refusing update from remote peer b8d5d020b0f8457c8dda0e5d078e0719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:38.292829  9893 consensus_queue.cc:1048] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d09da48d6040cbaf9ab247f0cab47a" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 44595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:38.469959  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:38.475566  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
I20260709 13:15:38.492986  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:38.494341  8939 tablet_replica.cc:333] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.495213  8939 raft_consensus.cc:2243] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.495630  8939 raft_consensus.cc:2272] T 38f90449075f4a5bb5ef60b03c2bd994 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.495849  9676 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:15:38.500053  8939 tablet_replica.cc:333] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
W20260709 13:15:38.500541  9676 consensus_peers.cc:597] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a -> Peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Couldn't send request to peer 93cc0019e14c4c81bb85a15aa27c5bcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.501063  8939 raft_consensus.cc:2243] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.502017  8939 raft_consensus.cc:2272] T 10f93462f9c9481ab1c9acd7b81c5e07 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.504464  8939 tablet_replica.cc:333] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.505221  8939 raft_consensus.cc:2243] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:15:38.506039  9676 consensus_peers.cc:597] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a -> Peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Couldn't send request to peer 93cc0019e14c4c81bb85a15aa27c5bcf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.506143  8939 raft_consensus.cc:2272] T 26c3b9f26fa847da83c7f263b48e2186 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.507997  8939 tablet_replica.cc:333] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.508497  8939 raft_consensus.cc:2243] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.508870  8939 raft_consensus.cc:2272] T 4ef4fcff49154fd6a7d64347c6fede0b P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.510540  8939 tablet_replica.cc:333] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.511015  8939 raft_consensus.cc:2243] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.511422  8939 raft_consensus.cc:2272] T fb4ab0c19a254a6cb841c918138e6c24 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.513463  8939 tablet_replica.cc:333] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.513911  8939 raft_consensus.cc:2243] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.514633  8939 raft_consensus.cc:2272] T 583bf45858c748d5963211b28fb9b6e0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.516335  8939 tablet_replica.cc:333] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.516803  8939 raft_consensus.cc:2243] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.517154  8939 raft_consensus.cc:2272] T edae947f5ff14bef80eb1882ef34d4b0 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.518704  8939 tablet_replica.cc:333] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.519143  8939 raft_consensus.cc:2243] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.519857  8939 raft_consensus.cc:2272] T 01b9ca4e70ae4357a3be5c7dab250f16 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.521421  8939 tablet_replica.cc:333] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.521842  8939 raft_consensus.cc:2243] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.522184  8939 raft_consensus.cc:2272] T b0fb410524e743638bc2578b6b666b82 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.524096  8939 tablet_replica.cc:333] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf: stopping tablet replica
I20260709 13:15:38.524516  8939 raft_consensus.cc:2243] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.524855  8939 raft_consensus.cc:2272] T 721c3209a34a4fa7840b6163ba6e4c94 P 93cc0019e14c4c81bb85a15aa27c5bcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.555325  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
I20260709 13:15:38.575438  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
I20260709 13:15:38.595984  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:38.596729  8939 tablet_replica.cc:333] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.597546  8939 raft_consensus.cc:2243] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.598147  8939 raft_consensus.cc:2272] T 721c3209a34a4fa7840b6163ba6e4c94 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.600137  9602 consensus_peers.cc:597] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 -> Peer 93cc0019e14c4c81bb85a15aa27c5bcf (127.8.186.193:36809): Couldn't send request to peer 93cc0019e14c4c81bb85a15aa27c5bcf. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:36809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.600487  8939 tablet_replica.cc:333] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.601044  8939 raft_consensus.cc:2243] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.601442  8939 raft_consensus.cc:2272] T 38f90449075f4a5bb5ef60b03c2bd994 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.603271  8939 tablet_replica.cc:333] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.603814  8939 raft_consensus.cc:2243] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.604220  8939 raft_consensus.cc:2272] T 26c3b9f26fa847da83c7f263b48e2186 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.605870  8939 tablet_replica.cc:333] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.606302  8939 raft_consensus.cc:2243] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.606649  8939 raft_consensus.cc:2272] T 4ef4fcff49154fd6a7d64347c6fede0b P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.608167  8939 tablet_replica.cc:333] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.608630  8939 raft_consensus.cc:2243] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.609282  8939 raft_consensus.cc:2272] T b0fb410524e743638bc2578b6b666b82 P b8d5d020b0f8457c8dda0e5d078e0719 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.611030  8939 tablet_replica.cc:333] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.611526  8939 raft_consensus.cc:2243] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.611956  8939 raft_consensus.cc:2272] T 01b9ca4e70ae4357a3be5c7dab250f16 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.613443  8939 tablet_replica.cc:333] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.613863  8939 raft_consensus.cc:2243] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.614243  8939 raft_consensus.cc:2272] T 583bf45858c748d5963211b28fb9b6e0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.615799  8939 tablet_replica.cc:333] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.616251  8939 raft_consensus.cc:2243] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.616997  8939 raft_consensus.cc:2272] T edae947f5ff14bef80eb1882ef34d4b0 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.618611  8939 tablet_replica.cc:333] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.619061  8939 raft_consensus.cc:2243] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.619426  8939 raft_consensus.cc:2272] T 10f93462f9c9481ab1c9acd7b81c5e07 P b8d5d020b0f8457c8dda0e5d078e0719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.621008  8939 tablet_replica.cc:333] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719: stopping tablet replica
I20260709 13:15:38.621423  8939 raft_consensus.cc:2243] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.622044  8939 raft_consensus.cc:2272] T fb4ab0c19a254a6cb841c918138e6c24 P b8d5d020b0f8457c8dda0e5d078e0719 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:38.633920  9677 consensus_peers.cc:597] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a -> Peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Couldn't send request to peer b8d5d020b0f8457c8dda0e5d078e0719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:38.636695  8939 connection.cc:466] server connection from 127.0.0.1:48134 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48134 (request call id 62) could send its response
W20260709 13:15:38.641513  9677 consensus_peers.cc:597] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a -> Peer b8d5d020b0f8457c8dda0e5d078e0719 (127.8.186.194:34347): Couldn't send request to peer b8d5d020b0f8457c8dda0e5d078e0719. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:34347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.650193  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
I20260709 13:15:38.668110  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
I20260709 13:15:38.686729  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:38.687363  8939 tablet_replica.cc:333] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.687965  8939 raft_consensus.cc:2243] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.688421  8939 raft_consensus.cc:2272] T 583bf45858c748d5963211b28fb9b6e0 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.690107  8939 tablet_replica.cc:333] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.690584  8939 raft_consensus.cc:2243] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.690963  8939 raft_consensus.cc:2272] T edae947f5ff14bef80eb1882ef34d4b0 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.692555  8939 tablet_replica.cc:333] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.693003  8939 raft_consensus.cc:2243] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.693660  8939 raft_consensus.cc:2272] T 721c3209a34a4fa7840b6163ba6e4c94 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.695641  8939 tablet_replica.cc:333] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.696173  8939 raft_consensus.cc:2243] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.696844  8939 raft_consensus.cc:2272] T 4ef4fcff49154fd6a7d64347c6fede0b P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.698333  8939 tablet_replica.cc:333] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.698781  8939 raft_consensus.cc:2243] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.699108  8939 raft_consensus.cc:2272] T 26c3b9f26fa847da83c7f263b48e2186 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.700637  8939 tablet_replica.cc:333] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.701061  8939 raft_consensus.cc:2243] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.701453  8939 raft_consensus.cc:2272] T 01b9ca4e70ae4357a3be5c7dab250f16 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.703086  8939 tablet_replica.cc:333] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.703550  8939 raft_consensus.cc:2243] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.704036  8939 raft_consensus.cc:2272] T b0fb410524e743638bc2578b6b666b82 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.706246  8939 tablet_replica.cc:333] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.706686  8939 raft_consensus.cc:2243] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.707355  8939 raft_consensus.cc:2272] T 38f90449075f4a5bb5ef60b03c2bd994 P 91d09da48d6040cbaf9ab247f0cab47a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.709055  8939 tablet_replica.cc:333] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.709467  8939 raft_consensus.cc:2243] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.709806  8939 raft_consensus.cc:2272] T 10f93462f9c9481ab1c9acd7b81c5e07 P 91d09da48d6040cbaf9ab247f0cab47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.711226  8939 tablet_replica.cc:333] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a: stopping tablet replica
I20260709 13:15:38.711613  8939 raft_consensus.cc:2243] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:38.712020  8939 raft_consensus.cc:2272] T fb4ab0c19a254a6cb841c918138e6c24 P 91d09da48d6040cbaf9ab247f0cab47a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.738093  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:15:38.755573  8939 master.cc:562] Master@127.8.186.254:40713 shutting down...
I20260709 13:15:38.772975  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.773489  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.773821  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P 41d380a15f6945ffbc67671df9269018: stopping tablet replica
I20260709 13:15:38.792798  8939 master.cc:584] Master@127.8.186.254:40713 shutdown complete.
91d09da48d6040cbaf9ab247f0cab47a  1
93cc0019e14c4c81bb85a15aa27c5bcf  5
b8d5d020b0f8457c8dda0e5d078e0719  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10155 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:38.831961  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:36577
I20260709 13:15:38.833073  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.838205  9914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.838233  9913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.839733  9916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.840710  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:38.841557  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:38.841734  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:38.841853  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602938841836 us; error 0 us; skew 500 ppm
I20260709 13:15:38.842310  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.844919  8939 webserver.cc:533] Webserver started at http://127.8.186.254:46423/ using document root <none> and password file <none>
I20260709 13:15:38.845377  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.845527  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:38.845750  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:38.846817  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "a2e763e48a394cda873aa837f65da240"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-mq27"
I20260709 13:15:38.851249  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:38.854622  9921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.855338  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:38.855608  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "a2e763e48a394cda873aa837f65da240"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-mq27"
I20260709 13:15:38.855916  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.866945  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.868273  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.905802  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:36577
I20260709 13:15:38.905886  9972 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:36577 every 8 connection(s)
I20260709 13:15:38.909685  9973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.919396  9973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Bootstrap starting.
I20260709 13:15:38.924039  9973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.928220  9973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: No bootstrap required, opened a new log
I20260709 13:15:38.930527  9973 raft_consensus.cc:359] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e763e48a394cda873aa837f65da240" member_type: VOTER }
I20260709 13:15:38.930929  9973 raft_consensus.cc:385] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.931160  9973 raft_consensus.cc:740] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e763e48a394cda873aa837f65da240, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.931697  9973 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e763e48a394cda873aa837f65da240" member_type: VOTER }
I20260709 13:15:38.932170  9973 raft_consensus.cc:399] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:38.932377  9973 raft_consensus.cc:493] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:38.932621  9973 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.936970  9973 raft_consensus.cc:515] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e763e48a394cda873aa837f65da240" member_type: VOTER }
I20260709 13:15:38.937857  9973 leader_election.cc:304] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2e763e48a394cda873aa837f65da240; no voters: 
I20260709 13:15:38.939021  9973 leader_election.cc:290] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:38.939417  9976 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.940644  9976 raft_consensus.cc:697] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 1 LEADER]: Becoming Leader. State: Replica: a2e763e48a394cda873aa837f65da240, State: Running, Role: LEADER
I20260709 13:15:38.941296  9976 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e763e48a394cda873aa837f65da240" member_type: VOTER }
I20260709 13:15:38.941807  9973 sys_catalog.cc:565] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:38.945883  9978 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2e763e48a394cda873aa837f65da240. Latest consensus state: current_term: 1 leader_uuid: "a2e763e48a394cda873aa837f65da240" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e763e48a394cda873aa837f65da240" member_type: VOTER } }
I20260709 13:15:38.946316  9977 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2e763e48a394cda873aa837f65da240" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e763e48a394cda873aa837f65da240" member_type: VOTER } }
I20260709 13:15:38.946599  9978 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:38.946805  9977 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:38.952536  9984 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:38.957962  9984 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:38.961776  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:38.966895  9984 catalog_manager.cc:1383] Generated new cluster ID: 630e7feee58a496693ea6d1e106c08d5
I20260709 13:15:38.967156  9984 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:38.997936  9984 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:38.999153  9984 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:39.012887  9984 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Generated new TSK 0
I20260709 13:15:39.013451  9984 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:39.028657  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.034350  9994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.035583  9995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.036617  9997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.037195  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:39.037972  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.038151  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.038300  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602939038283 us; error 0 us; skew 500 ppm
I20260709 13:15:39.038816  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.041138  8939 webserver.cc:533] Webserver started at http://127.8.186.193:38089/ using document root <none> and password file <none>
I20260709 13:15:39.041589  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.041774  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.042018  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.043046  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "9a67604b91f54791b1316fd327793337"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-mq27"
I20260709 13:15:39.047509  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:15:39.050794 10002 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.051499  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:39.051838  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "9a67604b91f54791b1316fd327793337"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-mq27"
I20260709 13:15:39.052124  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.064123  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.065369  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.066810  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.069144  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.069337  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.069571  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.069747  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.112061  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:38563
I20260709 13:15:39.112139 10064 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:38563 every 8 connection(s)
I20260709 13:15:39.116796  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.124238 10069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.126667 10070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.127319 10072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.129186  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:39.130227  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:39.130375 10065 heartbeater.cc:344] Connected to a master server at 127.8.186.254:36577
W20260709 13:15:39.130512  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.130726  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602939130711 us; error 0 us; skew 500 ppm
I20260709 13:15:39.130795 10065 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.131474  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.131688 10065 heartbeater.cc:507] Master 127.8.186.254:36577 requested a full tablet report, sending...
I20260709 13:15:39.134189  8939 webserver.cc:533] Webserver started at http://127.8.186.194:39447/ using document root <none> and password file <none>
I20260709 13:15:39.134131  9938 ts_manager.cc:194] Registered new tserver with Master: 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:39.134743  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.134943  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.135177  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.136126  9938 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46600
I20260709 13:15:39.136303  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "fd3903ba079e4f47aaf0aa4432382c23"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-mq27"
I20260709 13:15:39.141193  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:39.144351 10077 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.145043  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:39.145327  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "fd3903ba079e4f47aaf0aa4432382c23"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-mq27"
I20260709 13:15:39.145582  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.162930  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.164250  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.166162  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.168627  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.168833  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.169075  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.169215  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.207120  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:35119
I20260709 13:15:39.207221 10139 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:35119 every 8 connection(s)
I20260709 13:15:39.211881  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.218514 10143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.219225 10144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.222302 10146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.222630 10140 heartbeater.cc:344] Connected to a master server at 127.8.186.254:36577
I20260709 13:15:39.223057 10140 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.223791 10140 heartbeater.cc:507] Master 127.8.186.254:36577 requested a full tablet report, sending...
I20260709 13:15:39.225850  9938 ts_manager.cc:194] Registered new tserver with Master: fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:39.227130  9938 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46604
I20260709 13:15:39.229166  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:39.230017  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.230213  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.230394  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602939230379 us; error 0 us; skew 500 ppm
I20260709 13:15:39.230943  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.233548  8939 webserver.cc:533] Webserver started at http://127.8.186.195:42705/ using document root <none> and password file <none>
I20260709 13:15:39.234027  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.234210  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.234483  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.235670  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "f145536c6dbe456fb8565950244bc2a5"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-mq27"
I20260709 13:15:39.240061  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:39.243544 10151 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.244323  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:39.244607  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "f145536c6dbe456fb8565950244bc2a5"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-mq27"
I20260709 13:15:39.244884  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.266215  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.267447  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.268987  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.271349  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.271561  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.271842  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.272002  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.311645  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:39091
I20260709 13:15:39.311771 10213 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:39091 every 8 connection(s)
I20260709 13:15:39.325441 10214 heartbeater.cc:344] Connected to a master server at 127.8.186.254:36577
I20260709 13:15:39.325848 10214 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.326537 10214 heartbeater.cc:507] Master 127.8.186.254:36577 requested a full tablet report, sending...
I20260709 13:15:39.328559  9938 ts_manager.cc:194] Registered new tserver with Master: f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:39.329432  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014592016s
I20260709 13:15:39.330119  9938 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46608
I20260709 13:15:39.355252  9938 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46624:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:39.361512  9938 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:39.563081 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7c959dd43740e0922779387d4a3046 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:39.564603 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7c959dd43740e0922779387d4a3046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.567035 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 72fb3f38009a4e7c9c49a225873b591d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:39.567858 10030 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7c959dd43740e0922779387d4a3046 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:39.568517 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fb3f38009a4e7c9c49a225873b591d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.569168 10030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7c959dd43740e0922779387d4a3046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.570000 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 811060649d664704b4b7ab08b2d4a419 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:39.570363 10178 tablet_service.cc:1511] Processing CreateTablet for tablet dc4197bea6d247b289e63500fc5bc56e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:39.571130 10029 tablet_service.cc:1511] Processing CreateTablet for tablet dc4197bea6d247b289e63500fc5bc56e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:39.571473 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811060649d664704b4b7ab08b2d4a419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.572743 10177 tablet_service.cc:1511] Processing CreateTablet for tablet a30a6af7e1c84c848d5ae312ca4c3eb8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:39.572837 10028 tablet_service.cc:1511] Processing CreateTablet for tablet a30a6af7e1c84c848d5ae312ca4c3eb8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:39.574437 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a6af7e1c84c848d5ae312ca4c3eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.575304 10176 tablet_service.cc:1511] Processing CreateTablet for tablet d634bc48b9d24bac964c65941dbc95ba (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:39.576226 10023 tablet_service.cc:1511] Processing CreateTablet for tablet b57d4d09773c44b6b5b6a6c1002cf19f (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:39.576849 10027 tablet_service.cc:1511] Processing CreateTablet for tablet d634bc48b9d24bac964c65941dbc95ba (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:39.577521 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d4d09773c44b6b5b6a6c1002cf19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.577569 10104 tablet_service.cc:1511] Processing CreateTablet for tablet dc4197bea6d247b289e63500fc5bc56e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:39.578953 10026 tablet_service.cc:1511] Processing CreateTablet for tablet f9a32b1065fb4ad3a7f2a86329f56464 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:39.580073 10103 tablet_service.cc:1511] Processing CreateTablet for tablet a30a6af7e1c84c848d5ae312ca4c3eb8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:39.580780 10025 tablet_service.cc:1511] Processing CreateTablet for tablet 72fb3f38009a4e7c9c49a225873b591d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:39.582307 10102 tablet_service.cc:1511] Processing CreateTablet for tablet d634bc48b9d24bac964c65941dbc95ba (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:39.583351 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a32b1065fb4ad3a7f2a86329f56464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.584872 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fb3f38009a4e7c9c49a225873b591d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.584522 10101 tablet_service.cc:1511] Processing CreateTablet for tablet f9a32b1065fb4ad3a7f2a86329f56464 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:39.585394 10022 tablet_service.cc:1511] Processing CreateTablet for tablet d6e8de93fa794635a32ba4eb6cdc82ca (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:39.586608 10022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e8de93fa794635a32ba4eb6cdc82ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.588157 10029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4197bea6d247b289e63500fc5bc56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.563081 10105 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7c959dd43740e0922779387d4a3046 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:39.592306 10175 tablet_service.cc:1511] Processing CreateTablet for tablet f9a32b1065fb4ad3a7f2a86329f56464 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:39.593294 10021 tablet_service.cc:1511] Processing CreateTablet for tablet a17d1dcb93ee43aeb594457df0185659 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:39.594626 10021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d1dcb93ee43aeb594457df0185659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.594767 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 72fb3f38009a4e7c9c49a225873b591d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:39.596894 10173 tablet_service.cc:1511] Processing CreateTablet for tablet 811060649d664704b4b7ab08b2d4a419 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:39.597536 10098 tablet_service.cc:1511] Processing CreateTablet for tablet b57d4d09773c44b6b5b6a6c1002cf19f (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:39.598325 10027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d634bc48b9d24bac964c65941dbc95ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.599156 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 811060649d664704b4b7ab08b2d4a419 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:39.599766 10097 tablet_service.cc:1511] Processing CreateTablet for tablet d6e8de93fa794635a32ba4eb6cdc82ca (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:39.601511 10172 tablet_service.cc:1511] Processing CreateTablet for tablet b57d4d09773c44b6b5b6a6c1002cf19f (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:39.601920 10096 tablet_service.cc:1511] Processing CreateTablet for tablet a17d1dcb93ee43aeb594457df0185659 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:39.571482 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4197bea6d247b289e63500fc5bc56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.604779 10171 tablet_service.cc:1511] Processing CreateTablet for tablet d6e8de93fa794635a32ba4eb6cdc82ca (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:39.606062 10171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e8de93fa794635a32ba4eb6cdc82ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.608316 10172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d4d09773c44b6b5b6a6c1002cf19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.609022 10175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a32b1065fb4ad3a7f2a86329f56464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.608949 10170 tablet_service.cc:1511] Processing CreateTablet for tablet a17d1dcb93ee43aeb594457df0185659 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:39.609709 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d634bc48b9d24bac964c65941dbc95ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.611718 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72fb3f38009a4e7c9c49a225873b591d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.612412 10173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811060649d664704b4b7ab08b2d4a419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.613022 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d1dcb93ee43aeb594457df0185659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.578908 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4197bea6d247b289e63500fc5bc56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.616098 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a6af7e1c84c848d5ae312ca4c3eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.618611 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e8de93fa794635a32ba4eb6cdc82ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.619289 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811060649d664704b4b7ab08b2d4a419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.620134 10103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a6af7e1c84c848d5ae312ca4c3eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.622357 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d4d09773c44b6b5b6a6c1002cf19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.628150 10105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7c959dd43740e0922779387d4a3046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.634014 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a32b1065fb4ad3a7f2a86329f56464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.635196 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d634bc48b9d24bac964c65941dbc95ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.635977 10096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d1dcb93ee43aeb594457df0185659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.687793 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 133523a809584dd5b44a19acf589801d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:39.689271 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133523a809584dd5b44a19acf589801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.707365 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab28ea212034df2acdf22eab1b39bdd (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:39.708858 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab28ea212034df2acdf22eab1b39bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.732640 10230 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:39.746487 10171 tablet_service.cc:1511] Processing CreateTablet for tablet 34831254ce7143c8bf6fa684a958c7dc (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:39.748080 10171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34831254ce7143c8bf6fa684a958c7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.750514 10021 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab28ea212034df2acdf22eab1b39bdd (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:39.752055 10021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab28ea212034df2acdf22eab1b39bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.759068 10229 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:39.759578 10023 tablet_service.cc:1511] Processing CreateTablet for tablet 133523a809584dd5b44a19acf589801d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:39.760983 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133523a809584dd5b44a19acf589801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.766390 10170 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe760ac48e44c2d9fce1d214088eb0e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:39.772292 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 380d0cf74fa74de9b77a62b31da282f1 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:39.779511 10023 tablet_service.cc:1511] Processing CreateTablet for tablet 34831254ce7143c8bf6fa684a958c7dc (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:39.781734 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34831254ce7143c8bf6fa684a958c7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.791615 10171 tablet_service.cc:1511] Processing CreateTablet for tablet 778034d202c94f46bfe767ecaf503d1e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:39.793576 10178 tablet_service.cc:1511] Processing CreateTablet for tablet 2db964eeed76452cb3a8a969e5e2b32a (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:39.767637 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe760ac48e44c2d9fce1d214088eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.795264 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380d0cf74fa74de9b77a62b31da282f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.800384 10176 tablet_service.cc:1511] Processing CreateTablet for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:39.801748 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fa3c9e8a7a496eaa49ec78b5a92103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.804232 10175 tablet_service.cc:1511] Processing CreateTablet for tablet 9339757002c64268bb483f1a5bfe0ccf (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:39.805075 10230 tablet_bootstrap.cc:654] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.806118 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab28ea212034df2acdf22eab1b39bdd (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:39.808048 10171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778034d202c94f46bfe767ecaf503d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.810704 10101 tablet_service.cc:1511] Processing CreateTablet for tablet 133523a809584dd5b44a19acf589801d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:39.812737 10173 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff24b1804914099b167420853598f48 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:39.817245 10103 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe760ac48e44c2d9fce1d214088eb0e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:39.813048 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:39.818714 10105 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff24b1804914099b167420853598f48 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:39.840760 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe760ac48e44c2d9fce1d214088eb0e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:39.842187 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe760ac48e44c2d9fce1d214088eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.842880 10023 tablet_service.cc:1511] Processing CreateTablet for tablet 380d0cf74fa74de9b77a62b31da282f1 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:39.845532 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380d0cf74fa74de9b77a62b31da282f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.847519 10229 tablet_bootstrap.cc:654] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.822175 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 380d0cf74fa74de9b77a62b31da282f1 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:39.822582 10099 tablet_service.cc:1511] Processing CreateTablet for tablet d739126ade124f87a06c44ebdd114d8b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:39.812827 10096 tablet_service.cc:1511] Processing CreateTablet for tablet 34831254ce7143c8bf6fa684a958c7dc (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:39.849903 10025 tablet_service.cc:1511] Processing CreateTablet for tablet 2db964eeed76452cb3a8a969e5e2b32a (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:39.850777 10022 tablet_service.cc:1511] Processing CreateTablet for tablet d739126ade124f87a06c44ebdd114d8b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:39.852035 10022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d739126ade124f87a06c44ebdd114d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.852456 10029 tablet_service.cc:1511] Processing CreateTablet for tablet 9339757002c64268bb483f1a5bfe0ccf (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:39.852716 10028 tablet_service.cc:1511] Processing CreateTablet for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:39.826143 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab28ea212034df2acdf22eab1b39bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.853761 10029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9339757002c64268bb483f1a5bfe0ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.854120 10103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe760ac48e44c2d9fce1d214088eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.826817 10177 tablet_service.cc:1511] Processing CreateTablet for tablet d739126ade124f87a06c44ebdd114d8b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:39.854393 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db964eeed76452cb3a8a969e5e2b32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.823827 10026 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff24b1804914099b167420853598f48 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:39.830430 10175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9339757002c64268bb483f1a5bfe0ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.854967 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380d0cf74fa74de9b77a62b31da282f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.855567 10173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff24b1804914099b167420853598f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.856182 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d739126ade124f87a06c44ebdd114d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.856751 10105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff24b1804914099b167420853598f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.850006 10030 tablet_service.cc:1511] Processing CreateTablet for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:39.858273 10030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fa3c9e8a7a496eaa49ec78b5a92103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.858835 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d739126ade124f87a06c44ebdd114d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.830224 10098 tablet_service.cc:1511] Processing CreateTablet for tablet 778034d202c94f46bfe767ecaf503d1e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:39.832437 10102 tablet_service.cc:1511] Processing CreateTablet for tablet 2db964eeed76452cb3a8a969e5e2b32a (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:39.832449 10104 tablet_service.cc:1511] Processing CreateTablet for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:39.860643 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778034d202c94f46bfe767ecaf503d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.861284 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fa3c9e8a7a496eaa49ec78b5a92103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.861810 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8111eefbfbe3442e98fd2c9b054ee1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.864037 10096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34831254ce7143c8bf6fa684a958c7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.868148 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db964eeed76452cb3a8a969e5e2b32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.872116 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8111eefbfbe3442e98fd2c9b054ee1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.849903 10027 tablet_service.cc:1511] Processing CreateTablet for tablet 778034d202c94f46bfe767ecaf503d1e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:39.880128 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133523a809584dd5b44a19acf589801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.880543 10027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778034d202c94f46bfe767ecaf503d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.883565 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff24b1804914099b167420853598f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.884016 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db964eeed76452cb3a8a969e5e2b32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.888267 10231 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:39.897321 10174 tablet_service.cc:1511] Processing CreateTablet for tablet a31abbd8853749ac891b56f5989949b0 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:39.898669 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31abbd8853749ac891b56f5989949b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.934801 10231 tablet_bootstrap.cc:654] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.934479 10025 tablet_service.cc:1511] Processing CreateTablet for tablet a31abbd8853749ac891b56f5989949b0 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:39.935786 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31abbd8853749ac891b56f5989949b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.938870 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 085543d3b9b94f2d806b9cd16489951a (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:39.933048 10098 tablet_service.cc:1511] Processing CreateTablet for tablet 9339757002c64268bb483f1a5bfe0ccf (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:39.942489 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9339757002c64268bb483f1a5bfe0ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.945154 10028 tablet_service.cc:1511] Processing CreateTablet for tablet d1e1f2cc55034d12aba959a49530a6f8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:39.948014 10229 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:39.948513 10229 ts_tablet_manager.cc:1403] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.209s	user 0.009s	sys 0.002s
I20260709 13:15:39.940261 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085543d3b9b94f2d806b9cd16489951a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.941612 10230 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:39.951223 10230 ts_tablet_manager.cc:1403] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.219s	user 0.020s	sys 0.007s
I20260709 13:15:39.954398 10230 raft_consensus.cc:359] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:39.955161 10230 raft_consensus.cc:385] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.955444 10230 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.956346 10230 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:39.957520  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:39.958163 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e1f2cc55034d12aba959a49530a6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.942600 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 085543d3b9b94f2d806b9cd16489951a (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:39.972635 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085543d3b9b94f2d806b9cd16489951a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.977083 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:39.977921 10170 tablet_service.cc:1511] Processing CreateTablet for tablet d1e1f2cc55034d12aba959a49530a6f8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:39.978438 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8111eefbfbe3442e98fd2c9b054ee1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.979123 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e1f2cc55034d12aba959a49530a6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.985800 10026 tablet_service.cc:1511] Processing CreateTablet for tablet 230ae7ec0d4d46b88977591c29ce761b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:39.987138 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230ae7ec0d4d46b88977591c29ce761b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.951442 10229 raft_consensus.cc:359] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:39.996225 10229 raft_consensus.cc:385] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.996564 10229 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.997274 10229 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.002054 10105 tablet_service.cc:1511] Processing CreateTablet for tablet a31abbd8853749ac891b56f5989949b0 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:40.003695 10170 tablet_service.cc:1511] Processing CreateTablet for tablet 230ae7ec0d4d46b88977591c29ce761b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:40.006333 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230ae7ec0d4d46b88977591c29ce761b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.008098 10030 tablet_service.cc:1511] Processing CreateTablet for tablet d5b36c20170946939b59a55932ff2f8d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:40.005071 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 085543d3b9b94f2d806b9cd16489951a (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:40.009356 10030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b36c20170946939b59a55932ff2f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.023037 10140 heartbeater.cc:499] Master 127.8.186.254:36577 was elected leader, sending a full tablet report...
I20260709 13:15:40.021919 10230 ts_tablet_manager.cc:1434] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.070s	user 0.022s	sys 0.003s
I20260709 13:15:40.035079 10105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31abbd8853749ac891b56f5989949b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.039091 10104 tablet_service.cc:1511] Processing CreateTablet for tablet 230ae7ec0d4d46b88977591c29ce761b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:40.044538 10029 tablet_service.cc:1511] Processing CreateTablet for tablet 1a3203f1155b4e9f83bfcd5d6b9fb72d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:40.045869 10029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a3203f1155b4e9f83bfcd5d6b9fb72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.048576 10096 tablet_service.cc:1511] Processing CreateTablet for tablet d5b36c20170946939b59a55932ff2f8d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:40.051690 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 11d1d6b12e0b4e5b9006189784101119 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:40.057291 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d1d6b12e0b4e5b9006189784101119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.056986 10098 tablet_service.cc:1511] Processing CreateTablet for tablet d1e1f2cc55034d12aba959a49530a6f8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:40.060144 10102 tablet_service.cc:1511] Processing CreateTablet for tablet 11d1d6b12e0b4e5b9006189784101119 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:40.060772 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230ae7ec0d4d46b88977591c29ce761b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.037706 10229 ts_tablet_manager.cc:1434] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.089s	user 0.011s	sys 0.003s
I20260709 13:15:40.074682 10230 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:40.076828 10214 heartbeater.cc:499] Master 127.8.186.254:36577 was elected leader, sending a full tablet report...
I20260709 13:15:40.084637 10237 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.085191 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 1a3203f1155b4e9f83bfcd5d6b9fb72d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:40.085671 10178 tablet_service.cc:1511] Processing CreateTablet for tablet d5b36c20170946939b59a55932ff2f8d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:40.087637 10025 tablet_service.cc:1511] Processing CreateTablet for tablet a9fbf8d873bf4f76894423df3dee3e74 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:40.090246 10103 tablet_service.cc:1511] Processing CreateTablet for tablet a9fbf8d873bf4f76894423df3dee3e74 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:40.092067 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b36c20170946939b59a55932ff2f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.096117 10237 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.086855 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e1f2cc55034d12aba959a49530a6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.100631 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fbf8d873bf4f76894423df3dee3e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.102638 10103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fbf8d873bf4f76894423df3dee3e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.105211 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d1d6b12e0b4e5b9006189784101119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.107846 10229 tablet_bootstrap.cc:492] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:40.112094 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085543d3b9b94f2d806b9cd16489951a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.113334 10231 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:40.113871 10231 ts_tablet_manager.cc:1403] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.270s	user 0.010s	sys 0.009s
I20260709 13:15:40.116089 10096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b36c20170946939b59a55932ff2f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.120708 10237 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:40.124454 10027 tablet_service.cc:1511] Processing CreateTablet for tablet 2597dc9899784d6eb96b916d235dc5b2 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:40.125759 10027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2597dc9899784d6eb96b916d235dc5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.132025 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a3203f1155b4e9f83bfcd5d6b9fb72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.132791 10101 tablet_service.cc:1511] Processing CreateTablet for tablet 2597dc9899784d6eb96b916d235dc5b2 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:40.134382 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2597dc9899784d6eb96b916d235dc5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.138979 10065 heartbeater.cc:499] Master 127.8.186.254:36577 was elected leader, sending a full tablet report...
I20260709 13:15:40.141520 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 1a3203f1155b4e9f83bfcd5d6b9fb72d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:40.142982 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a3203f1155b4e9f83bfcd5d6b9fb72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.147707 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 11d1d6b12e0b4e5b9006189784101119 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:40.149173 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d1d6b12e0b4e5b9006189784101119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.151454 10028 tablet_service.cc:1511] Processing CreateTablet for tablet 32f89d2cf222427f9747123276de473f (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:40.152412 10230 tablet_bootstrap.cc:654] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.152755 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f89d2cf222427f9747123276de473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.162807 10174 tablet_service.cc:1511] Processing CreateTablet for tablet a9fbf8d873bf4f76894423df3dee3e74 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:40.163152 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 2597dc9899784d6eb96b916d235dc5b2 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:40.164376 10231 raft_consensus.cc:359] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.165112 10231 raft_consensus.cc:385] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.165413 10231 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.172703 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fbf8d873bf4f76894423df3dee3e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.173408 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2597dc9899784d6eb96b916d235dc5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.178275 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:40.180161 10155 leader_election.cc:343] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.172712 10229 tablet_bootstrap.cc:654] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.206995 10234 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.207554 10234 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.210865 10234 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:40.185873 10231 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.249012 10230 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:40.249563 10230 ts_tablet_manager.cc:1403] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.006s
I20260709 13:15:40.252584 10230 raft_consensus.cc:359] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.253880 10230 raft_consensus.cc:385] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.254240 10230 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.260219 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3c204de67641b8a897fd3a314bf8ea (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:40.266652 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 32f89d2cf222427f9747123276de473f (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:40.268071 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f89d2cf222427f9747123276de473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.268141 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:40.275177 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3c204de67641b8a897fd3a314bf8ea (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:40.276535 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3c204de67641b8a897fd3a314bf8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.280026 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 32f89d2cf222427f9747123276de473f (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:40.279919 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3c204de67641b8a897fd3a314bf8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.282052 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f89d2cf222427f9747123276de473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.255025 10230 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.285116 10115 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:40.294376 10231 ts_tablet_manager.cc:1434] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.180s	user 0.014s	sys 0.005s
I20260709 13:15:40.295452 10231 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:40.295310 10025 tablet_service.cc:1511] Processing CreateTablet for tablet 970bd90924ef4157a7c0b99fe31e7fcb (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:40.296880 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970bd90924ef4157a7c0b99fe31e7fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.297049 10230 ts_tablet_manager.cc:1434] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:15:40.298142 10230 tablet_bootstrap.cc:492] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:40.301735 10231 tablet_bootstrap.cc:654] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.323868 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 970bd90924ef4157a7c0b99fe31e7fcb (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:40.325269 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970bd90924ef4157a7c0b99fe31e7fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.338229 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:40.339636 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:40.340230 10078 leader_election.cc:343] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.341054 10246 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.341243 10081 leader_election.cc:343] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.341687 10081 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:40.341586 10246 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.342312 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:40.342492 10234 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.343487 10237 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.343886 10237 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.344201 10237 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.345861 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3c204de67641b8a897fd3a314bf8ea (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:40.351801 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3c204de67641b8a897fd3a314bf8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.362424 10237 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.358690 10246 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:40.366205 10230 tablet_bootstrap.cc:654] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.375018 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 970bd90924ef4157a7c0b99fe31e7fcb (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:40.376462 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970bd90924ef4157a7c0b99fe31e7fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.375072 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 050435abbd194f2ea45db6d7a8974831 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:40.378489 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050435abbd194f2ea45db6d7a8974831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.380182 10229 tablet_bootstrap.cc:492] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:40.382599 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:40.383540 10231 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
W20260709 13:15:40.384043 10155 leader_election.cc:343] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.384677 10229 ts_tablet_manager.cc:1403] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.304s	user 0.017s	sys 0.004s
I20260709 13:15:40.385545 10237 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:40.385337 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 050435abbd194f2ea45db6d7a8974831 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:40.384166 10231 ts_tablet_manager.cc:1403] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.013s
I20260709 13:15:40.386677 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050435abbd194f2ea45db6d7a8974831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.386719 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:40.387378 10115 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.387809 10229 raft_consensus.cc:359] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.392599 10026 tablet_service.cc:1511] Processing CreateTablet for tablet 63d5d93de0b049d0b905d6e491783021 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:40.393976 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d5d93de0b049d0b905d6e491783021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.394688 10098 tablet_service.cc:1511] Processing CreateTablet for tablet 63d5d93de0b049d0b905d6e491783021 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:40.395998 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d5d93de0b049d0b905d6e491783021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.398397 10029 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb1a4c54d724ebb8f354038db69e5a5 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:40.398697 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 63d5d93de0b049d0b905d6e491783021 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:40.399700 10029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb1a4c54d724ebb8f354038db69e5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.399811 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d5d93de0b049d0b905d6e491783021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.398422 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 050435abbd194f2ea45db6d7a8974831 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:40.402395 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050435abbd194f2ea45db6d7a8974831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.388528 10229 raft_consensus.cc:385] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.420082 10229 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.420877 10229 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.422981 10229 ts_tablet_manager.cc:1434] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.000s
I20260709 13:15:40.419592 10115 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:40.437932 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:40.438714 10237 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.438689 10230 tablet_bootstrap.cc:492] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:40.439255 10237 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:40.439814 10230 ts_tablet_manager.cc:1403] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.004s
I20260709 13:15:40.434640 10229 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:40.440426 10237 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.443969 10230 raft_consensus.cc:359] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:40.444144 10101 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb1a4c54d724ebb8f354038db69e5a5 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:40.444739 10230 raft_consensus.cc:385] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.445084 10230 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.445519 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb1a4c54d724ebb8f354038db69e5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.445819 10230 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:40.455508 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbda83574ee42f494a2a55e59683596 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:40.458088 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbda83574ee42f494a2a55e59683596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.424890 10231 raft_consensus.cc:359] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.460369 10231 raft_consensus.cc:385] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.460745 10231 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.460414 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbda83574ee42f494a2a55e59683596 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:40.462198 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbda83574ee42f494a2a55e59683596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.462428 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbda83574ee42f494a2a55e59683596 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:40.463723 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbda83574ee42f494a2a55e59683596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.465977 10231 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.468115 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:40.468850 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb1a4c54d724ebb8f354038db69e5a5 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:15:40.469544 10004 leader_election.cc:343] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.469755 10229 tablet_bootstrap.cc:654] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.470120 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb1a4c54d724ebb8f354038db69e5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.478495 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:40.479238 10230 ts_tablet_manager.cc:1434] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.005s
W20260709 13:15:40.480314 10003 leader_election.cc:343] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.481069 10003 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:40.484112 10246 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.476583 10231 ts_tablet_manager.cc:1434] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 13:15:40.481174 10230 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:40.495419 10025 tablet_service.cc:1511] Processing CreateTablet for tablet 342754e0259d4d1197a5da7433555a8b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:40.498941 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 342754e0259d4d1197a5da7433555a8b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:40.500294 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342754e0259d4d1197a5da7433555a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.502604 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342754e0259d4d1197a5da7433555a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.510273 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 2e34dad81aac43a1aac71ca8c862321d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:40.510850 10178 tablet_service.cc:1511] Processing CreateTablet for tablet 2e34dad81aac43a1aac71ca8c862321d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:40.511597 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e34dad81aac43a1aac71ca8c862321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.512133 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e34dad81aac43a1aac71ca8c862321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.512055 10028 tablet_service.cc:1511] Processing CreateTablet for tablet fefbaaae9f26463bb73383d72660a7a1 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:40.513362 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefbaaae9f26463bb73383d72660a7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.500429 10098 tablet_service.cc:1511] Processing CreateTablet for tablet 342754e0259d4d1197a5da7433555a8b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:40.526477 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342754e0259d4d1197a5da7433555a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.529172  9935 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.512122 10029 tablet_service.cc:1511] Processing CreateTablet for tablet 2e34dad81aac43a1aac71ca8c862321d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:40.537076 10231 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:40.538574 10229 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:40.539000 10229 ts_tablet_manager.cc:1403] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.012s
I20260709 13:15:40.536111 10230 tablet_bootstrap.cc:654] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.545791 10229 raft_consensus.cc:359] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.546779 10229 raft_consensus.cc:385] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.547068 10229 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.539682 10029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e34dad81aac43a1aac71ca8c862321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.548545 10229 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.550294 10100 tablet_service.cc:1511] Processing CreateTablet for tablet fefbaaae9f26463bb73383d72660a7a1 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:40.550897 10229 ts_tablet_manager.cc:1434] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:15:40.551522 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefbaaae9f26463bb73383d72660a7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.552062 10229 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:40.563388 10178 tablet_service.cc:1511] Processing CreateTablet for tablet fefbaaae9f26463bb73383d72660a7a1 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:40.564802 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefbaaae9f26463bb73383d72660a7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.571619 10229 tablet_bootstrap.cc:654] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.559948 10231 tablet_bootstrap.cc:654] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.575109 10028 tablet_service.cc:1511] Processing CreateTablet for tablet 366d253a473243de9090f7b03b1c955b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:40.577955 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d253a473243de9090f7b03b1c955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.580394 10030 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5bb7b33f6c4f0da898f288eb770258 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:40.582605 10030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bb7b33f6c4f0da898f288eb770258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.584561 10237 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.585088 10237 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.587216 10237 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:40.593535 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:40.594655 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:40.596037 10153 leader_election.cc:343] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:40.596843 10155 leader_election.cc:343] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.597262 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:40.598094 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5bb7b33f6c4f0da898f288eb770258 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:40.598439 10237 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.599417 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bb7b33f6c4f0da898f288eb770258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.602012 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5bb7b33f6c4f0da898f288eb770258 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:40.603299 10230 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:40.579191 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 366d253a473243de9090f7b03b1c955b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:40.610432 10230 ts_tablet_manager.cc:1403] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.000s
I20260709 13:15:40.611027 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d253a473243de9090f7b03b1c955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.611541 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 2398a1470b87449dab93ba045655ca29 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:40.612821 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2398a1470b87449dab93ba045655ca29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.613422 10230 raft_consensus.cc:359] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.614144 10230 raft_consensus.cc:385] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.614449 10230 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.615733 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bb7b33f6c4f0da898f288eb770258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.623998 10230 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.626643 10230 ts_tablet_manager.cc:1434] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:40.625102 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 366d253a473243de9090f7b03b1c955b (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:40.632469 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d253a473243de9090f7b03b1c955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.649590 10234 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.652386 10234 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.655272 10234 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:40.656239 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:40.656989 10040 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:40.658828 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:40.660703 10078 leader_election.cc:343] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.663630 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:40.665000 10234 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.665463 10234 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.665854 10234 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.668952 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 0be325f96e974db28d904978cd65157d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:40.670297 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be325f96e974db28d904978cd65157d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.670886 10098 tablet_service.cc:1511] Processing CreateTablet for tablet 2398a1470b87449dab93ba045655ca29 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:40.672676 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 0be325f96e974db28d904978cd65157d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:40.672676 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 0be325f96e974db28d904978cd65157d (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:40.673982 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be325f96e974db28d904978cd65157d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.674086 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be325f96e974db28d904978cd65157d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.665428 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 2398a1470b87449dab93ba045655ca29 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:40.676352 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2398a1470b87449dab93ba045655ca29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.676585 10025 tablet_service.cc:1511] Processing CreateTablet for tablet 49f43d8e966541cf899abeeacbe8ff29 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:40.677817 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f43d8e966541cf899abeeacbe8ff29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.680548 10230 tablet_bootstrap.cc:492] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:40.680441 10234 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.681880 10229 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:40.682370 10229 ts_tablet_manager.cc:1403] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.012s
I20260709 13:15:40.682531 10234 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:40.684219 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:40.686305 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:40.686040 10078 leader_election.cc:343] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.686699 10229 raft_consensus.cc:359] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.687918 10229 raft_consensus.cc:385] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.688235 10229 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.687776 10178 tablet_service.cc:1511] Processing CreateTablet for tablet 49f43d8e966541cf899abeeacbe8ff29 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:40.689635 10026 tablet_service.cc:1511] Processing CreateTablet for tablet c62c17c1a96045a9a7d8729d053776f8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:40.686883 10040 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.690887 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62c17c1a96045a9a7d8729d053776f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.691256 10176 tablet_service.cc:1511] Processing CreateTablet for tablet c62c17c1a96045a9a7d8729d053776f8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:40.691907 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 49f43d8e966541cf899abeeacbe8ff29 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:40.690164 10101 tablet_service.cc:1511] Processing CreateTablet for tablet c62c17c1a96045a9a7d8729d053776f8 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:40.695257 10231 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:40.690886 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f43d8e966541cf899abeeacbe8ff29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.696316 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62c17c1a96045a9a7d8729d053776f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.700042 10229 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.701380 10230 tablet_bootstrap.cc:654] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.702348 10229 ts_tablet_manager.cc:1434] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:15:40.703455 10229 tablet_bootstrap.cc:492] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:40.706640 10231 ts_tablet_manager.cc:1403] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.170s	user 0.038s	sys 0.016s
I20260709 13:15:40.707589 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2398a1470b87449dab93ba045655ca29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.709293 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62c17c1a96045a9a7d8729d053776f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.709702 10231 raft_consensus.cc:359] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.710404 10231 raft_consensus.cc:385] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.710685 10231 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.715008 10105 tablet_service.cc:1511] Processing CreateTablet for tablet 8352b62df8ae441f825cf2075b4f63cb (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:40.715938 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f43d8e966541cf899abeeacbe8ff29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.718174 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 8352b62df8ae441f825cf2075b4f63cb (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:40.719480 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8352b62df8ae441f825cf2075b4f63cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.721659 10103 tablet_service.cc:1511] Processing CreateTablet for tablet 63a2fe5619be481399904909f88ce441 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:40.722986 10103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a2fe5619be481399904909f88ce441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.726275 10170 tablet_service.cc:1511] Processing CreateTablet for tablet 63a2fe5619be481399904909f88ce441 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:40.727205 10027 tablet_service.cc:1511] Processing CreateTablet for tablet 63a2fe5619be481399904909f88ce441 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:40.728578 10027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a2fe5619be481399904909f88ce441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.732789 10022 tablet_service.cc:1511] Processing CreateTablet for tablet 6e77e3a0687c460f8d3f29e5194c49e9 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:40.734130 10022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e77e3a0687c460f8d3f29e5194c49e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.739473 10102 tablet_service.cc:1511] Processing CreateTablet for tablet 6e77e3a0687c460f8d3f29e5194c49e9 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:40.744889 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e77e3a0687c460f8d3f29e5194c49e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.745222 10096 tablet_service.cc:1511] Processing CreateTablet for tablet ffbced50ff05471aae6f2f593710055e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:40.746487 10096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbced50ff05471aae6f2f593710055e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.749070 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 6e77e3a0687c460f8d3f29e5194c49e9 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:40.749750 10176 tablet_service.cc:1511] Processing CreateTablet for tablet ffbced50ff05471aae6f2f593710055e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:40.753225 10040 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:40.754839 10231 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.758446 10023 tablet_service.cc:1511] Processing CreateTablet for tablet 400d1a1ff7f24369b1d869661f6a2640 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:40.759536 10246 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.759972 10105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8352b62df8ae441f825cf2075b4f63cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.761601 10231 ts_tablet_manager.cc:1434] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.004s
I20260709 13:15:40.760051 10246 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.764492 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:40.765718 10234 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.771482 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a2fe5619be481399904909f88ce441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.772256 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:40.773201 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:40.774829 10003 leader_election.cc:343] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.776064 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbced50ff05471aae6f2f593710055e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.754341 10029 tablet_service.cc:1511] Processing CreateTablet for tablet ffbced50ff05471aae6f2f593710055e (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:40.780969 10029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbced50ff05471aae6f2f593710055e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.762893 10229 tablet_bootstrap.cc:654] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.767547 10104 tablet_service.cc:1511] Processing CreateTablet for tablet 400d1a1ff7f24369b1d869661f6a2640 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:40.790669 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400d1a1ff7f24369b1d869661f6a2640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.792294 10028 tablet_service.cc:1511] Processing CreateTablet for tablet 8352b62df8ae441f825cf2075b4f63cb (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:40.793781 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400d1a1ff7f24369b1d869661f6a2640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.808229 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e77e3a0687c460f8d3f29e5194c49e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.813686 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 400d1a1ff7f24369b1d869661f6a2640 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:40.814985 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400d1a1ff7f24369b1d869661f6a2640. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:40.823994 10004 leader_election.cc:343] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.824592 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:40.825721 10247 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.824883 10028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8352b62df8ae441f825cf2075b4f63cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.788825 10246 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:40.789104 10231 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:40.824561 10026 tablet_service.cc:1511] Processing CreateTablet for tablet e127deec1bdf4a7883aec8a35942fb23 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 13:15:40.861123 10155 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:40.861780 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e127deec1bdf4a7883aec8a35942fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.843636 10234 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:40.864526 10234 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.870411 10178 tablet_service.cc:1511] Processing CreateTablet for tablet e127deec1bdf4a7883aec8a35942fb23 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:40.870784 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 10bea19d11e44342889595040e4d97bd (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:40.872001 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bea19d11e44342889595040e4d97bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.873366 10101 tablet_service.cc:1511] Processing CreateTablet for tablet e127deec1bdf4a7883aec8a35942fb23 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:40.874635 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e127deec1bdf4a7883aec8a35942fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.908188 10261 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.908741 10261 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:40.909700 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e127deec1bdf4a7883aec8a35942fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.910858 10261 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:40.896265 10096 tablet_service.cc:1511] Processing CreateTablet for tablet 10bea19d11e44342889595040e4d97bd (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:40.912683 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:40.912986 10096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bea19d11e44342889595040e4d97bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.914058 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:40.914072 10230 tablet_bootstrap.cc:492] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:40.922590 10230 ts_tablet_manager.cc:1403] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.249s	user 0.017s	sys 0.019s
I20260709 13:15:40.925993 10230 raft_consensus.cc:359] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.926805 10230 raft_consensus.cc:385] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.927119 10230 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
W20260709 13:15:40.921954 10081 leader_election.cc:343] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.927382 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 10bea19d11e44342889595040e4d97bd (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:15:40.928112 10078 leader_election.cc:343] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.930578 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:40.937063 10261 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.938473 10024 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:40.939047 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bea19d11e44342889595040e4d97bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.939548 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.936205 10231 tablet_bootstrap.cc:654] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.966778 10229 tablet_bootstrap.cc:492] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:40.967324 10229 ts_tablet_manager.cc:1403] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.264s	user 0.028s	sys 0.042s
W20260709 13:15:40.969389  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:40.970227 10229 raft_consensus.cc:359] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:40.953128 10230 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:40.970958 10025 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:40.970947 10229 raft_consensus.cc:385] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.975584 10229 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.975970 10025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.976454 10229 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:40.978753 10229 ts_tablet_manager.cc:1434] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:40.970990 10101 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:40.980285  9938 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.991276 10230 ts_tablet_manager.cc:1434] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:15:40.994679 10022 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5cf83b6b34444eb97230c9c7106ca4 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:40.999528 10022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5cf83b6b34444eb97230c9c7106ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.005848 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:41.006467 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.007210 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.008787 10104 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5cf83b6b34444eb97230c9c7106ca4 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:41.010074 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5cf83b6b34444eb97230c9c7106ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.013945 10237 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.020375 10230 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.020545 10231 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.021083 10231 ts_tablet_manager.cc:1403] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.245s	user 0.017s	sys 0.024s
I20260709 13:15:41.022778 10229 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.026327 10102 tablet_service.cc:1511] Processing CreateTablet for tablet b4a137ce092c4e1f93e053d05a21cb5c (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:41.027777 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a137ce092c4e1f93e053d05a21cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.028613 10024 tablet_service.cc:1511] Processing CreateTablet for tablet b4a137ce092c4e1f93e053d05a21cb5c (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:41.034866 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a137ce092c4e1f93e053d05a21cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.036290 10230 tablet_bootstrap.cc:654] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.066366 10264 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.066962 10264 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.069231 10264 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.070333 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.071084 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.071516 10231 raft_consensus.cc:359] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:41.071938 10078 leader_election.cc:343] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.064617 10237 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.072642 10081 leader_election.cc:343] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.072549 10237 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.073104 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:41.074597 10237 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.075079 10097 tablet_service.cc:1511] Processing CreateTablet for tablet f5f53253de3345159399b6816804e1e6 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:41.075551 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.073868 10264 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.076515 10024 tablet_service.cc:1511] Processing CreateTablet for tablet f5f53253de3345159399b6816804e1e6 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:41.077605 10024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53253de3345159399b6816804e1e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:41.061738 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71859.6us
I20260709 13:15:41.079929 10231 raft_consensus.cc:385] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.082633 10229 tablet_bootstrap.cc:654] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.080765 10231 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.084333 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.091904 10178 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:41.092049 10231 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.094503 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:41.095299 10040 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.096312 10230 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.096794 10230 ts_tablet_manager.cc:1403] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.022s
I20260709 13:15:41.097177 10155 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:41.097442 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5cf83b6b34444eb97230c9c7106ca4 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:41.098137 10268 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.083410 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53253de3345159399b6816804e1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.095041 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.094470 10231 ts_tablet_manager.cc:1434] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.001s
I20260709 13:15:41.098518 10268 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.102479 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.103704 10170 tablet_service.cc:1511] Processing CreateTablet for tablet b4a137ce092c4e1f93e053d05a21cb5c (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:41.107896 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a137ce092c4e1f93e053d05a21cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.108932 10237 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.109483 10237 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.101027 10268 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.112231 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5cf83b6b34444eb97230c9c7106ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.116622 10237 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.117434 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:41.118888 10155 leader_election.cc:343] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.127072 10268 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.129184 10268 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.130038 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.132447 10230 raft_consensus.cc:359] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.134114 10040 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.139789 10231 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.143610 10230 raft_consensus.cc:385] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.144028 10040 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:41.144528 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.144548 10230 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.145233 10115 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.145948 10155 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:41.147037 10268 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.146816 10230 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.145635 10231 tablet_bootstrap.cc:654] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.148305 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:41.149109 10230 ts_tablet_manager.cc:1434] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:15:41.150317 10230 tablet_bootstrap.cc:492] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
W20260709 13:15:41.150985 10153 leader_election.cc:343] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.153272 10231 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.153239 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:41.154008 10231 ts_tablet_manager.cc:1403] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:15:41.157495 10231 raft_consensus.cc:359] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.158344 10231 raft_consensus.cc:385] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.158660 10231 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.158948 10237 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.159430 10237 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.159611 10231 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.171770 10231 ts_tablet_manager.cc:1434] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:41.172271 10237 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.174284 10264 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.174871 10264 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.177233 10264 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.178992 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.179491 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.179843 10040 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
W20260709 13:15:41.181293 10078 leader_election.cc:343] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.184538 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:41.187438 10231 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.150318 10170 tablet_service.cc:1511] Processing CreateTablet for tablet f5f53253de3345159399b6816804e1e6 (DEFAULT_TABLE table=test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:41.187557 10264 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.189718 10230 tablet_bootstrap.cc:654] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.189635 10229 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.190595 10229 ts_tablet_manager.cc:1403] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.168s	user 0.007s	sys 0.007s
I20260709 13:15:41.190013 10264 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.191720 10264 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.193857 10229 raft_consensus.cc:359] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.194671 10229 raft_consensus.cc:385] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.194986 10229 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.197079 10229 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.199730 10229 ts_tablet_manager.cc:1434] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:41.149608 10268 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:41.200941 10229 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.203662 10264 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.189678 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53253de3345159399b6816804e1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.209772 10237 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:41.211766 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58585.3us
I20260709 13:15:41.201081 10268 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:41.213366 10153 leader_election.cc:343] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.214787 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.214932 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:41.215377 10040 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:41.216295 10078 leader_election.cc:343] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.216785 10264 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.220633 10274 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.221235 10274 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:41.223954 10231 tablet_bootstrap.cc:654] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.225389 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.229898 10237 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:15:41.230739 10155 leader_election.cc:343] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.225517 10040 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:41.225950 10274 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:41.226734 10230 tablet_bootstrap.cc:492] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.228513 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.233170 10230 ts_tablet_manager.cc:1403] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.004s
I20260709 13:15:41.233421 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:41.234679 10264 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.235167 10264 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:41.236514 10229 tablet_bootstrap.cc:654] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:41.233119 10155 leader_election.cc:343] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.236069 10264 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.236807 10230 raft_consensus.cc:359] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.238248 10230 raft_consensus.cc:385] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.238619 10230 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.239605 10230 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.242179 10230 ts_tablet_manager.cc:1434] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:15:41.248054 10230 tablet_bootstrap.cc:492] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.248713  9935 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.258249 10231 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.258970 10231 ts_tablet_manager.cc:1403] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.009s
I20260709 13:15:41.261385 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:41.262023 10114 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.262140 10231 raft_consensus.cc:359] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.262989 10231 raft_consensus.cc:385] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.263149 10274 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.263351 10231 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.263680 10274 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.264287 10231 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.264869  9938 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.265765 10274 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.266770 10231 ts_tablet_manager.cc:1434] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:15:41.267357 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.268142 10038 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:15:41.268209 10231 tablet_bootstrap.cc:492] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.271500 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.273247 10153 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.274511 10274 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.276737 10231 tablet_bootstrap.cc:654] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.277951 10230 tablet_bootstrap.cc:654] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.277665 10264 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.283715 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.284400 10115 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.285470 10114 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:41.292054 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:41.298877 10279 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.299350 10279 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.299710 10279 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.300061 10230 tablet_bootstrap.cc:492] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.300525 10230 ts_tablet_manager.cc:1403] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.006s
I20260709 13:15:41.301226 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:41.302198 10268 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.302714 10268 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:41.303071 10230 raft_consensus.cc:359] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.303771 10230 raft_consensus.cc:385] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.303501 10268 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.304064 10230 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.304774 10230 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.306792 10230 ts_tablet_manager.cc:1434] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:41.307638 10230 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.310539 10279 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:41.313309 10230 tablet_bootstrap.cc:654] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.313778 10231 tablet_bootstrap.cc:492] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.314255 10231 ts_tablet_manager.cc:1403] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.001s
I20260709 13:15:41.314170 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.313572 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:41.314947 10114 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:41.317168 10155 leader_election.cc:343] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.317348 10279 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:41.318074 10274 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.318348 10231 raft_consensus.cc:359] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.319288 10231 raft_consensus.cc:385] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.319589 10231 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.320547 10231 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.322938 10264 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.323416 10229 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.324026 10229 ts_tablet_manager.cc:1403] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.000s
I20260709 13:15:41.322980 10114 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:41.330888 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:41.331362 10229 raft_consensus.cc:359] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.332399 10274 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.332532 10229 raft_consensus.cc:385] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.332909 10229 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.332926 10274 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:41.333449 10231 ts_tablet_manager.cc:1434] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:15:41.333827 10229 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.333956 10274 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:41.334470 10231 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.339371 10229 ts_tablet_manager.cc:1434] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:15:41.340481 10229 tablet_bootstrap.cc:492] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.350322 10230 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.350801 10230 ts_tablet_manager.cc:1403] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.004s
I20260709 13:15:41.353374 10230 raft_consensus.cc:359] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.354187 10230 raft_consensus.cc:385] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.354430 10230 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.353494  9938 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.369494 10230 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.370858 10264 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.372054 10230 ts_tablet_manager.cc:1434] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:15:41.372130 10264 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.372987 10230 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.373004 10229 tablet_bootstrap.cc:654] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.376303 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.376966 10039 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:41.378297 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:41.379452 10230 tablet_bootstrap.cc:654] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.379591 10234 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.380060 10234 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.380414 10234 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.384088 10246 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.384565 10231 tablet_bootstrap.cc:654] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.387488 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:41.389102 10078 leader_election.cc:343] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.384603 10246 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.393802 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:15:41.395310 10004 leader_election.cc:343] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.395359 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:41.396886 10003 leader_election.cc:343] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.397351 10003 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.394109  9938 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.398528 10246 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.399067 10246 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.403862 10264 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.408839 10234 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.410351 10264 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.410904 10264 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.413090 10264 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.416100 10229 tablet_bootstrap.cc:492] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.416574 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:41.418088 10081 leader_election.cc:343] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.418536 10230 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.416605 10229 ts_tablet_manager.cc:1403] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.011s
I20260709 13:15:41.419034 10230 ts_tablet_manager.cc:1403] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.018s
I20260709 13:15:41.416590 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:41.420332 10078 leader_election.cc:343] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.420778 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:41.421844 10264 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.421677 10230 raft_consensus.cc:359] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.422371 10230 raft_consensus.cc:385] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.422673 10230 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.423669 10231 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.423353 10230 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.422098 10229 raft_consensus.cc:359] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.424130 10231 ts_tablet_manager.cc:1403] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.018s
I20260709 13:15:41.424214 10229 raft_consensus.cc:385] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.424500 10229 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.424587 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.424966 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:41.425208 10039 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:41.426242 10078 leader_election.cc:343] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.426587 10231 raft_consensus.cc:359] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.427225 10231 raft_consensus.cc:385] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.427471 10231 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.428110 10231 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.429473 10230 ts_tablet_manager.cc:1434] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:41.430087 10231 ts_tablet_manager.cc:1434] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:41.430547 10230 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.431461 10231 tablet_bootstrap.cc:492] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.425251 10229 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.435372 10229 ts_tablet_manager.cc:1434] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 13:15:41.436304 10229 tablet_bootstrap.cc:492] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.436949 10231 tablet_bootstrap.cc:654] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.437644 10234 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:15:41.440464 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 43615.4us
I20260709 13:15:41.441907 10229 tablet_bootstrap.cc:654] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.446328 10230 tablet_bootstrap.cc:654] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.447930 10231 tablet_bootstrap.cc:492] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.448396 10231 ts_tablet_manager.cc:1403] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 13:15:41.451144 10231 raft_consensus.cc:359] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:41.451961 10231 raft_consensus.cc:385] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.451941 10039 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:41.452419 10231 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.453173 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:41.453293 10231 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:41.454432 10234 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.454937 10234 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:41.455451 10231 ts_tablet_manager.cc:1434] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:41.456480 10231 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.456156 10234 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.464383 10229 tablet_bootstrap.cc:492] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.464934 10229 ts_tablet_manager.cc:1403] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.006s
I20260709 13:15:41.467121 10294 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.467841 10231 tablet_bootstrap.cc:654] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.467614 10294 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.469982 10230 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.470453 10230 ts_tablet_manager.cc:1403] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.004s
I20260709 13:15:41.471563  9938 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.473191 10230 raft_consensus.cc:359] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.473899 10230 raft_consensus.cc:385] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.474181 10230 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.474031 10229 raft_consensus.cc:359] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.474749 10229 raft_consensus.cc:385] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.474742 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.475189 10229 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.475040 10230 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.475924 10229 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.477640 10230 ts_tablet_manager.cc:1434] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:41.478143 10229 ts_tablet_manager.cc:1434] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:15:41.478680 10230 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.479164 10229 tablet_bootstrap.cc:492] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.485357 10230 tablet_bootstrap.cc:654] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.485467 10229 tablet_bootstrap.cc:654] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:41.485605 10004 leader_election.cc:343] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.500439 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:41.502271 10003 leader_election.cc:343] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.502743 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.503587 10294 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.504809 10294 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.506866 10230 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.508172 10230 ts_tablet_manager.cc:1403] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.005s
I20260709 13:15:41.511297 10230 raft_consensus.cc:359] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.512101 10230 raft_consensus.cc:385] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.512424 10230 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.513278 10230 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.515533 10229 tablet_bootstrap.cc:492] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.515964 10229 ts_tablet_manager.cc:1403] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.015s
I20260709 13:15:41.516592 10231 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.517040 10231 ts_tablet_manager.cc:1403] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.035s
I20260709 13:15:41.518316 10230 ts_tablet_manager.cc:1434] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:41.518260 10229 raft_consensus.cc:359] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.519008 10229 raft_consensus.cc:385] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.519327 10230 tablet_bootstrap.cc:492] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.519294 10229 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.519611 10231 raft_consensus.cc:359] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.520308 10231 raft_consensus.cc:385] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.520141 10229 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.520581 10231 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.521346 10231 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.526331 10229 ts_tablet_manager.cc:1434] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:41.527309 10229 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.533030 10229 tablet_bootstrap.cc:654] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.535629 10231 ts_tablet_manager.cc:1434] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:15:41.536640 10231 tablet_bootstrap.cc:492] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.538714 10230 tablet_bootstrap.cc:654] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.543012 10294 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.543584 10294 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:15:41.544603 10231 tablet_bootstrap.cc:654] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.545895 10294 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.547690 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.549896 10229 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.550516 10229 ts_tablet_manager.cc:1403] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 13:15:41.551450 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.552374 10114 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:41.553897 10229 raft_consensus.cc:359] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.554873 10229 raft_consensus.cc:385] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.555229 10229 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.556066 10229 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.553912 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.557951 10294 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.558547 10229 ts_tablet_manager.cc:1434] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:41.561955 10229 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.566218 10294 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.566706 10231 tablet_bootstrap.cc:492] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.567184 10231 ts_tablet_manager.cc:1403] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 13:15:41.567428 10229 tablet_bootstrap.cc:654] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.569691 10230 tablet_bootstrap.cc:492] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.569772 10231 raft_consensus.cc:359] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.570271 10230 ts_tablet_manager.cc:1403] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.020s
I20260709 13:15:41.570554 10231 raft_consensus.cc:385] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.570871 10231 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.571525 10231 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.573575 10231 ts_tablet_manager.cc:1434] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:15:41.574003 10230 raft_consensus.cc:359] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.574594 10230 raft_consensus.cc:385] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.574810 10230 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.575596 10231 tablet_bootstrap.cc:492] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.576352 10229 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.575554 10230 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.576792 10229 ts_tablet_manager.cc:1403] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:15:41.579464 10229 raft_consensus.cc:359] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.580137 10229 raft_consensus.cc:385] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.580407 10229 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.581017 10229 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.581678 10230 ts_tablet_manager.cc:1434] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:41.582260 10231 tablet_bootstrap.cc:654] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.582585 10230 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.582892 10229 ts_tablet_manager.cc:1434] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:15:41.583702 10229 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.588410 10230 tablet_bootstrap.cc:654] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.589138 10229 tablet_bootstrap.cc:654] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.590584 10274 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.591050 10274 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.593237 10274 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.595111 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.594988 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.596086 10039 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
W20260709 13:15:41.597074 10153 leader_election.cc:343] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.597698 10274 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.597640 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.598274 10274 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.598950 10279 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.599401 10279 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.599810 10279 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.602818 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.603520 10114 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.604866 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:41.605830 10268 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.606210 10268 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.606541 10268 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.604804 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:41.612954 10155 leader_election.cc:343] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.615267 10268 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.615872 10274 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.618356 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:41.619910 10155 leader_election.cc:343] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.622641 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:41.623265 10114 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.631664 10268 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.630537 10114 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:41.633313 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:41.634639 10268 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.635468 10234 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.635985 10234 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.637632 10230 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.638095 10230 ts_tablet_manager.cc:1403] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.006s
I20260709 13:15:41.639962 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.633684 10279 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:41.641383 10081 leader_election.cc:343] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.643539 10229 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.644006 10229 ts_tablet_manager.cc:1403] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.017s
I20260709 13:15:41.643844 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.644914 10189 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:41.645591 10279 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.640895 10230 raft_consensus.cc:359] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.646268 10230 raft_consensus.cc:385] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.646636 10230 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.647084 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:41.647390 10230 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.647907 10264 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.648205 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.648399 10264 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.648787 10039 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.649745 10230 ts_tablet_manager.cc:1434] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:41.646343 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:15:41.652220 10153 leader_election.cc:343] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.652773 10231 tablet_bootstrap.cc:492] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.648768 10264 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.653267 10231 ts_tablet_manager.cc:1403] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.078s	user 0.039s	sys 0.031s
I20260709 13:15:41.638033 10234 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.655941 10231 raft_consensus.cc:359] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.656697 10231 raft_consensus.cc:385] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.656960 10231 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.657087 10039 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:41.657639 10231 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.659284 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.659654 10231 ts_tablet_manager.cc:1434] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:41.661751 10231 tablet_bootstrap.cc:492] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.661890 10230 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.663774 10264 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.664573 10268 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:41.665338 10279 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.669325 10279 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:41.670151 10279 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.667229 10229 raft_consensus.cc:359] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.671212 10229 raft_consensus.cc:385] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.672801 10229 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.673537 10229 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.673825 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:41.674480 10189 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.675158 10229 ts_tablet_manager.cc:1434] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:15:41.672056 10268 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.675993 10229 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.667867 10230 tablet_bootstrap.cc:654] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.667932 10231 tablet_bootstrap.cc:654] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.670506 10264 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.682161 10229 tablet_bootstrap.cc:654] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.689961 10189 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:41.691231 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:41.691628 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.692292 10039 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.692181 10264 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.693653 10264 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:41.694504 10264 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.695371 10229 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.695960 10229 ts_tablet_manager.cc:1403] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:15:41.698637 10229 raft_consensus.cc:359] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.699539 10229 raft_consensus.cc:385] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.699855 10229 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.700340  9937 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.702570 10230 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.703068 10230 ts_tablet_manager.cc:1403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.002s
I20260709 13:15:41.705997 10230 raft_consensus.cc:359] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.706700 10230 raft_consensus.cc:385] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.706984 10230 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.709210 10230 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.709836 10234 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.711313 10039 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:41.712821 10231 tablet_bootstrap.cc:492] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:41.713359 10231 ts_tablet_manager.cc:1403] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.018s
I20260709 13:15:41.713717 10230 ts_tablet_manager.cc:1434] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:41.714766 10230 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.716265 10231 raft_consensus.cc:359] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.717015 10231 raft_consensus.cc:385] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.717331 10231 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.718165 10231 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.700686 10229 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.719255  9937 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.721076 10229 ts_tablet_manager.cc:1434] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:15:41.722011 10229 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:41.723067 10230 tablet_bootstrap.cc:654] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.726358 10268 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.729081 10229 tablet_bootstrap.cc:654] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.728969 10274 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:41.737109 10153 consensus_peers.cc:597] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.744563 10230 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.745074 10230 ts_tablet_manager.cc:1403] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:15:41.745718  9935 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.747668 10230 raft_consensus.cc:359] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.748353 10230 raft_consensus.cc:385] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.748634 10230 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.748734 10294 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.749297 10230 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.749402 10294 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.751731 10230 ts_tablet_manager.cc:1434] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:41.752791 10230 tablet_bootstrap.cc:492] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:41.753351 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.754639 10264 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.755354 10294 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.755120 10264 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.757337 10264 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.758714 10230 tablet_bootstrap.cc:654] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.759995 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.762216 10038 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:41.762363 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.763038 10189 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:41.763566 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:41.764444 10264 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.764850 10264 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.765218 10264 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.764626 10231 ts_tablet_manager.cc:1434] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:15:41.770515 10274 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.770845 10279 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.782871 10231 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:41.788993 10264 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.792380 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:41.793123 10037 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.795568 10279 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.796188 10279 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.798542 10279 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.802640 10188 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.803613 10264 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.809921 10268 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.810518 10268 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.816248 10268 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.814082 10274 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.817312 10274 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.817644 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.818409 10113 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.819730 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:41.815582 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.825752 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.819486 10274 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.828521 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:41.829250 10187 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.829674 10003 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.820140 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.839488 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.841015 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:41.841993 10036 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.840229 10038 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:41.843731 10040 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:15:41.844901 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:41.850188 10264 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.850749 10264 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.852591 10037 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:41.852910 10264 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.854055 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:41.856109 10264 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.856662 10264 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:41.857573 10264 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.861286 10231 tablet_bootstrap.cc:654] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.861750 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:41.863318 10081 leader_election.cc:343] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.864794 10187 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:41.866431 10319 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:41.868256 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 48629.9us
I20260709 13:15:41.868772 10325 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.869292 10325 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.869661 10325 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.870889 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:41.873646 10326 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.876878 10279 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.880280 10279 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.880699 10279 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.902756 10261 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.884346 10319 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.903317 10261 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.913965 10234 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.914546 10229 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:41.915014 10229 ts_tablet_manager.cc:1403] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.193s	user 0.028s	sys 0.023s
I20260709 13:15:41.916739 10189 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.914013 10040 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.934456 10261 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:41.935138 10237 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.935671 10237 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.937988 10237 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:41.940107 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:41.881017 10326 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.952013 10230 tablet_bootstrap.cc:492] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:41.952617 10230 ts_tablet_manager.cc:1403] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.200s	user 0.044s	sys 0.093s
I20260709 13:15:41.953285 10229 raft_consensus.cc:359] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.954027 10229 raft_consensus.cc:385] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.954329 10229 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.958541 10229 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.968793 10229 ts_tablet_manager.cc:1434] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:15:41.928004 10319 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:41.971349 10264 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.995069 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:41.983557 10078 leader_election.cc:343] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.992547 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:42.002833 10081 leader_election.cc:343] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.993319 10153 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:41.999773 10039 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.011199 10229 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
W20260709 13:15:42.014297  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:41.997507 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:42.024895 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.031525 10234 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.036439  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:42.060638 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70909.1us
W20260709 13:15:42.061647 10153 leader_election.cc:343] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.993197 10264 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.067902 10332 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:42.075363 10325 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.078465 10326 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:42.114917 10231 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
W20260709 13:15:42.171540 10330 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:15:42.185297 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.185591 10231 ts_tablet_manager.cc:1403] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.403s	user 0.044s	sys 0.039s
I20260709 13:15:42.173625 10325 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:42.172341 10264 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.176364 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.188108 10231 raft_consensus.cc:359] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.171452 10333 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.191419 10231 raft_consensus.cc:385] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.184046 10319 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.191927 10231 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.192726 10279 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.194128 10319 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.194602 10319 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.195295 10279 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:42.192838 10231 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.197283 10231 ts_tablet_manager.cc:1434] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:42.185123 10230 raft_consensus.cc:359] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.197993 10230 raft_consensus.cc:385] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.198290 10231 tablet_bootstrap.cc:492] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:42.199719 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.200505 10112 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:42.198302 10230 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.202559 10230 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.191687 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.115345 10261 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.208496 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.220366 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:42.221658 10231 tablet_bootstrap.cc:654] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.222157 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.224103 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.224789 10040 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:42.227968 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:42.228685 10040 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.231117 10231 tablet_bootstrap.cc:492] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:42.231631 10231 ts_tablet_manager.cc:1403] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 13:15:42.234194 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:42.234269 10231 raft_consensus.cc:359] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.234932 10115 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.236580 10040 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:42.237432 10319 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:15:42.238003 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 255994us
I20260709 13:15:42.241230 10039 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.234978 10231 raft_consensus.cc:385] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.245751 10231 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.244007 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.244563 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:42.244971 10230 ts_tablet_manager.cc:1434] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.292s	user 0.006s	sys 0.012s
I20260709 13:15:42.248315 10230 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.247983 10231 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.244027 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:42.252804 10333 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.255798 10231 ts_tablet_manager.cc:1434] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:15:42.257298 10231 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
W20260709 13:15:42.253682 10081 leader_election.cc:343] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.252805 10334 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:42.255452 10333 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.260561 10333 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.264304 10110 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:42.258004 10040 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.268404 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.256939 10279 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:42.270820 10153 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:42.208444 10261 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.279901 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:42.280405 10326 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.264304 10115 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:42.280882 10325 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:42.289548 10078 leader_election.cc:343] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.374029 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:15:42.374964 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 85477.2us
I20260709 13:15:42.276984 10334 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.365815 10261 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.307186 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:42.374895 10153 leader_election.cc:343] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.382834 10230 tablet_bootstrap.cc:654] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.377978 10264 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.378821 10325 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:42.376890 10333 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.394039 10333 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:42.397073 10336 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.397948 10040 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:42.379329 10234 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:15:42.389274 10078 leader_election.cc:343] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.399008 10231 tablet_bootstrap.cc:654] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.401665 10229 tablet_bootstrap.cc:654] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.380548 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:15:42.403092 10081 leader_election.cc:343] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.380189 10334 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:42.404505 10153 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.407630 10319 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.401476 10326 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.398160 10325 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.413340 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:42.413986 10115 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.403941 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:42.423079 10261 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.422394 10115 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
W20260709 13:15:42.425343 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47942.2us
I20260709 13:15:42.433972 10334 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.433487 10234 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.434973 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:42.427102 10326 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.443261 10319 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.443150 10334 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.443529 10326 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.445379 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:42.445648 10326 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:42.447347 10279 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.447818 10279 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:42.448648 10279 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.451285 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:42.451272 10324 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.452070 10036 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.440791 10234 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.455829 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.459607 10234 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.463973 10230 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:42.475163 10230 ts_tablet_manager.cc:1403] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.227s	user 0.018s	sys 0.009s
I20260709 13:15:42.470626 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.472102 10036 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
W20260709 13:15:42.470211 10155 leader_election.cc:343] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.491032 10231 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:42.491699 10319 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.494791 10231 ts_tablet_manager.cc:1403] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.238s	user 0.007s	sys 0.018s
I20260709 13:15:42.466645 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:42.492237 10319 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.498497 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.498724 10319 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.505242 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.505455 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:42.517380 10003 leader_election.cc:343] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.518291 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.518923 10036 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:42.507287 10279 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.538872 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.541752 10231 raft_consensus.cc:359] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.542482 10231 raft_consensus.cc:385] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.542784 10231 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
W20260709 13:15:42.543078 10081 leader_election.cc:343] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.547446 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:42.548792 10279 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:42.549825 10234 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.549757 10279 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.550241 10234 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.550686 10234 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.550484 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.543465 10231 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.557725 10231 ts_tablet_manager.cc:1434] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:15:42.558930 10230 raft_consensus.cc:359] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.559800 10230 raft_consensus.cc:385] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.560070 10230 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.559968 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.560916 10230 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.563937 10230 ts_tablet_manager.cc:1434] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 13:15:42.564967 10230 tablet_bootstrap.cc:492] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.558928 10231 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:42.505295 10344 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
W20260709 13:15:42.574738 10153 leader_election.cc:343] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.575196 10153 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:15:42.567924 10078 leader_election.cc:343] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.578661 10229 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:42.579200 10229 ts_tablet_manager.cc:1403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.568s	user 0.033s	sys 0.040s
I20260709 13:15:42.572896 10234 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.580130 10078 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:15:42.582046 10078 leader_election.cc:343] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.582445 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:42.584434 10344 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.584791 10264 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:42.585455 10078 leader_election.cc:343] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.580253 10326 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.597826 10113 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:15:42.598408 10229 raft_consensus.cc:359] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.599114 10229 raft_consensus.cc:385] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.599335 10229 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.600996 10234 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.601243 10229 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.603356 10229 ts_tablet_manager.cc:1434] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:15:42.603648 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:42.606559 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:42.607057 10229 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:42.607543 10319 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.608662 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:42.617244 10230 tablet_bootstrap.cc:654] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.612203  9935 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.636420 10319 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:42.657079 10352 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:15:42.658632 10039 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:42.750701 10230 tablet_bootstrap.cc:492] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:42.751791 10230 ts_tablet_manager.cc:1403] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.187s	user 0.030s	sys 0.020s
I20260709 13:15:42.754406 10230 raft_consensus.cc:359] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.755060 10230 raft_consensus.cc:385] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.755321 10230 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.756029 10230 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.757712 10230 ts_tablet_manager.cc:1434] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:42.758682 10230 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.664003 10264 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.100s
I20260709 13:15:42.764696 10230 tablet_bootstrap.cc:654] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.767912 10231 tablet_bootstrap.cc:654] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:42.706769 10078 leader_election.cc:343] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.774289 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:15:42.775035 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70900.6us
I20260709 13:15:42.776700 10234 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.777163 10234 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:42.778051 10230 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:42.777977 10234 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.778575 10230 ts_tablet_manager.cc:1403] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:15:42.781385 10230 raft_consensus.cc:359] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.782662 10230 raft_consensus.cc:385] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.790385 10230 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.791181 10230 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.793311 10230 ts_tablet_manager.cc:1434] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:15:42.794230 10230 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.799708 10230 tablet_bootstrap.cc:654] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.799041  9935 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.805931  9935 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.810837 10230 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:42.811316 10230 ts_tablet_manager.cc:1403] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:15:42.813805 10230 raft_consensus.cc:359] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.814450 10230 raft_consensus.cc:385] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.814699 10230 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.815284 10230 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.818249 10230 ts_tablet_manager.cc:1434] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:42.821440 10230 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.827512 10230 tablet_bootstrap.cc:654] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.828847 10229 tablet_bootstrap.cc:654] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.840469 10319 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.841068 10319 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.843919 10319 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.844573 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:42.845427 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:42.846207 10004 leader_election.cc:343] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:42.847018 10003 leader_election.cc:343] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.847425 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:42.848734 10319 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.851130  9938 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.858047 10231 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:42.858213 10230 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:42.858829 10230 ts_tablet_manager.cc:1403] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.015s
I20260709 13:15:42.860242 10229 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:42.860661 10229 ts_tablet_manager.cc:1403] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.000s
I20260709 13:15:42.861464 10230 raft_consensus.cc:359] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.862095 10230 raft_consensus.cc:385] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.862352 10230 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.863005 10229 raft_consensus.cc:359] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.863142 10230 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.863655 10229 raft_consensus.cc:385] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.863937 10336 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.858827 10231 ts_tablet_manager.cc:1403] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.300s	user 0.008s	sys 0.012s
I20260709 13:15:42.864521 10336 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.863965 10229 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.866586 10229 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.869227 10229 ts_tablet_manager.cc:1434] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:42.871054 10230 ts_tablet_manager.cc:1434] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:42.871418 10229 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:42.871662 10336 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.872116 10230 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.870106 10231 raft_consensus.cc:359] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.877976 10230 tablet_bootstrap.cc:654] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.877957 10231 raft_consensus.cc:385] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.871243 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.869311 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.878360 10231 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
W20260709 13:15:42.880175 10078 leader_election.cc:343] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:42.880643 10081 leader_election.cc:343] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.881063 10081 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:42.881773 10336 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.886399 10229 tablet_bootstrap.cc:654] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.887933 10231 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.890261 10231 ts_tablet_manager.cc:1434] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.003s
I20260709 13:15:42.893575 10231 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:42.898811 10231 tablet_bootstrap.cc:654] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.904611 10229 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:42.905095 10229 ts_tablet_manager.cc:1403] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:15:42.907938 10229 raft_consensus.cc:359] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.908687 10229 raft_consensus.cc:385] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.908936 10229 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.909680 10229 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.911751 10229 ts_tablet_manager.cc:1434] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:42.912722 10229 tablet_bootstrap.cc:492] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:42.920719 10229 tablet_bootstrap.cc:654] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.921622 10230 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:42.922083 10230 ts_tablet_manager.cc:1403] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.011s
I20260709 13:15:42.924530 10230 raft_consensus.cc:359] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.925154 10230 raft_consensus.cc:385] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.925352 10231 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:42.925408 10230 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.925877 10231 ts_tablet_manager.cc:1403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.025s
I20260709 13:15:42.926177 10230 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.927713 10230 ts_tablet_manager.cc:1434] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:15:42.928148 10231 raft_consensus.cc:359] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.928784 10231 raft_consensus.cc:385] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.928967 10230 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:42.929035 10231 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.929749 10231 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.931305 10231 ts_tablet_manager.cc:1434] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:15:42.932456 10231 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:42.937676 10231 tablet_bootstrap.cc:654] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.937934 10325 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.942505 10336 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.943084 10230 tablet_bootstrap.cc:654] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.950533 10115 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.951048 10358 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.943044 10336 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.956924 10336 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.958977 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.959995 10358 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.960739 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.961305 10035 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:42.962502 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:42.963290 10344 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.963610 10344 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.964267 10344 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:42.967921 10078 leader_election.cc:343] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.974344 10279 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.976889 10336 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.977661 10234 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.977394 10336 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.978140 10234 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.980124 10234 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.980293 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.981015 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:42.981648 10040 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:42.983091 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:42.983112 10336 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.983916 10234 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.989723 10234 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.990121 10234 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.984089 10229 tablet_bootstrap.cc:492] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:42.984591 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.991845 10186 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:42.985025 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:42.985903 10344 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.986812 10358 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.994606 10344 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:42.995311 10229 ts_tablet_manager.cc:1403] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.000s
I20260709 13:15:42.996474 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:42.997051 10038 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.998945 10078 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:42.998349 10229 raft_consensus.cc:359] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:42.999625 10229 raft_consensus.cc:385] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.999918 10229 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.000247 10344 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.000646 10229 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.003110 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:15:43.005012 10078 leader_election.cc:343] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.007537 10234 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.008486 10038 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:43.010892 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:43.011632 10185 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.010895 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:43.013067 10040 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.013983 10358 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.014503 10358 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.017596 10358 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.018230 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:15:43.019771 10153 leader_election.cc:343] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.022882 10040 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:43.012928 10229 ts_tablet_manager.cc:1434] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:43.028616 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:43.029451 10344 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.029965 10344 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:43.030808 10344 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.032421 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:43.035897 10155 leader_election.cc:343] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.036238 10229 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.036635 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.037626 10358 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.040473 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.041359 10334 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.041808 10334 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:43.043459 10334 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.044466 10230 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.045269 10230 ts_tablet_manager.cc:1403] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.020s
I20260709 13:15:43.041910 10185 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:43.043457 10231 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.049403 10231 ts_tablet_manager.cc:1403] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.012s
I20260709 13:15:43.052016 10333 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.052505 10333 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.054051 10231 raft_consensus.cc:359] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.054570 10333 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:15:43.054674  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:43.054976 10231 raft_consensus.cc:385] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.055401  9937 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.056501 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.057163 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:43.058343 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:43.055384 10231 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.059309 10231 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.060376 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.060981 10115 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:43.061904 10231 ts_tablet_manager.cc:1434] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:15:43.062937 10231 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.064291 10279 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.064653 10279 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.064982 10279 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.056041 10230 raft_consensus.cc:359] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.065902 10230 raft_consensus.cc:385] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.066298 10230 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.067830 10230 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.069149 10324 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.072083 10324 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.075151 10324 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.065876 10234 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.080472 10231 tablet_bootstrap.cc:654] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.080467 10229 tablet_bootstrap.cc:654] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.081032 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.082233 10113 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:43.082912 10234 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.083458 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:43.084424 10325 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.084818 10325 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.085132 10325 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.084234 10234 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.086244 10230 ts_tablet_manager.cc:1434] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:15:43.087406 10230 tablet_bootstrap.cc:492] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.096446 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:43.113445 10155 leader_election.cc:343] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.110397 10325 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.112254  9938 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.118615 10332 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.119556 10230 tablet_bootstrap.cc:654] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.124797 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:43.125468 10115 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.125552 10279 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.129895 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.130091 10325 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.130788 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:43.131351 10114 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.133716 10234 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.137068 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:43.133683 10279 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.143306 10229 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.144090 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:43.144563 10155 leader_election.cc:343] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.145169 10229 ts_tablet_manager.cc:1403] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.005s
I20260709 13:15:43.145504 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.147086 10234 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.149078 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:43.149680 10038 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.149948 10114 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:43.149680 10115 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:43.151177 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:43.152752 10325 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.152743 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:43.153432 10325 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:43.154531 10319 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.154346 10325 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.154976 10319 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.155551 10115 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.159623 10229 raft_consensus.cc:359] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.160393 10229 raft_consensus.cc:385] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.160645 10229 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.161517 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:43.163727 10003 leader_election.cc:343] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.164032 10229 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.159556 10038 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:43.157119 10319 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.167639 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.168375 10114 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:43.168867 10231 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.168867 10279 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.169327 10231 ts_tablet_manager.cc:1403] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.007s
I20260709 13:15:43.169494 10230 tablet_bootstrap.cc:492] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.169955 10230 ts_tablet_manager.cc:1403] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.000s
I20260709 13:15:43.170430 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.171190 10319 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.171538 10319 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.171881 10319 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.172418 10230 raft_consensus.cc:359] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.173074 10230 raft_consensus.cc:385] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.173311 10230 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.173559 10231 raft_consensus.cc:359] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.174227 10231 raft_consensus.cc:385] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.173924 10230 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.174505 10231 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.175192 10231 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.176256 10230 ts_tablet_manager.cc:1434] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:43.175195 10229 ts_tablet_manager.cc:1434] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:15:43.177250 10230 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.177290 10229 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.183858 10230 tablet_bootstrap.cc:654] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.186877  9937 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.189863 10279 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:43.190973 10279 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.180143 10319 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.196178 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:43.196951 10114 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.205215 10229 tablet_bootstrap.cc:654] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.211329 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:15:43.212867 10003 leader_election.cc:343] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.213423 10234 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.213445 10319 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.214125 10234 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.215124 10114 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:43.216908 10234 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.217100 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.218276 10319 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.218400 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.218734 10319 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:43.221033 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.221237 10231 ts_tablet_manager.cc:1434] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.052s	user 0.020s	sys 0.021s
I20260709 13:15:43.222250 10231 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
W20260709 13:15:43.222658 10081 leader_election.cc:343] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.224159 10078 leader_election.cc:343] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.224577 10078 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.226052 10334 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.227973 10231 tablet_bootstrap.cc:654] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.219532 10319 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.233028 10230 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.233716 10230 ts_tablet_manager.cc:1403] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.017s
I20260709 13:15:43.236374 10325 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.236904 10325 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.238917 10325 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.241215 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.241626 10230 raft_consensus.cc:359] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.242280 10230 raft_consensus.cc:385] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.242538 10230 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
W20260709 13:15:43.242878 10155 leader_election.cc:343] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.243283 10230 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.244987 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:15:43.247375 10153 leader_election.cc:343] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.247818 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.248960 10325 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.251359 10230 ts_tablet_manager.cc:1434] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:15:43.252424 10230 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.256263 10319 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.256791 10319 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.259824 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.260573 10114 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:43.260695 10230 tablet_bootstrap.cc:654] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.261234 10229 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.261686 10229 ts_tablet_manager.cc:1403] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.013s
I20260709 13:15:43.262811 10319 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.263957 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.264320 10229 raft_consensus.cc:359] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.265010 10229 raft_consensus.cc:385] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.265273 10229 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.265741 10003 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.266094 10229 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.266667 10319 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.268397 10229 ts_tablet_manager.cc:1434] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:15:43.269229 10231 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.269338 10229 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.269821 10231 ts_tablet_manager.cc:1403] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.009s
I20260709 13:15:43.278573 10334 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.279242 10334 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.295261  9938 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.299715  9935 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.303627 10234 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.304208 10234 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.307289 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:43.308929 10081 leader_election.cc:343] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.322844 10114 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.337844 10334 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.339562 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.340253 10231 raft_consensus.cc:359] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.340925 10231 raft_consensus.cc:385] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.341193 10231 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.341929 10231 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.343835 10234 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.344662 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.345263 10319 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.346269 10229 tablet_bootstrap.cc:654] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:43.341136 10078 leader_election.cc:343] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.352630 10081 leader_election.cc:343] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.353569 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.355046 10231 ts_tablet_manager.cc:1434] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.085s	user 0.014s	sys 0.001s
I20260709 13:15:43.355149 10344 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.355852 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.356127 10231 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
W20260709 13:15:43.357445 10078 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:43.358068 10078 leader_election.cc:343] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.358461 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.359149 10344 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.362071 10344 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.365175 10230 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.365612 10230 ts_tablet_manager.cc:1403] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.017s
I20260709 13:15:43.368196 10230 raft_consensus.cc:359] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.368853 10230 raft_consensus.cc:385] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.369110 10230 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.372517 10230 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.379169 10229 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.379465 10230 ts_tablet_manager.cc:1434] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:15:43.379649 10229 ts_tablet_manager.cc:1403] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.000s
I20260709 13:15:43.380398 10230 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.382282 10229 raft_consensus.cc:359] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.382954 10229 raft_consensus.cc:385] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.383224 10229 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.377318 10231 tablet_bootstrap.cc:654] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.402098 10230 tablet_bootstrap.cc:654] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.402738 10229 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.404937 10229 ts_tablet_manager.cc:1434] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:15:43.405900 10229 tablet_bootstrap.cc:492] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.416462 10231 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.417012 10231 ts_tablet_manager.cc:1403] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.004s
I20260709 13:15:43.418437 10229 tablet_bootstrap.cc:654] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.419478 10231 raft_consensus.cc:359] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.420208 10231 raft_consensus.cc:385] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.420934 10231 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.421660 10231 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.423843 10231 ts_tablet_manager.cc:1434] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:43.426267 10231 tablet_bootstrap.cc:492] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.430387 10229 tablet_bootstrap.cc:492] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.430956 10229 ts_tablet_manager.cc:1403] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:15:43.432456 10231 tablet_bootstrap.cc:654] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.433727 10229 raft_consensus.cc:359] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.434578 10229 raft_consensus.cc:385] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.434906 10229 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.435801 10229 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.440361 10229 ts_tablet_manager.cc:1434] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:43.441429 10229 tablet_bootstrap.cc:492] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.443089 10319 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.443580 10319 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.445695 10319 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.447902 10229 tablet_bootstrap.cc:654] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.447434 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.453990 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.454715 10114 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
W20260709 13:15:43.455657 10003 leader_election.cc:343] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.458384 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.459282 10319 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.459632 10319 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.460085 10319 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.461009 10336 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.463423 10279 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.463940 10279 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.465974 10279 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.468171 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:43.469969 10155 leader_election.cc:343] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.467247 10319 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.472879 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.473531 10114 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:43.474792 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:43.475658 10332 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.476061 10332 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.476402 10332 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.486872 10332 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.493265 10230 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.493834 10230 ts_tablet_manager.cc:1403] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.114s	user 0.026s	sys 0.016s
I20260709 13:15:43.494678 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:43.495296 10114 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.495699 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:43.496305 10115 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.496397 10230 raft_consensus.cc:359] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.497071 10230 raft_consensus.cc:385] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.497336 10230 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.497910 10230 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.498687 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:43.500239 10230 ts_tablet_manager.cc:1434] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:15:43.501425 10230 tablet_bootstrap.cc:492] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.502453 10334 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:43.506879 10155 leader_election.cc:343] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.511350 10319 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.512387 10231 tablet_bootstrap.cc:492] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.512470 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:43.513648 10231 ts_tablet_manager.cc:1403] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.088s	user 0.022s	sys 0.015s
W20260709 13:15:43.514544 10003 leader_election.cc:343] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.515372 10114 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:43.516575 10231 raft_consensus.cc:359] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.517362 10231 raft_consensus.cc:385] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.517623 10231 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.512790 10332 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.519179 10230 tablet_bootstrap.cc:654] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.519078 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.519461 10231 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.521786 10231 ts_tablet_manager.cc:1434] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:15:43.522750 10319 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.523289 10332 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.524120 10332 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.523306 10319 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:43.533762 10319 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.530733 10230 tablet_bootstrap.cc:492] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.535527 10230 ts_tablet_manager.cc:1403] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.006s
I20260709 13:15:43.537082 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.538254 10115 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:43.531116 10229 tablet_bootstrap.cc:492] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.529570 10231 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.539171 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.539963 10114 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:15:43.541380 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:43.543305 10229 ts_tablet_manager.cc:1403] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.006s
I20260709 13:15:43.534484 10332 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.545524 10231 tablet_bootstrap.cc:654] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.538103 10230 raft_consensus.cc:359] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.545886 10230 raft_consensus.cc:385] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.546177 10230 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.543249 10279 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.546742 10279 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:43.546885 10230 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.542547 10153 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.547855 10388 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.547601 10279 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.548636 10388 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.549695 10230 ts_tablet_manager.cc:1434] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 13:15:43.550678 10230 tablet_bootstrap.cc:492] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.550808 10388 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.551956 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.552582 10185 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:43.553723 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.553923 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:43.554368 10114 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:43.555601 10388 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.556049 10388 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.556216 10325 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.560794 10388 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.556528 10229 raft_consensus.cc:359] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.562230 10229 raft_consensus.cc:385] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.562508 10229 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.563180 10229 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.565248 10229 ts_tablet_manager.cc:1434] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:15:43.566138 10229 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.569952 10325 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.570118 10388 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.572611 10388 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.559584 10230 tablet_bootstrap.cc:654] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.573668 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:43.574254 10185 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.573339 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:43.574750 10114 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.582195 10229 tablet_bootstrap.cc:654] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.586414 10114 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:43.591377 10185 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:43.592945 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:43.594323 10388 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.598551 10230 tablet_bootstrap.cc:492] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.599778 10230 ts_tablet_manager.cc:1403] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.001s
I20260709 13:15:43.601202 10229 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.601550 10229 ts_tablet_manager.cc:1403] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:15:43.602586 10230 raft_consensus.cc:359] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.603271 10230 raft_consensus.cc:385] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.603562 10230 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.604621 10388 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:43.604359 10230 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.606261 10230 ts_tablet_manager.cc:1434] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:43.605937  9935 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.607803 10230 tablet_bootstrap.cc:492] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.607295 10388 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.611826 10231 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.612385 10231 ts_tablet_manager.cc:1403] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.038s
I20260709 13:15:43.590278  9938 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.613916 10185 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.603322 10229 raft_consensus.cc:359] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.622112 10229 raft_consensus.cc:385] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.634066 10229 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.633162 10231 raft_consensus.cc:359] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.634075 10334 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.635581 10231 raft_consensus.cc:385] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.635977 10231 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.637265 10229 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.639585 10229 ts_tablet_manager.cc:1434] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.002s
I20260709 13:15:43.640519 10229 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.625099 10230 tablet_bootstrap.cc:654] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.636669 10231 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.643616  9937 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.645951 10231 ts_tablet_manager.cc:1434] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:15:43.646829 10231 tablet_bootstrap.cc:492] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.648285 10344 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.648792 10344 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.650202 10336 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.650830 10344 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.655901 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.656615 10038 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:43.655901 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.657976 10186 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:43.659078 10229 tablet_bootstrap.cc:654] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.660384 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:43.661264 10344 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.661607 10344 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.661921 10344 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.670748 10358 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.671271 10358 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.673435 10358 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.675241 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.676056 10114 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:15:43.678830 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.680236 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.682015 10279 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.689896 10279 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.691257 10279 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.695953 10344 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.698822 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:43.699452 10035 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.710737 10035 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:43.712090 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:43.712996 10336 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.714130 10336 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:43.714979 10336 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.719128 10344 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.719707 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:43.720353 10186 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.736442 10186 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:43.737207 10358 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.739655 10344 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.741043 10344 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.744587 10344 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.744611 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.745811 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.747119 10231 tablet_bootstrap.cc:654] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.752548 10229 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.753099 10229 ts_tablet_manager.cc:1403] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.113s	user 0.035s	sys 0.028s
W20260709 13:15:43.753254 10081 leader_election.cc:343] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.754268 10230 tablet_bootstrap.cc:492] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.754797 10230 ts_tablet_manager.cc:1403] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.147s	user 0.034s	sys 0.049s
W20260709 13:15:43.758380 10078 leader_election.cc:343] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.758876 10078 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.759845 10344 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.760409 10388 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.769338 10230 raft_consensus.cc:359] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.770033 10230 raft_consensus.cc:385] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.770253 10230 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.769019  9936 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.771339 10229 raft_consensus.cc:359] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.770972 10230 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.772106 10229 raft_consensus.cc:385] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.772451 10229 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.770810 10231 tablet_bootstrap.cc:492] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.773257 10229 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.774693 10231 ts_tablet_manager.cc:1403] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.004s
I20260709 13:15:43.773610 10230 ts_tablet_manager.cc:1434] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:15:43.776322 10229 ts_tablet_manager.cc:1434] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:15:43.777053 10230 tablet_bootstrap.cc:492] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:43.777434 10229 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.777215 10388 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.781629 10231 raft_consensus.cc:359] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.782325 10231 raft_consensus.cc:385] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.782590 10231 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.783239 10231 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.784296 10358 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.784754 10358 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.785280 10231 ts_tablet_manager.cc:1434] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:43.786481 10231 tablet_bootstrap.cc:492] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.786708 10358 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.787882 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.788609 10229 tablet_bootstrap.cc:654] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.790759 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.793900 10231 tablet_bootstrap.cc:654] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.796568 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.798336 10332 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.807104 10325 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.807578 10229 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.808228 10231 tablet_bootstrap.cc:492] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.808588 10229 ts_tablet_manager.cc:1403] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.007s
I20260709 13:15:43.808736 10231 ts_tablet_manager.cc:1403] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.005s
I20260709 13:15:43.810263 10332 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.818662 10231 raft_consensus.cc:359] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.819330 10231 raft_consensus.cc:385] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.819574 10231 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.823098 10229 raft_consensus.cc:359] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.823912 10231 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.832221 10229 raft_consensus.cc:385] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.832623 10229 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.833546 10231 ts_tablet_manager.cc:1434] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:43.833428 10229 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.834558 10231 tablet_bootstrap.cc:492] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.835439 10229 ts_tablet_manager.cc:1434] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:15:43.836236 10229 tablet_bootstrap.cc:492] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.840165 10229 tablet_bootstrap.cc:654] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.798296 10230 tablet_bootstrap.cc:654] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.840492 10231 tablet_bootstrap.cc:654] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.857875 10230 tablet_bootstrap.cc:492] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:43.859061 10230 ts_tablet_manager.cc:1403] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.010s
I20260709 13:15:43.860810 10229 tablet_bootstrap.cc:492] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.861362 10229 ts_tablet_manager.cc:1403] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 13:15:43.863401 10230 raft_consensus.cc:359] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.865617 10229 raft_consensus.cc:359] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.871091 10388 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.883682 10229 raft_consensus.cc:385] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.883724 10230 raft_consensus.cc:385] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.883903 10388 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.884405 10230 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.885159 10230 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.886005 10388 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.887693 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.889815 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.890511 10114 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:43.892158 10230 ts_tablet_manager.cc:1434] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:15:43.892515 10229 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.892751 10004 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:43.875839 10231 tablet_bootstrap.cc:492] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.893316 10229 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.894060 10231 ts_tablet_manager.cc:1403] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.017s
I20260709 13:15:43.894136 10388 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.895395 10229 ts_tablet_manager.cc:1434] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 13:15:43.895785 10185 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.896332 10229 tablet_bootstrap.cc:492] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.896616 10231 raft_consensus.cc:359] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.897269 10231 raft_consensus.cc:385] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.897534 10231 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.898162 10231 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.902952 10325 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.903692 10231 ts_tablet_manager.cc:1434] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:43.903446 10325 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.904546 10231 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:43.905470 10325 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.907032 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.908416 10230 tablet_bootstrap.cc:492] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
W20260709 13:15:43.909166 10155 leader_election.cc:343] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.908557 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:43.910478 10115 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:43.911309 10388 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.911610 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:43.912767 10325 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.913364 10325 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.913733 10325 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.918175 10229 tablet_bootstrap.cc:654] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.921970 10230 tablet_bootstrap.cc:654] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.924496 10325 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.925513 10231 tablet_bootstrap.cc:654] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.930121 10388 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.936019 10336 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.936564 10336 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.938720 10336 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.940490 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.944973 10325 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.946522 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:15:43.946929 10081 leader_election.cc:343] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.947132 10115 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.947991 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:43.949606 10155 leader_election.cc:343] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.950727 10229 tablet_bootstrap.cc:492] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:43.951165 10229 ts_tablet_manager.cc:1403] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.014s
I20260709 13:15:43.950477 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:43.952571 10078 leader_election.cc:343] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.952999 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:43.953984 10229 raft_consensus.cc:359] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.954746 10229 raft_consensus.cc:385] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.955078 10229 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.954085 10336 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.956877 10231 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:43.955791 10229 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.954612 10115 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:43.960595 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:43.961799 10325 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.962227 10229 ts_tablet_manager.cc:1434] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:15:43.962474 10325 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:43.963287 10229 tablet_bootstrap.cc:492] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:43.963449 10325 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.968711 10319 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.970103 10229 tablet_bootstrap.cc:654] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.978286 10231 ts_tablet_manager.cc:1403] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.017s
I20260709 13:15:43.981158 10231 raft_consensus.cc:359] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.982005 10231 raft_consensus.cc:385] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.982334 10231 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.983106 10231 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.990137 10279 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.990764 10279 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.993046 10279 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:43.994287 10388 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.994585 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:43.994781 10388 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:43.995210 10038 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:43.996556 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:43.996755 10388 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:43.998296 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:43.998929 10186 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.000146 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.000566 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.001187 10410 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.001156 10114 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.001693 10410 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.001789 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.002079 10410 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.002429 10115 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:44.003243 10279 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.003602 10279 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.003966 10279 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.004266 10229 tablet_bootstrap.cc:492] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:44.004698 10229 ts_tablet_manager.cc:1403] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.023s
I20260709 13:15:44.006904 10231 ts_tablet_manager.cc:1434] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:15:44.008219 10230 tablet_bootstrap.cc:492] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.008711 10230 ts_tablet_manager.cc:1403] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.010s
I20260709 13:15:44.011067 10230 raft_consensus.cc:359] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.011698 10230 raft_consensus.cc:385] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.007221 10229 raft_consensus.cc:359] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.011996 10230 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.012181 10229 raft_consensus.cc:385] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.012492 10229 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.012873 10230 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.014835 10230 ts_tablet_manager.cc:1434] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:44.015430 10229 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.017367 10229 ts_tablet_manager.cc:1434] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:44.017513 10388 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.014936 10410 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.018146 10230 tablet_bootstrap.cc:492] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.020570 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:44.021122 10186 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.022779 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.023293 10113 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.023553 10230 tablet_bootstrap.cc:654] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.011996 10279 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.025853 10279 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.026698 10231 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:44.027699 10229 tablet_bootstrap.cc:492] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:44.019476 10410 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.033776 10336 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.033689  9937 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.034273 10336 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.037555 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.038463 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.038977 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:44.039531 10038 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:44.040242 10081 leader_election.cc:343] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.041579 10325 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:44.042927 10078 leader_election.cc:343] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.042162 10336 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.043396 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:44.044085 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.044477 10186 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:44.044795 10115 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.048091 10344 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.056687 10231 tablet_bootstrap.cc:654] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.048799 10113 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:44.059082 10038 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:44.060063 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.063345 10410 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.069885 10410 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.077082 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.077368 10410 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.071436 10388 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.077862 10332 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.078858 10388 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:44.079649 10388 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.083977 10229 tablet_bootstrap.cc:654] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.082893 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.086503 10186 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.087961 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.088868 10115 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:44.086009 10332 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:44.091374 10332 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.091935 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.093051 10110 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.090610 10410 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.094755 10410 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.096659 10410 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.106698 10230 tablet_bootstrap.cc:492] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.107201 10230 ts_tablet_manager.cc:1403] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.015s
I20260709 13:15:44.102626 10325 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:44.122198 10410 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.126987 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.127553 10113 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.128345 10410 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.158090 10279 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.174458 10279 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:44.176762  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:44.183071 10113 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:44.224402 10441 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:44.284322 10234 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.307911 10234 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.325353 10332 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.326092 10332 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.337985 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:44.338783 10185 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.345283 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:44.399876 10332 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.400517 10279 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.400856 10234 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.401530 10185 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:44.403723 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.405463 10231 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:44.405939 10231 ts_tablet_manager.cc:1403] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.379s	user 0.021s	sys 0.008s
I20260709 13:15:44.436604  9935 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:44.440876 10078 leader_election.cc:343] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.441200 10229 tablet_bootstrap.cc:492] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:44.441705 10229 ts_tablet_manager.cc:1403] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.414s	user 0.008s	sys 0.010s
I20260709 13:15:44.441121 10441 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.442344 10441 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.444363 10441 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.444697 10388 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.445163 10388 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:44.445946 10388 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.449504 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.450203 10111 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:44.453255 10229 raft_consensus.cc:359] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.453989 10229 raft_consensus.cc:385] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.454246 10229 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.454847 10229 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.455081 10336 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.455389 10230 raft_consensus.cc:359] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.456065 10230 raft_consensus.cc:385] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.456346 10230 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.453171 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.456966 10230 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.458438 10229 ts_tablet_manager.cc:1434] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:15:44.458927 10230 ts_tablet_manager.cc:1434] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.351s	user 0.004s	sys 0.001s
I20260709 13:15:44.459324 10229 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
W20260709 13:15:44.459712 10081 leader_election.cc:343] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.460228 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:44.463536 10344 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.467260 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.468005 10110 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:44.477087 10231 raft_consensus.cc:359] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.478024 10231 raft_consensus.cc:385] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.478367 10231 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.479007 10231 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.480971 10358 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.481246 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.481933 10188 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.488651 10336 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.490800 10230 tablet_bootstrap.cc:492] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
W20260709 13:15:44.493239 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 148071us
I20260709 13:15:44.497000 10230 tablet_bootstrap.cc:654] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.497632 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:44.525095 10279 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.525138 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:44.499049 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.503756 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.525647 10279 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.526086 10036 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:44.505378 10003 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.526049 10279 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.504873 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.514250 10231 ts_tablet_manager.cc:1434] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.003s
I20260709 13:15:44.527559 10358 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.527963 10358 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.528297 10358 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.529572 10231 tablet_bootstrap.cc:492] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:44.508931 10229 tablet_bootstrap.cc:654] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.532532 10455 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.526037 10111 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.537487 10455 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.537935 10455 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.539222 10279 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.523102  9937 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.535051 10358 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:44.548158 10155 leader_election.cc:343] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:44.558485 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.565202 10358 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.567098 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:44.569007 10155 leader_election.cc:343] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.569656 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:44.572065 10231 tablet_bootstrap.cc:654] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.573136 10229 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:44.573508 10229 ts_tablet_manager.cc:1403] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.009s
I20260709 13:15:44.575789 10229 raft_consensus.cc:359] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.576289 10229 raft_consensus.cc:385] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.576506 10229 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.576987 10229 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.578039 10230 tablet_bootstrap.cc:492] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.578476 10230 ts_tablet_manager.cc:1403] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.000s
I20260709 13:15:44.578511 10229 ts_tablet_manager.cc:1434] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:44.579341 10229 tablet_bootstrap.cc:492] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:44.571492 10455 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.580883 10035 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:15:44.581007 10230 raft_consensus.cc:359] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.581707 10230 raft_consensus.cc:385] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.581974 10230 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.582581 10230 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.584446 10455 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.584758 10229 tablet_bootstrap.cc:654] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.585572 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:44.586314 10188 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:44.587711 10230 ts_tablet_manager.cc:1434] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:44.588675 10230 tablet_bootstrap.cc:492] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.589428 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.590027 10111 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.593981 10230 tablet_bootstrap.cc:654] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.596912 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.597565 10115 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.599277 10229 tablet_bootstrap.cc:492] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:44.599766 10229 ts_tablet_manager.cc:1403] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.003s
I20260709 13:15:44.602330 10229 raft_consensus.cc:359] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.602968 10229 raft_consensus.cc:385] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.603232 10229 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.603827 10229 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.605228 10230 tablet_bootstrap.cc:492] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.605567 10115 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:44.605844 10229 ts_tablet_manager.cc:1434] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:44.605732 10230 ts_tablet_manager.cc:1403] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:15:44.606794 10229 tablet_bootstrap.cc:492] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:44.608721 10230 raft_consensus.cc:359] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.609453 10230 raft_consensus.cc:385] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.609745 10230 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.610534 10230 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.612833 10229 tablet_bootstrap.cc:654] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.613585 10230 ts_tablet_manager.cc:1434] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:15:44.614635 10230 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.620815 10230 tablet_bootstrap.cc:654] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.630807 10358 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.634714 10279 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.637970 10230 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.638517 10230 ts_tablet_manager.cc:1403] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:15:44.638403 10111 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:44.641304 10230 raft_consensus.cc:359] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.642026 10230 raft_consensus.cc:385] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.642297 10230 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.642925 10230 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.646944 10358 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.647234 10230 ts_tablet_manager.cc:1434] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:44.647521 10358 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.648240 10230 tablet_bootstrap.cc:492] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.650316 10358 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.655252 10230 tablet_bootstrap.cc:654] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.660696 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.661635 10111 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:44.667544 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.668212 10456 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.668839 10456 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.671326 10456 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.672636 10325 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.673082 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.672771 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:44.673982 10155 leader_election.cc:343] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:44.674530 10081 leader_election.cc:343] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:44.675266 10078 leader_election.cc:343] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.675376 10455 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.675787 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:44.675910 10455 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.678037 10447 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.678512 10334 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.688154 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.688936 10185 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.690656 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.691612 10447 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.692018 10447 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.692346 10447 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.677974 10455 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.701112 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:44.702287 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:44.704141 10332 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.704610 10332 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:44.704928 10325 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.705381 10325 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:44.705425 10332 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.707042 10325 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.711225 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.722182 10455 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.722275 10115 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:44.726323 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:44.728116 10279 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.729290 10279 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.729633 10279 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.731349 10004 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:44.732563 10455 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.743001 10231 tablet_bootstrap.cc:492] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:44.743670 10231 ts_tablet_manager.cc:1403] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.216s	user 0.076s	sys 0.046s
I20260709 13:15:44.727355 10447 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.748703 10230 tablet_bootstrap.cc:492] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.749245 10230 ts_tablet_manager.cc:1403] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.101s	user 0.023s	sys 0.006s
I20260709 13:15:44.751049 10447 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.750974 10279 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.752780 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:44.753439 10188 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.754280 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.754832 10115 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.756075 10279 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.758108 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:44.758285 10230 raft_consensus.cc:359] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.759027 10230 raft_consensus.cc:385] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.759310 10230 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.762286 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.762987 10113 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:44.766412 10230 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.772017 10230 ts_tablet_manager.cc:1434] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:15:44.774200  9937 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.775101 10279 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.775528 10279 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.776190 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.776788 10109 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.776810 10230 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.798897 10188 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:44.800810 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:44.800889 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:44.801069 10155 leader_election.cc:343] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.801828 10441 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.802305 10441 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:44.803992 10441 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.805123 10115 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:44.806448 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:44.806624 10230 tablet_bootstrap.cc:654] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.808544 10231 raft_consensus.cc:359] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.809204 10231 raft_consensus.cc:385] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.809306 10229 tablet_bootstrap.cc:492] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:44.809499 10231 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.810017 10109 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:44.810415 10231 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.811416 10279 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.812664 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.812978 10231 ts_tablet_manager.cc:1434] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:15:44.814332 10231 tablet_bootstrap.cc:492] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
W20260709 13:15:44.813443 10155 leader_election.cc:343] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.809859 10229 ts_tablet_manager.cc:1403] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.203s	user 0.042s	sys 0.045s
I20260709 13:15:44.807431 10325 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.822432 10231 tablet_bootstrap.cc:654] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.818773 10109 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:44.828557 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:44.826921 10325 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:44.829763 10325 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.831959 10279 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.832316 10279 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.832612 10279 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.839128 10229 raft_consensus.cc:359] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.839855 10229 raft_consensus.cc:385] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.840094 10229 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.840708 10229 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.843472 10230 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.844094 10230 ts_tablet_manager.cc:1403] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.014s
I20260709 13:15:44.845294 10229 ts_tablet_manager.cc:1434] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:15:44.846199 10229 tablet_bootstrap.cc:492] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:44.846982 10230 raft_consensus.cc:359] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.847709 10230 raft_consensus.cc:385] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.847986 10230 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.848594 10230 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.850597 10230 ts_tablet_manager.cc:1434] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:44.851467 10230 tablet_bootstrap.cc:492] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.852835 10279 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.856900 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:44.857977 10279 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.857540 10114 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.863091 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:44.864274 10155 leader_election.cc:343] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.867151  9937 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.877756 10230 tablet_bootstrap.cc:654] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.877813 10334 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.883723 10334 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.885823 10334 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.887168 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.887068 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:44.889007 10081 leader_election.cc:343] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.896958 10447 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.899343 10114 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:44.901088 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:44.901242 10231 tablet_bootstrap.cc:492] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
W20260709 13:15:44.901680 10078 leader_election.cc:343] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.902184 10332 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.902714 10332 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:44.902617  9936 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.903616 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:44.903609 10332 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.904937 10334 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.905630 10231 ts_tablet_manager.cc:1403] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.007s
I20260709 13:15:44.907215 10441 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.909011 10441 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.910809 10230 tablet_bootstrap.cc:492] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:44.910959 10441 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.911406 10230 ts_tablet_manager.cc:1403] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.009s
I20260709 13:15:44.919797 10456 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.904150  9936 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.920408 10456 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.923674 10456 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.925197 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.920336 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:44.926566 10081 leader_election.cc:343] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.929592 10229 tablet_bootstrap.cc:654] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.930047 10230 raft_consensus.cc:359] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.933077 10230 raft_consensus.cc:385] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.933368 10230 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.936317 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:44.937206 10114 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:44.938680 10231 raft_consensus.cc:359] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.939347 10231 raft_consensus.cc:385] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.939639 10231 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.940289 10231 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.940289 10230 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.943111 10231 ts_tablet_manager.cc:1434] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:15:44.944095 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.944499 10230 ts_tablet_manager.cc:1434] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.003s
I20260709 13:15:44.945385 10230 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:44.948400 10231 tablet_bootstrap.cc:492] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:44.951119 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:15:44.951929 10078 leader_election.cc:343] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.952355 10447 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.952400 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:44.954031 10456 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.949692 10453 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.958415 10279 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.958884 10279 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.960738 10279 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:44.961072 10231 tablet_bootstrap.cc:654] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.958997 10453 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:44.965464 10453 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.966637 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:44.967507 10230 tablet_bootstrap.cc:654] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.967613 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:44.972456 10456 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.973034 10456 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:44.994639 10155 leader_election.cc:343] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.997237 10456 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:44.997591 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:44.999140 10081 leader_election.cc:343] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.999481 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.000286 10111 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:45.004276 10447 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.005770 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:45.007489 10078 leader_election.cc:343] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.008016 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.010382 10234 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.019424 10447 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.024860 10230 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.025614 10230 ts_tablet_manager.cc:1403] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.004s
I20260709 13:15:45.028668 10230 raft_consensus.cc:359] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.029421 10230 raft_consensus.cc:385] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.029699 10230 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.030375 10230 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.032691 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.033941 10279 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.034216 10231 tablet_bootstrap.cc:492] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:45.034366 10279 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.034775 10279 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.034832 10231 ts_tablet_manager.cc:1403] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.002s
I20260709 13:15:45.038323 10231 raft_consensus.cc:359] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.039065 10231 raft_consensus.cc:385] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.039347 10231 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.040154 10231 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.032518 10230 ts_tablet_manager.cc:1434] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:45.043933 10230 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.044857 10334 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.041862 10279 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.045336 10334 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.048190 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:45.048363 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.048897 10035 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:45.049902 10081 leader_election.cc:343] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.052106 10334 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.052268 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.052546 10231 ts_tablet_manager.cc:1434] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:45.053536 10231 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
W20260709 13:15:45.053705 10078 leader_election.cc:343] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.054150 10078 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.054878 10334 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.056483 10035 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.057874 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:45.058797 10325 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.059468 10325 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:45.060600 10325 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.066256 10231 tablet_bootstrap.cc:654] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.072094 10230 tablet_bootstrap.cc:654] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.077147 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.078045 10114 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:45.082614 10279 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.087482 10004 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:45.088352 10229 tablet_bootstrap.cc:492] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.088310 10447 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.088963 10229 ts_tablet_manager.cc:1403] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.243s	user 0.063s	sys 0.067s
I20260709 13:15:45.091648 10229 raft_consensus.cc:359] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.092311 10229 raft_consensus.cc:385] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.092558 10229 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.093308 10229 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.094933 10447 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.096920 10229 ts_tablet_manager.cc:1434] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:45.097921 10229 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:45.100198 10334 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.100713 10334 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.102803 10334 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.103428 10229 tablet_bootstrap.cc:654] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.104780 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:45.106310 10078 leader_election.cc:343] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.107185 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:45.108734 10081 leader_election.cc:343] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.108765 10325 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.109279 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.110322 10334 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.110715  9936 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.112447  9936 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.114020  9936 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.126888 10229 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.127481 10229 ts_tablet_manager.cc:1403] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.010s
I20260709 13:15:45.130231 10229 raft_consensus.cc:359] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.130971 10229 raft_consensus.cc:385] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.131239 10229 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.132058 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:45.132656 10111 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.135815 10229 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.138263 10229 ts_tablet_manager.cc:1434] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:45.139266 10229 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:45.146237 10230 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.146402 10229 tablet_bootstrap.cc:654] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.146891 10230 ts_tablet_manager.cc:1403] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.103s	user 0.025s	sys 0.015s
I20260709 13:15:45.146494 10279 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.149530 10111 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.150161 10230 raft_consensus.cc:359] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.150858 10230 raft_consensus.cc:385] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.151113 10230 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.151787 10230 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.155601 10231 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:45.156145 10231 ts_tablet_manager.cc:1403] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.028s
I20260709 13:15:45.158914 10231 raft_consensus.cc:359] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.159575 10231 raft_consensus.cc:385] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.159878 10231 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.160168 10229 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.160647 10229 ts_tablet_manager.cc:1403] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:15:45.161240 10230 ts_tablet_manager.cc:1434] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:15:45.162180 10230 tablet_bootstrap.cc:492] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.163965 10229 raft_consensus.cc:359] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.164618 10229 raft_consensus.cc:385] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.164880 10229 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.160627 10231 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.165449 10229 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.167346 10231 ts_tablet_manager.cc:1434] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:15:45.168205 10229 ts_tablet_manager.cc:1434] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:45.169461 10229 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:45.171003 10230 tablet_bootstrap.cc:654] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.168277 10231 tablet_bootstrap.cc:492] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:45.175307 10229 tablet_bootstrap.cc:654] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.180903 10231 tablet_bootstrap.cc:654] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.184729 10229 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.185128 10229 ts_tablet_manager.cc:1403] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:15:45.185575 10230 tablet_bootstrap.cc:492] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.186044 10230 ts_tablet_manager.cc:1403] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.004s
I20260709 13:15:45.187072 10229 raft_consensus.cc:359] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.187692 10229 raft_consensus.cc:385] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.187968 10229 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.188611 10230 raft_consensus.cc:359] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.188652 10229 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.189397 10230 raft_consensus.cc:385] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.189693 10230 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.190328 10230 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.191260 10229 ts_tablet_manager.cc:1434] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:45.192240 10229 tablet_bootstrap.cc:492] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:45.196774 10231 tablet_bootstrap.cc:492] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:45.197286 10231 ts_tablet_manager.cc:1403] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 13:15:45.197954 10229 tablet_bootstrap.cc:654] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.200968 10231 raft_consensus.cc:359] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.201673 10231 raft_consensus.cc:385] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.203102 10231 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.202803 10230 ts_tablet_manager.cc:1434] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:15:45.204675 10230 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.207780 10231 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.210192 10231 ts_tablet_manager.cc:1434] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:45.211596 10231 tablet_bootstrap.cc:492] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:45.213973 10229 tablet_bootstrap.cc:492] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.213984 10447 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.214684 10229 ts_tablet_manager.cc:1403] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:15:45.214592 10447 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.216707 10447 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.218971 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.219264 10230 tablet_bootstrap.cc:654] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.218401 10229 raft_consensus.cc:359] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.219874 10229 raft_consensus.cc:385] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.220208 10229 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.221009 10229 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.223240 10229 ts_tablet_manager.cc:1434] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:45.220280 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.224037 10231 tablet_bootstrap.cc:654] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.225176 10229 tablet_bootstrap.cc:492] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:45.229002 10332 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.234480 10229 tablet_bootstrap.cc:654] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.235459 10230 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.235965 10230 ts_tablet_manager.cc:1403] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:15:45.238448 10230 raft_consensus.cc:359] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.239125 10230 raft_consensus.cc:385] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.239408 10230 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.240470 10231 tablet_bootstrap.cc:492] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:45.240958 10231 ts_tablet_manager.cc:1403] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.030s	user 0.003s	sys 0.009s
I20260709 13:15:45.225651 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:45.244511 10230 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.243522 10231 raft_consensus.cc:359] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.246691 10231 raft_consensus.cc:385] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.248087 10230 ts_tablet_manager.cc:1434] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:45.247031 10231 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.249621 10456 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.249487 10231 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.250191 10456 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.250989 10230 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.253556 10453 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.255714 10231 ts_tablet_manager.cc:1434] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:15:45.256737 10231 tablet_bootstrap.cc:492] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:45.262501 10231 tablet_bootstrap.cc:654] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.267779 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.268836 10230 tablet_bootstrap.cc:654] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:45.269464 10081 leader_election.cc:343] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.271822 10334 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.272372 10334 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.276450 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.277848 10334 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.283159 10450 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.283753 10450 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.285877 10450 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.288136 10230 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.288074 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.288784 10230 ts_tablet_manager.cc:1403] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
W20260709 13:15:45.290365 10078 leader_election.cc:343] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.292505 10230 raft_consensus.cc:359] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.294111 10230 raft_consensus.cc:385] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.294807 10230 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.295917 10230 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.298609 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:45.299193  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:45.299178 10230 ts_tablet_manager.cc:1434] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:45.302284 10230 tablet_bootstrap.cc:492] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.307942 10230 tablet_bootstrap.cc:654] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.314602 10234 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.315464 10234 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.317798 10234 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.319010 10230 tablet_bootstrap.cc:492] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.319526 10230 ts_tablet_manager.cc:1403] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 13:15:45.322119 10325 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.322355 10230 raft_consensus.cc:359] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.322995 10230 raft_consensus.cc:385] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.323282 10230 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.324105 10230 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.326184 10230 ts_tablet_manager.cc:1434] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:15:45.327069 10230 tablet_bootstrap.cc:492] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
W20260709 13:15:45.292912 10081 leader_election.cc:343] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.328918 10081 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.332880 10230 tablet_bootstrap.cc:654] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.299353 10040 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:45.335141 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.343888 10453 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.353709 10504 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.358664 10456 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.362584 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.363548 10185 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:45.367193 10325 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.372248 10453 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.373919 10230 tablet_bootstrap.cc:492] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.374429 10230 ts_tablet_manager.cc:1403] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.002s
I20260709 13:15:45.377038 10230 raft_consensus.cc:359] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.377705 10230 raft_consensus.cc:385] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.377981 10230 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.383884 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:45.389544 10230 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:45.393553 10081 leader_election.cc:343] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.399266 10334 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.399863 10334 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.402562 10334 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.407153 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.409255 10279 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.409703 10279 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.410027 10279 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.391793 10230 ts_tablet_manager.cc:1434] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:15:45.418726 10230 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.418838 10279 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.422355 10078 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.423518 10504 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.423946 10504 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.424260 10504 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.441982 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.442276 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.442749 10114 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
W20260709 13:15:45.443506 10081 leader_election.cc:343] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.443688 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:45.445503 10078 leader_election.cc:343] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.446017 10078 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.447463 10443 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.448041 10443 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:45.450335 10078 leader_election.cc:343] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.450956 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.451359 10443 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.452505 10230 tablet_bootstrap.cc:654] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.452888 10334 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:45.453956 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:45.454599 10279 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.457451 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.458341 10234 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.458614 10506 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.459045 10506 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.461063 10506 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:15:45.461881 10155 leader_election.cc:343] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.462248 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:45.463969 10081 leader_election.cc:343] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.468782 10504 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.475833 10504 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.478256 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:45.457528 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:45.478871 10186 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.479001 10040 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.481009 10447 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.481490 10447 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.483469 10447 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.478312 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:45.485112 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.496374 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.485592 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.497052 10111 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:45.486356 10186 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:45.492250 10036 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:45.498797 10078 leader_election.cc:343] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.499442 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.500586 10334 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:45.497730 10003 leader_election.cc:343] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:45.502681 10081 leader_election.cc:343] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.506965 10078 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.508785 10504 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.509021 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:45.509609 10504 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:45.510597 10504 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.515390 10332 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.515990 10325 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.517784 10153 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.520684 10325 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.521099 10325 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.521449 10325 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.543641 10332 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.544289 10332 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.548178 10332 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.554319 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.558614 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:15:45.559074 10155 leader_election.cc:343] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.559257 10115 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:45.563009 10229 tablet_bootstrap.cc:492] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.563498 10229 ts_tablet_manager.cc:1403] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.339s	user 0.112s	sys 0.134s
I20260709 13:15:45.565312 10443 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.565514 10040 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.569141 10506 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.569368 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:45.569737 10506 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.570116 10443 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.570566 10443 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:45.572595 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.574525 10231 tablet_bootstrap.cc:492] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:45.575122 10231 ts_tablet_manager.cc:1403] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.319s	user 0.091s	sys 0.161s
W20260709 13:15:45.575639 10081 leader_election.cc:343] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.575291 10443 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.576527 10506 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.578197 10231 raft_consensus.cc:359] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.578991 10231 raft_consensus.cc:385] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.579308 10231 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.580008 10332 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.580071 10231 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.579316 10229 raft_consensus.cc:359] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.580610 10332 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.581467 10229 raft_consensus.cc:385] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.581771 10229 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.582463 10229 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.509611 10111 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.584371 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.582947 10231 ts_tablet_manager.cc:1434] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:45.585654 10231 tablet_bootstrap.cc:492] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:45.586354 10332 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.567175 10325 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:45.587513 10155 leader_election.cc:343] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.624614 10231 tablet_bootstrap.cc:654] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.645563 10325 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.646929 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:45.648878 10155 leader_election.cc:343] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.634958 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.651692 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.663280 10229 ts_tablet_manager.cc:1434] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.002s
I20260709 13:15:45.664953 10229 tablet_bootstrap.cc:492] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:45.658767 10453 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.664413 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.666927 10453 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.699736 10230 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.672331 10112 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:45.700259 10230 ts_tablet_manager.cc:1403] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.282s	user 0.012s	sys 0.002s
W20260709 13:15:45.679795 10078 leader_election.cc:343] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.711378 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.690028 10453 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.714478 10279 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.714834 10279 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.715207 10279 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.718475 10229 tablet_bootstrap.cc:654] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.706470 10334 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.711898 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.727169 10234 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.729169 10230 raft_consensus.cc:359] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:45.727092 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51012.4us
I20260709 13:15:45.733741 10230 raft_consensus.cc:385] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.740404 10230 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.744835 10230 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.750360 10230 ts_tablet_manager.cc:1434] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:15:45.752095 10230 tablet_bootstrap.cc:492] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:45.763954 10279 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.770702 10279 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.734602 10334 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.779482 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:45.788671 10036 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.789256 10111 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.789921 10334 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.780305 10231 tablet_bootstrap.cc:492] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:45.780725 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:15:45.782632 10513 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
I20260709 13:15:45.783912 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:45.787179 10453 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.791270 10231 ts_tablet_manager.cc:1403] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.206s	user 0.024s	sys 0.011s
I20260709 13:15:45.812312 10231 raft_consensus.cc:359] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.813061 10231 raft_consensus.cc:385] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.813336 10231 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.796868 10107 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.797457 10106 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.822204  9935 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.833258 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.842029 10231 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.840945 10456 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.857183 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:45.858479 10230 tablet_bootstrap.cc:654] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.862198 10325 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.862676 10325 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.865762 10521 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:45.869843 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.855679 10456 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.872709 10325 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.877139 10231 ts_tablet_manager.cc:1434] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.002s
I20260709 13:15:45.878331 10231 tablet_bootstrap.cc:492] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:45.880283 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.881119 10040 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:15:45.880786 10081 leader_election.cc:343] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.864550 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.883628 10106 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.860484 10112 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.891844 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:45.892478 10189 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.892673 10456 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.885519 10108 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:45.895234 10453 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:45.908264 10107 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.909199 10036 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:45.915104 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:45.925386 10325 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:45.926772 10078 leader_election.cc:343] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.927268 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:45.925928 10325 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:45.928478 10325 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.929649 10504 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.927922 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:45.934552 10189 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
W20260709 13:15:45.935309 10081 leader_election.cc:343] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.937204 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:45.938594 10112 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:45.938697 10453 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.939280 10453 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:45.940359 10453 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:45.942066 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 79092.9us
I20260709 13:15:45.945542 10153 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.946632 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:45.946815 10332 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.947329 10279 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.947839 10279 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.948156 10279 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.947307 10332 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:45.950012 10332 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.957618 10279 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.959329 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:45.960153 10113 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:15:45.962932 10229 tablet_bootstrap.cc:492] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:45.963464 10229 ts_tablet_manager.cc:1403] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.299s	user 0.015s	sys 0.010s
I20260709 13:15:45.963716 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:45.965587 10279 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:45.966467 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:45.967988 10155 leader_election.cc:343] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.969723 10231 tablet_bootstrap.cc:654] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.982023 10524 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.982924 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:45.986159 10230 tablet_bootstrap.cc:492] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:45.987717 10230 ts_tablet_manager.cc:1403] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.013s
W20260709 13:15:45.993068 10078 leader_election.cc:343] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.998616 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:45.999403 10111 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.000682 10229 raft_consensus.cc:359] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.001468 10229 raft_consensus.cc:385] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.001801 10229 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.002792 10229 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:45.993577 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.007112 10518 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.013109 10528 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:46.016412 10229 ts_tablet_manager.cc:1434] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:15:46.017422 10229 tablet_bootstrap.cc:492] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:46.018791 10111 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:46.024049 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:46.025296 10528 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.025871 10528 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:46.021351 10230 raft_consensus.cc:359] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.023093 10229 tablet_bootstrap.cc:654] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.027482 10230 raft_consensus.cc:385] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.027792 10230 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.028414 10230 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.030781 10230 ts_tablet_manager.cc:1434] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.039s	user 0.000s	sys 0.005s
I20260709 13:15:46.031698 10230 tablet_bootstrap.cc:492] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.026841 10528 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.039723 10231 tablet_bootstrap.cc:492] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.059581 10231 ts_tablet_manager.cc:1403] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.004s
I20260709 13:15:46.063324 10231 raft_consensus.cc:359] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:46.050933 10081 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.052686  9936 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.057686 10522 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.040213 10230 tablet_bootstrap.cc:654] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.070330 10231 raft_consensus.cc:385] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.070749 10231 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.071470 10231 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.073657 10231 ts_tablet_manager.cc:1434] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:46.074609 10231 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.080470 10231 tablet_bootstrap.cc:654] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.096051  9937 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.100970 10230 tablet_bootstrap.cc:492] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:46.101500 10230 ts_tablet_manager.cc:1403] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:15:46.103122 10231 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.103641 10231 ts_tablet_manager.cc:1403] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:15:46.106465 10231 raft_consensus.cc:359] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.107259 10231 raft_consensus.cc:385] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.107589 10231 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.108407 10231 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.110110 10230 raft_consensus.cc:359] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.110785 10230 raft_consensus.cc:385] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.110886 10231 ts_tablet_manager.cc:1434] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:46.111089 10230 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.111997 10231 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.117424 10230 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.118597 10231 tablet_bootstrap.cc:654] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.119071 10230 ts_tablet_manager.cc:1434] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:46.122159 10230 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.124689  9936 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.129864 10230 tablet_bootstrap.cc:654] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.127048  9936 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.130003 10231 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.130865 10231 ts_tablet_manager.cc:1403] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:15:46.131043  9936 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.132694 10453 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.133167 10453 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.135303 10231 raft_consensus.cc:359] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.135972 10456 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:46.136078 10231 raft_consensus.cc:385] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.137260 10231 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.137979 10231 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.140403 10231 ts_tablet_manager.cc:1434] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:46.144462 10453 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.145574 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.146270 10189 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:46.146715 10231 tablet_bootstrap.cc:492] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.148715 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:46.151657 10453 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.152115 10453 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.152463 10453 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.153573 10231 tablet_bootstrap.cc:654] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.160313 10230 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:46.160835 10230 ts_tablet_manager.cc:1403] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.003s
I20260709 13:15:46.165024 10518 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.165591 10518 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.167943 10518 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.168736 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:46.170609 10081 leader_election.cc:343] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.170969 10453 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.171303 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:46.172788 10078 leader_election.cc:343] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.173282 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.174455 10518 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.163653 10230 raft_consensus.cc:359] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.175426 10230 raft_consensus.cc:385] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.175730 10230 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.180615 10230 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.182694 10230 ts_tablet_manager.cc:1434] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:46.183645 10230 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.186715 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:46.187378 10188 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.194500 10188 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:46.195771 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:46.196830 10516 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.197024 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.197314 10516 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:46.197679 10107 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:46.198161 10516 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.202010 10519 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.202471 10519 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.204607 10519 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.206151 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.202734 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:46.207973 10107 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.210143 10230 tablet_bootstrap.cc:654] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.210950 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.213454 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:46.215111 10519 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.215972 10455 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.216496 10107 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:46.216418 10455 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.218532 10455 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.220230 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.223166 10229 tablet_bootstrap.cc:492] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:46.223660 10229 ts_tablet_manager.cc:1403] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.206s	user 0.043s	sys 0.039s
I20260709 13:15:46.225138 10230 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:46.225718 10230 ts_tablet_manager.cc:1403] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.003s
I20260709 13:15:46.226269 10229 raft_consensus.cc:359] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.226954 10229 raft_consensus.cc:385] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.227213 10229 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.229789 10230 raft_consensus.cc:359] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.230616 10230 raft_consensus.cc:385] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.230942 10230 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.234527 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.234889 10230 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.231369 10453 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.237169 10230 ts_tablet_manager.cc:1434] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:15:46.237319 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:46.237982 10230 tablet_bootstrap.cc:492] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.237835 10229 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.238039 10516 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.240727 10229 ts_tablet_manager.cc:1434] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:15:46.241640 10229 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:46.242151 10231 tablet_bootstrap.cc:492] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.242671 10231 ts_tablet_manager.cc:1403] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.096s	user 0.045s	sys 0.036s
I20260709 13:15:46.243983 10230 tablet_bootstrap.cc:654] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.245873 10231 raft_consensus.cc:359] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.246744 10231 raft_consensus.cc:385] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.247083 10231 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.248324 10231 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.250489 10229 tablet_bootstrap.cc:654] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.250669 10231 ts_tablet_manager.cc:1434] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:46.290979 10231 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.293051  9937 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.294831 10234 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.298697 10234 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.304409 10234 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.305284 10234 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.305037 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:46.337672 10078 leader_election.cc:343] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.343366 10234 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.352193 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:46.358289 10078 leader_election.cc:343] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.361083 10234 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.357914 10521 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.378786 10516 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.381527 10279 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:46.390300 10230 tablet_bootstrap.cc:492] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:46.391131 10230 ts_tablet_manager.cc:1403] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.153s	user 0.004s	sys 0.009s
I20260709 13:15:46.415210 10230 raft_consensus.cc:359] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.416153 10230 raft_consensus.cc:385] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.416460 10230 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.417176 10230 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.412706 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:46.426998  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:46.426913 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:46.430662 10229 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:46.431342 10229 ts_tablet_manager.cc:1403] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.016s
I20260709 13:15:46.431680 10325 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.433310 10325 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.436002 10325 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:46.437240 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:46.439185 10155 leader_election.cc:343] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.441198 10230 ts_tablet_manager.cc:1434] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 13:15:46.445541 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.446399 10107 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:46.442526 10230 tablet_bootstrap.cc:492] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.453289 10519 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.453944 10519 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.455651 10229 raft_consensus.cc:359] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.456576 10229 raft_consensus.cc:385] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.456918 10229 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.453531 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:46.457672 10229 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.467353 10035 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.472846 10519 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.474303 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.476300 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.476854 10518 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.477497 10518 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.478035 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:46.483143 10518 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.472221 10516 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:15:46.487833 10519 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.488586 10231 tablet_bootstrap.cc:654] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.488672 10229 ts_tablet_manager.cc:1434] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
W20260709 13:15:46.489415 10081 leader_election.cc:343] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.490137 10229 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:46.492988 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.501982 10279 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.503881 10325 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.505663 10552 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.504246 10325 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.506675 10325 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.505558 10036 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:46.504032 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50704.3us
W20260709 13:15:46.512060 10081 leader_election.cc:343] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.512571 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.513669 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.517089 10552 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.525262 10325 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.534845 10230 tablet_bootstrap.cc:654] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.546471 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:46.560053 10524 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:46.552752 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:46.557988 10081 leader_election.cc:343] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:46.562889 10078 leader_election.cc:343] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.563400 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.566502 10552 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:46.566224 10155 leader_election.cc:343] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:46.567983 10155 consensus_peers.cc:597] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.581607 10450 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.586951 10040 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.601387 10325 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:46.623911 10231 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.624547 10231 ts_tablet_manager.cc:1403] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.373s	user 0.009s	sys 0.028s
I20260709 13:15:46.627767 10231 raft_consensus.cc:359] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.639287 10231 raft_consensus.cc:385] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.639639 10231 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.640772 10231 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.642535 10231 ts_tablet_manager.cc:1434] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:46.649312 10231 tablet_bootstrap.cc:492] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.660377 10230 tablet_bootstrap.cc:492] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:46.663563 10230 ts_tablet_manager.cc:1403] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.221s	user 0.023s	sys 0.019s
I20260709 13:15:46.664698 10552 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.665683 10229 tablet_bootstrap.cc:654] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.665287 10552 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.664104 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:46.670878 10107 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.687625 10552 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.688220 10455 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:46.689172 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.689635 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:46.690975 10081 leader_election.cc:343] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:46.691547 10078 leader_election.cc:343] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.691987 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.695818 10455 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:46.698374 10518 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.711401 10229 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:46.712218 10229 ts_tablet_manager.cc:1403] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.004s
I20260709 13:15:46.713802 10453 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.714991 10453 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.720876 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.723115 10230 raft_consensus.cc:359] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.724144 10230 raft_consensus.cc:385] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.724452 10230 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.725206 10230 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.725767 10111 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:46.727203 10229 raft_consensus.cc:359] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.727717 10229 raft_consensus.cc:385] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.727474 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:46.728039 10229 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.729375 10455 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.732012 10455 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.728192 10453 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.734977 10230 ts_tablet_manager.cc:1434] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.002s
I20260709 13:15:46.734723 10229 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.734787 10455 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.739142 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:46.742137 10003 leader_election.cc:343] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.745790 10229 ts_tablet_manager.cc:1434] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.006s
W20260709 13:15:46.747469 10560 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:46.748989 10229 tablet_bootstrap.cc:492] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:46.750788 10519 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.751480 10231 tablet_bootstrap.cc:654] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.751971 10519 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.754534 10519 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.755329 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.755532 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.757732 10004 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:46.758846 10453 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.760599 10504 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.761088 10504 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.764247 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:46.765012 10455 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:46.770119 10081 leader_election.cc:343] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.770857 10455 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.771574 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:46.772296 10112 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.773901 10230 tablet_bootstrap.cc:492] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.775470 10107 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:46.777421 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:46.778306 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:46.779203 10528 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.780082 10528 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:46.781944 10528 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.783535 10112 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:46.784910 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:46.786865 10453 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.788165 10453 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:46.789347 10453 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.791204 10229 tablet_bootstrap.cc:654] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:46.801879 10003 leader_election.cc:343] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.806860 10231 tablet_bootstrap.cc:492] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.807377 10231 ts_tablet_manager.cc:1403] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.004s
I20260709 13:15:46.809540 10230 tablet_bootstrap.cc:654] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.810137 10231 raft_consensus.cc:359] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.810835 10231 raft_consensus.cc:385] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.811101 10231 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.811714 10231 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.816939 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:46.818449 10078 leader_election.cc:343] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.818861 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:46.819393 10231 ts_tablet_manager.cc:1434] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:15:46.819629 10552 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.820676 10231 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.823836 10504 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.826016  9937 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.837930 10231 tablet_bootstrap.cc:654] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.867148 10229 tablet_bootstrap.cc:492] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:46.867726 10229 ts_tablet_manager.cc:1403] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.023s
I20260709 13:15:46.870252  9935 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.874902 10231 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:46.875478 10231 ts_tablet_manager.cc:1403] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.008s
I20260709 13:15:46.879196 10231 raft_consensus.cc:359] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.879923 10231 raft_consensus.cc:385] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.880187 10231 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.881573 10231 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.882145 10229 raft_consensus.cc:359] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.883509 10229 raft_consensus.cc:385] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.883885 10229 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.884536 10229 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.886329 10229 ts_tablet_manager.cc:1434] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.001s
I20260709 13:15:46.887406 10229 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:46.887756 10230 tablet_bootstrap.cc:492] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:46.888230 10230 ts_tablet_manager.cc:1403] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.115s	user 0.035s	sys 0.026s
I20260709 13:15:46.883888 10231 ts_tablet_manager.cc:1434] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:46.892005 10230 raft_consensus.cc:359] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.892652 10230 raft_consensus.cc:385] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.892948 10230 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.894243 10231 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:46.898777 10230 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.904093 10230 ts_tablet_manager.cc:1434] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:46.904757 10229 tablet_bootstrap.cc:654] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.905172 10230 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:46.906248 10528 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.906962 10528 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.909380 10528 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:46.912182 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.912354 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:46.912992 10040 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:46.916605 10231 tablet_bootstrap.cc:654] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.912899 10112 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:46.918393 10155 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:46.920594 10279 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.920948 10279 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.921265 10279 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.926983 10230 tablet_bootstrap.cc:654] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.928580 10504 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.929143 10504 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.933442 10504 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.935770 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:46.937489 10081 leader_election.cc:343] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.938234 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.938920 10188 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:46.946115 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:46.946815 10504 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.947151 10504 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.947482 10504 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.943288 10279 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.954079 10279 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:46.956197 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:46.956888 10107 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.979720 10519 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.980772 10519 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.984318 10519 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.984341 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:46.976547 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:46.984764 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:46.985312 10035 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.992713 10504 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:46.995059 10504 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:46.985236 10112 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:46.999944 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:47.001314 10519 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.004105 10035 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.004629 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:47.005249 10188 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.005651 10155 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:47.007318 10279 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.007721 10279 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:47.008425 10279 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.010293 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:47.011502 10081 leader_election.cc:343] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.022081 10229 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.022619 10229 ts_tablet_manager.cc:1403] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.135s	user 0.033s	sys 0.004s
I20260709 13:15:47.026187 10229 raft_consensus.cc:359] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.026930 10229 raft_consensus.cc:385] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.027194 10229 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.027870 10229 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.029105 10519 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.029882 10229 ts_tablet_manager.cc:1434] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:15:47.030910 10229 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.021878 10107 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.044895 10230 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:47.046689 10230 ts_tablet_manager.cc:1403] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.142s	user 0.028s	sys 0.023s
I20260709 13:15:47.049928 10231 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.050421 10231 ts_tablet_manager.cc:1403] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.002s
I20260709 13:15:47.050931 10230 raft_consensus.cc:359] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.051456 10230 raft_consensus.cc:385] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.051653 10230 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.052289 10230 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.053157 10231 raft_consensus.cc:359] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.053808 10231 raft_consensus.cc:385] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.054059 10231 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.054705 10230 ts_tablet_manager.cc:1434] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:15:47.054641 10231 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.052663  9935 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.055943 10188 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:47.057220 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:47.058204 10504 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.058667 10504 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:47.059520 10504 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.061610 10230 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:47.064704 10229 tablet_bootstrap.cc:654] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.065243 10279 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.065596 10279 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.071082 10231 ts_tablet_manager.cc:1434] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:15:47.071465 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:47.076560 10155 leader_election.cc:343] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.080826 10279 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.079979 10231 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.082792 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.083479 10112 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.087105 10035 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.088212 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:47.094097 10528 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.099080 10528 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.099457 10528 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.109786 10230 tablet_bootstrap.cc:654] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.109807 10528 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.116271 10528 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.117336 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.122258 10107 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.118038 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:47.123834 10231 tablet_bootstrap.cc:654] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.120558  9937 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:47.133461 10155 leader_election.cc:343] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.157665 10107 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.158439 10229 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.158926 10229 ts_tablet_manager.cc:1403] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.024s
I20260709 13:15:47.158916 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:47.159874 10279 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.160362 10279 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:47.161149 10279 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.162328 10229 raft_consensus.cc:359] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.163009 10229 raft_consensus.cc:385] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.163290 10229 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.164054 10229 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.165544 10231 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.166213 10231 ts_tablet_manager.cc:1403] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.001s
I20260709 13:15:47.168512 10332 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.168957 10332 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.169116 10231 raft_consensus.cc:359] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.169696 10231 raft_consensus.cc:385] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.169951 10231 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.170543 10231 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.171039 10332 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.171849 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.172575 10035 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.173363 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.173686 10155 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:47.173978 10107 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.174490 10528 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.174881 10528 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.175269 10528 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.178071 10230 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:47.178561 10230 ts_tablet_manager.cc:1403] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.010s
I20260709 13:15:47.181119 10230 raft_consensus.cc:359] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.181746 10230 raft_consensus.cc:385] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.182132 10230 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.182214 10231 ts_tablet_manager.cc:1434] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:15:47.182672 10528 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.183302 10231 tablet_bootstrap.cc:492] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.182919 10230 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.185509 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:47.186077 10035 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.191582 10230 ts_tablet_manager.cc:1434] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:47.192652 10230 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
I20260709 13:15:47.193631 10035 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.194723 10155 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:47.195422 10332 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.195946 10332 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:47.196892 10231 tablet_bootstrap.cc:654] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.196777 10332 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.181929 10229 ts_tablet_manager.cc:1434] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 13:15:47.201385 10229 tablet_bootstrap.cc:492] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
W20260709 13:15:47.217094 10003 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.219027 10552 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.218958 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.219681 10107 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.219606 10552 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.223277 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.224473 10188 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 0.
I20260709 13:15:47.224148  9935 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.225445 10078 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.223975 10552 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.226161 10504 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.226610 10504 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.226943 10504 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.230928 10279 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.222239 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:47.232767 10081 leader_election.cc:343] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.233330 10504 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.236032 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:15:47.237166 10081 leader_election.cc:343] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.226199 10107 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.245332 10528 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.246476 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:47.245936 10231 tablet_bootstrap.cc:492] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.247051 10188 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.248826 10504 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.249156 10229 tablet_bootstrap.cc:654] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.249863 10230 tablet_bootstrap.cc:654] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.264832 10188 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:15:47.270099 10078 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:47.271916 10504 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.272389 10504 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:15:47.273217 10504 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.274529 10231 ts_tablet_manager.cc:1403] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.006s
I20260709 13:15:47.286152 10231 raft_consensus.cc:359] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.286707 10552 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.289328 10231 raft_consensus.cc:385] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.289695 10231 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.291401 10230 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:47.291653 10231 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.289438 10552 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.293195 10230 ts_tablet_manager.cc:1403] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.007s
I20260709 13:15:47.294675 10552 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.296051 10230 raft_consensus.cc:359] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.296519 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.296787 10230 raft_consensus.cc:385] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.297070 10230 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.297683 10230 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.300329 10230 ts_tablet_manager.cc:1434] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:47.301263 10230 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Bootstrap starting.
W20260709 13:15:47.302323 10078 leader_election.cc:343] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.304352 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.305794  9935 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.306564 10081 leader_election.cc:343] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.306985 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.308323 10552 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.311650 10229 tablet_bootstrap.cc:492] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.318171 10229 ts_tablet_manager.cc:1403] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.001s
I20260709 13:15:47.321182 10229 raft_consensus.cc:359] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.301210 10231 ts_tablet_manager.cc:1434] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:15:47.307085 10230 tablet_bootstrap.cc:654] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.326753 10279 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.327186 10231 tablet_bootstrap.cc:492] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.330693 10229 raft_consensus.cc:385] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.331105 10229 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.333338 10229 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.341514 10231 tablet_bootstrap.cc:654] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.343576 10229 ts_tablet_manager.cc:1434] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:15:47.347669 10230 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: No bootstrap required, opened a new log
I20260709 13:15:47.348464 10230 ts_tablet_manager.cc:1403] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.001s
I20260709 13:15:47.353822 10229 tablet_bootstrap.cc:492] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.365347 10230 raft_consensus.cc:359] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.366072 10230 raft_consensus.cc:385] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.366343 10230 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.367027 10230 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.369455 10230 ts_tablet_manager.cc:1434] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:47.370000 10229 tablet_bootstrap.cc:654] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.374666 10231 tablet_bootstrap.cc:492] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.375181 10231 ts_tablet_manager.cc:1403] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.009s
I20260709 13:15:47.374401  9936 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.377918 10231 raft_consensus.cc:359] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.378585 10231 raft_consensus.cc:385] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.378839 10231 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.379431 10231 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.381482 10231 ts_tablet_manager.cc:1434] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:47.382036 10519 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.382684 10231 tablet_bootstrap.cc:492] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.384115 10229 tablet_bootstrap.cc:492] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.384570 10229 ts_tablet_manager.cc:1403] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.007s
I20260709 13:15:47.387511 10229 raft_consensus.cc:359] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.388912 10231 tablet_bootstrap.cc:654] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.389577 10516 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.390025 10516 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.392261 10516 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.396245 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:47.397845 10003 leader_election.cc:343] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.401183 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.402029 10107 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:47.404192 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.404911 10519 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.405277 10519 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.405598 10519 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.388165 10229 raft_consensus.cc:385] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.409524 10229 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.409686 10279 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.411013 10229 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.414270 10519 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.417173 10519 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.418744 10229 ts_tablet_manager.cc:1434] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:15:47.420907 10552 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.421396 10552 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.424216 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.425278 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:15:47.425591 10081 leader_election.cc:343] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:47.426888 10078 leader_election.cc:343] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.427317 10078 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.428833 10504 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.430483 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.433780 10107 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.432590 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:47.419680 10229 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.430997 10552 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:15:47.440742 10003 leader_election.cc:343] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.441221 10453 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.441885 10453 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.449052 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.449563 10107 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:47.451063 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.452171 10516 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.452690 10516 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:47.452361 10229 tablet_bootstrap.cc:654] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.454748 10552 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.457238 10552 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.453519 10516 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.459885 10552 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.460462 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:15:47.462034 10081 leader_election.cc:343] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.463872 10231 tablet_bootstrap.cc:492] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.464324 10231 ts_tablet_manager.cc:1403] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.082s	user 0.039s	sys 0.018s
I20260709 13:15:47.471781 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.472983 10453 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:15:47.473121 10078 leader_election.cc:343] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.474006 10231 raft_consensus.cc:359] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.474545 10078 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.474934 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.475517 10552 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.475678 10186 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:15:47.476975 10231 raft_consensus.cc:385] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:47.477120  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:47.477291 10231 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.480026 10231 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.482451 10231 ts_tablet_manager.cc:1434] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:15:47.483404 10231 tablet_bootstrap.cc:492] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.495353 10231 tablet_bootstrap.cc:654] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.498188 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:47.505187 10453 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.514824 10453 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.517935 10231 tablet_bootstrap.cc:492] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.520598 10231 ts_tablet_manager.cc:1403] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.011s
I20260709 13:15:47.523164 10231 raft_consensus.cc:359] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.523810 10231 raft_consensus.cc:385] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.524061 10231 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.526289 10229 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.526726 10229 ts_tablet_manager.cc:1403] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.014s
I20260709 13:15:47.529709 10229 raft_consensus.cc:359] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.530478 10229 raft_consensus.cc:385] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.530731 10229 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.531420 10229 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.532928 10279 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.533519 10229 ts_tablet_manager.cc:1434] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:47.533358 10279 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.535194 10279 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.532073 10231 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.536398 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.536770 10231 ts_tablet_manager.cc:1434] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:15:47.537041 10107 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.539052 10229 tablet_bootstrap.cc:492] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.538978 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.541990 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.542824 10504 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.543282 10504 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.543876 10552 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.544247 10229 tablet_bootstrap.cc:654] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.544328 10552 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.545759 10504 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.548614 10231 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.547573 10455 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.549242 10455 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.551137 10455 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.552688 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.552609 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.553905 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.551514  9936 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.555017 10229 tablet_bootstrap.cc:492] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.555282 10231 tablet_bootstrap.cc:654] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.555450 10229 ts_tablet_manager.cc:1403] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
W20260709 13:15:47.556120 10155 leader_election.cc:343] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.556914 10443 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.557278 10443 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.557569 10443 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.558198 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.559304 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.559654 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.560366 10107 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:47.564610 10229 raft_consensus.cc:359] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.564888 10443 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.565311 10229 raft_consensus.cc:385] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.565675 10229 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.565994 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:47.546201 10552 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.566306 10229 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.568303 10040 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.568667 10229 ts_tablet_manager.cc:1434] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:47.570024 10229 tablet_bootstrap.cc:492] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.570662 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:47.574795 10453 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:47.555344 10081 leader_election.cc:343] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.575717 10229 tablet_bootstrap.cc:654] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.577816 10443 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:15:47.575657 10078 leader_election.cc:343] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.580802 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.581444 10552 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:47.581605 10078 leader_election.cc:343] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:47.584441 10081 leader_election.cc:343] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.584841 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.585443 10552 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.609210 10229 tablet_bootstrap.cc:492] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.609719 10229 ts_tablet_manager.cc:1403] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 13:15:47.610630 10528 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.611505 10231 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
W20260709 13:15:47.612299 10155 leader_election.cc:343] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.614336 10231 ts_tablet_manager.cc:1403] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.004s
I20260709 13:15:47.614826 10528 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.612253 10229 raft_consensus.cc:359] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.617434 10229 raft_consensus.cc:385] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.617710 10229 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.618309 10229 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.619802 10229 ts_tablet_manager.cc:1434] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:15:47.619932 10231 raft_consensus.cc:359] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.620725 10229 tablet_bootstrap.cc:492] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.620680 10231 raft_consensus.cc:385] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.621125 10231 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.621794 10231 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.629954 10229 tablet_bootstrap.cc:654] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.630563 10231 ts_tablet_manager.cc:1434] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:15:47.631692 10231 tablet_bootstrap.cc:492] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.640805 10231 tablet_bootstrap.cc:654] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.655964 10229 tablet_bootstrap.cc:492] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.656423 10229 ts_tablet_manager.cc:1403] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 13:15:47.659617 10229 raft_consensus.cc:359] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.660223 10443 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.660714 10443 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.660257 10229 raft_consensus.cc:385] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.662621 10443 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.662752 10229 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.663429 10229 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.665016 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.665598 10111 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.665884 10518 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.671103 10443 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.673142 10111 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.669739 10231 tablet_bootstrap.cc:492] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.674153 10231 ts_tablet_manager.cc:1403] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.012s
I20260709 13:15:47.680595 10229 ts_tablet_manager.cc:1434] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:47.680497 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.681135 10107 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.681567 10229 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.684547 10231 raft_consensus.cc:359] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.685308 10231 raft_consensus.cc:385] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.685623 10231 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.686326 10231 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.688478 10231 ts_tablet_manager.cc:1434] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:15:47.689548 10231 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.691082 10186 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.702250 10231 tablet_bootstrap.cc:654] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.688055 10528 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:47.692348 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:47.704223 10443 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.704717 10443 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:47.705561 10443 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.709939 10229 tablet_bootstrap.cc:654] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.728374 10229 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.728856 10229 ts_tablet_manager.cc:1403] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:15:47.735008 10332 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.738188 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.738924 10443 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.741370 10443 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.743546 10443 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.752211 10231 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.752825 10231 ts_tablet_manager.cc:1403] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.007s
I20260709 13:15:47.757010 10231 raft_consensus.cc:359] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.758375 10231 raft_consensus.cc:385] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.731451 10229 raft_consensus.cc:359] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.763301 10231 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.763425 10229 raft_consensus.cc:385] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.763967 10229 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.764374 10231 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.764626 10229 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.767165 10231 ts_tablet_manager.cc:1434] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:15:47.767326 10229 ts_tablet_manager.cc:1434] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:15:47.768319 10231 tablet_bootstrap.cc:492] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.768801 10229 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.762562 10443 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.774947 10231 tablet_bootstrap.cc:654] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.775602 10034 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.779189  9937 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.784431 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.784977 10518 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.784962 10107 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:47.790259 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 120079us
I20260709 13:15:47.772389 10443 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.801009 10229 tablet_bootstrap.cc:654] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.816959 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.817664 10034 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.828054 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:47.828680 10040 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.838406 10040 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.847625 10455 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.848129 10455 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.851028 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.851624 10188 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:47.852743 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:47.852974 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.853466 10453 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.853543 10111 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:47.853946 10453 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.854285 10453 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.853585 10455 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.859330 10229 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:47.859778 10229 ts_tablet_manager.cc:1403] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.015s
I20260709 13:15:47.861541 10453 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.862823 10455 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.864545 10107 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.863271 10455 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.865707 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.867105 10615 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.867548 10615 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:47.867635 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:47.868350 10615 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:47.868826 10003 leader_election.cc:343] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.869455 10455 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.869799 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.870431 10107 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:47.875681 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.876448 10455 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.876837 10455 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.877171 10455 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.879330 10453 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.880358 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:47.880887 10188 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.883916 10518 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.887084 10188 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:47.887432 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.888118 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:47.889040 10229 raft_consensus.cc:359] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.889750 10229 raft_consensus.cc:385] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.890009 10229 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.890547 10518 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.894497 10231 tablet_bootstrap.cc:492] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:47.894981 10231 ts_tablet_manager.cc:1403] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.127s	user 0.037s	sys 0.050s
I20260709 13:15:47.895202 10453 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.888094 10107 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.890555 10229 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.898468 10229 ts_tablet_manager.cc:1434] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.003s
I20260709 13:15:47.899379 10229 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:47.904201 10231 raft_consensus.cc:359] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.904843 10231 raft_consensus.cc:385] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.905102 10231 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.905712 10231 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.906111 10325 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.906546 10325 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.907189 10231 ts_tablet_manager.cc:1434] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.002s
I20260709 13:15:47.900435 10443 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.908473 10231 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:47.908272 10443 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.910238 10528 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.910673 10528 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.883646 10455 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.908515 10325 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.910231 10443 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.925420 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.925982 10040 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.927610 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.930043 10108 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.935272 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.935860 10112 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.935184 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.937379 10615 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.937763 10615 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.938074 10615 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.938225 10107 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:47.900760 10453 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:47.940500 10453 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.942672 10231 tablet_bootstrap.cc:654] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.944409 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.944859 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.945482 10106 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:47.912514 10528 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.947829 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.917881 10455 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:47.953860 10615 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.955794 10615 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:47.955866 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:47.957266 10615 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.958328 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:47.958768 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:47.963965 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:47.964493 10111 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.965235 10108 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 1: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:15:47.968261 10003 leader_election.cc:343] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.970074  9936 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.972638 10111 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:47.975618 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:47.976457 10112 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:47.977648 10528 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.978149 10528 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:47.978971 10528 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:15:47.980824 10155 leader_election.cc:343] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.982909 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:15:47.989231 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:47.989948 10325 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.992842 10455 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.995891 10455 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:47.996662 10455 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:47.997797 10325 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.001116 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:48.001669 10036 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.962105 10615 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.004097 10516 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.004549 10615 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.014621 10229 tablet_bootstrap.cc:654] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.007236 10036 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.023777  9937 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.035030 10453 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.037344 10615 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.046293 10615 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.047185 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:48.047787 10111 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.051780 10231 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:48.052155 10231 ts_tablet_manager.cc:1403] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.043s
I20260709 13:15:48.057030 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:48.060761 10111 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.061488  9937 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.062808 10231 raft_consensus.cc:359] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.063469 10231 raft_consensus.cc:385] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.063982 10231 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.074617 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:48.075773 10325 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:48.077512 10155 leader_election.cc:343] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.080029 10279 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.080421 10279 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.080825 10325 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:48.081585 10325 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.082172 10279 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.083493 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.084115 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:48.084127 10108 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:48.085402 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:48.087177 10528 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:48.087522 10528 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.087877 10528 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.090806 10231 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.093660 10229 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:48.094092 10229 ts_tablet_manager.cc:1403] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.195s	user 0.014s	sys 0.008s
I20260709 13:15:48.096721 10231 ts_tablet_manager.cc:1434] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.002s
W20260709 13:15:48.097985 10155 leader_election.cc:343] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.099380  9935 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.103374 10231 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:48.114262 10231 tablet_bootstrap.cc:654] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.117033 10229 raft_consensus.cc:359] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.117268 10528 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.117743 10229 raft_consensus.cc:385] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.118033 10229 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.120471 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:48.120193 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:48.121779 10528 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.121654 10229 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.121690 10111 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.123756 10229 ts_tablet_manager.cc:1434] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:15:48.126863 10229 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:48.127424 10231 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:48.127921 10231 ts_tablet_manager.cc:1403] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.002s
W20260709 13:15:48.124888 10155 leader_election.cc:343] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.131436 10231 raft_consensus.cc:359] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.132170 10231 raft_consensus.cc:385] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.132489 10231 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.133170 10231 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.136955 10229 tablet_bootstrap.cc:654] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.137069 10111 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.138200 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:15:48.139201 10528 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:48.139756 10231 ts_tablet_manager.cc:1434] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:48.140251 10528 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:48.140837 10231 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:48.141175 10528 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.141706  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.146783 10231 tablet_bootstrap.cc:654] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.159009 10229 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:48.159493 10229 ts_tablet_manager.cc:1403] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.007s
I20260709 13:15:48.162541 10229 raft_consensus.cc:359] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.163152 10229 raft_consensus.cc:385] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.163410 10229 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.164079 10229 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.164551 10231 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:48.165012 10231 ts_tablet_manager.cc:1403] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 13:15:48.166610 10229 ts_tablet_manager.cc:1434] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:48.167459 10229 tablet_bootstrap.cc:492] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:48.167728 10455 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.167418 10231 raft_consensus.cc:359] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.168257 10455 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.168730 10231 raft_consensus.cc:385] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.168999 10231 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.169571 10231 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.170226 10455 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:48.171047 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.172516 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:48.173215 10111 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:48.174568 10003 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:48.176144 10231 ts_tablet_manager.cc:1434] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:48.177292 10231 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:48.180383 10455 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.182870 10231 tablet_bootstrap.cc:654] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.196100  9935 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.198294 10455 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.202124 10229 tablet_bootstrap.cc:654] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.209096 10229 tablet_bootstrap.cc:492] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:48.209097 10231 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:48.209602 10229 ts_tablet_manager.cc:1403] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.003s
I20260709 13:15:48.209602 10231 ts_tablet_manager.cc:1403] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:15:48.212239 10229 raft_consensus.cc:359] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.212489 10231 raft_consensus.cc:359] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.212896 10229 raft_consensus.cc:385] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.213076 10231 raft_consensus.cc:385] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.213171 10229 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.213384 10231 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.213884 10229 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.214417 10231 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.215929 10229 ts_tablet_manager.cc:1434] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:48.216413 10231 ts_tablet_manager.cc:1434] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:48.216820 10229 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Bootstrap starting.
I20260709 13:15:48.217686 10231 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Bootstrap starting.
I20260709 13:15:48.222497 10229 tablet_bootstrap.cc:654] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.225744 10231 tablet_bootstrap.cc:654] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.233350 10229 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: No bootstrap required, opened a new log
I20260709 13:15:48.233778 10229 ts_tablet_manager.cc:1403] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 13:15:48.240298 10231 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: No bootstrap required, opened a new log
I20260709 13:15:48.240767 10231 ts_tablet_manager.cc:1403] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:15:48.240418 10229 raft_consensus.cc:359] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.241153 10229 raft_consensus.cc:385] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.241418 10229 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.242067 10229 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.244167 10229 ts_tablet_manager.cc:1434] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:48.243263 10231 raft_consensus.cc:359] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.244858 10231 raft_consensus.cc:385] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.245061 10231 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.245620 10231 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.247042 10231 ts_tablet_manager.cc:1434] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:48.278738 10528 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.287621 10325 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.303445 10615 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.320562 10035 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.327569 10615 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.331347 10455 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.331841 10455 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.333657 10455 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:48.334693 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.335216 10111 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:48.335330 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:48.335927 10189 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 0.
I20260709 13:15:48.336352 10453 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.336992 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:48.337544 10455 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:48.337896 10455 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.338198 10455 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.345279 10455 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.347095 10455 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:48.348151 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:15:48.348325 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:48.348824 10189 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.348948 10111 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.354151 10189 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:48.359652 10003 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:48.360417 10453 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:48.360868 10453 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:15:48.361670 10453 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.362126 10519 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.383200 10615 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.383682 10615 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.385033 10111 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:15:48.385859 10615 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.388051 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.388703 10111 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:48.389990 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:48.391242 10528 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:48.391585 10528 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.391930 10528 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.392026 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:48.396539 10035 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:48.399041 10528 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.401479 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:48.401767 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:48.401984 10035 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.402086 10528 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.407526 10035 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.406782 10455 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.408751 10108 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.410745 10455 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.411816  9937 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.411291 10455 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.415112 10108 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.416127 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:15:48.416945 10615 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:48.417369 10615 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:48.417541 10443 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.417951 10443 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.418155 10615 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.419833 10443 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.420831 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.421972 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:48.426551 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:48.428164 10279 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.433688 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.436077 10108 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 1: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:15:48.440903 10186 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.447974  9937 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.433755 10455 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:48.457302 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:15:48.458792 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:15:48.460196 10453 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.464387 10455 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.467002 10453 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.475361 10528 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.502138 10615 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.536412 10279 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.536859 10279 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.541577 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:15:48.542150 10040 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:48.544633 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:48.545297 10615 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:48.545421 10279 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.545729 10615 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:48.545444  9986 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:48.551000 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:15:48.553840 10107 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 0.
I20260709 13:15:48.546445 10615 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.560389 10528 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.566610 10615 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.568557 10615 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:48.569375 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:15:48.569880 10035 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.570143 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:15:48.570665 10107 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.574831 10035 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.575424 10107 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:15:48.580291 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:15:48.581080 10615 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:48.581820 10615 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:15:48.582914 10615 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:15:48.592087 10528 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.603721 10615 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.627615  9937 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.634670 10443 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.749958 10453 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.761533 10453 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.825918 10332 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.835582 10615 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:49.110333 10615 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:49.118671 10528 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:49.697492  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:49.724414 10671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:49.726061 10670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:49.732587 10673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:49.737346  8939 server_base.cc:1061] running on GCE node
I20260709 13:15:49.739061  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:49.739406  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:49.739620  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783602949739594 us; error 0 us; skew 500 ppm
I20260709 13:15:49.740327  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:49.747920  8939 webserver.cc:533] Webserver started at http://127.8.186.196:34611/ using document root <none> and password file <none>
I20260709 13:15:49.748447  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:49.748646  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:49.749024  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:49.750958  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-3-root/instance:
uuid: "2f672b54d4754c5aa62b5b919597a14e"
format_stamp: "Formatted at 2026-07-09 13:15:49 on dist-test-slave-mq27"
I20260709 13:15:49.758952  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:49.763080 10678 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:49.763911  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:49.764212  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-3-root
uuid: "2f672b54d4754c5aa62b5b919597a14e"
format_stamp: "Formatted at 2026-07-09 13:15:49 on dist-test-slave-mq27"
I20260709 13:15:49.764492  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:49.800434  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:49.802394  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:49.804205  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:49.806952  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:49.807227  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:49.807500  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:49.807720  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:49.873972  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.196:41001
I20260709 13:15:49.874083 10740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.196:41001 every 8 connection(s)
I20260709 13:15:49.892812  8939 auto_leader_rebalancer-test.cc:384] add a tserver: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:49.902685 10741 heartbeater.cc:344] Connected to a master server at 127.8.186.254:36577
I20260709 13:15:49.903224 10741 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:49.904129 10741 heartbeater.cc:507] Master 127.8.186.254:36577 requested a full tablet report, sending...
I20260709 13:15:49.906303  9937 ts_manager.cc:194] Registered new tserver with Master: 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:15:49.907943  9937 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50970
I20260709 13:15:50.672827 10107 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:50.681180 10189 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.683007 10518 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.691171 10036 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.692611 10518 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.696605 10518 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
W20260709 13:15:50.705289 10079 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 342754e0259d4d1197a5da7433555a8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.709046 10189 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.718744  9937 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.736018 10036 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.737437 10189 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:50.753805 10036 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.755472 10528 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.757972 10108 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.759452 10528 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.772126 10615 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
W20260709 13:15:50.774437 10153 consensus_peers.cc:597] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 778034d202c94f46bfe767ecaf503d1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.775717 10035 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.793408 10108 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.795012  9936 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.820437 10036 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:50.828146 10189 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.829566 10108 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.830677 10745 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.831681 10669 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.847445 10669 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
W20260709 13:15:50.850075 10004 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a31abbd8853749ac891b56f5989949b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.849697 10189 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.852402 10111 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.878142 10036 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:50.884187  9937 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.895714 10111 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:50.895880 10189 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:50.895972 10004 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 085543d3b9b94f2d806b9cd16489951a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.897464 10453 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.899224 10453 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.911389 10741 heartbeater.cc:499] Master 127.8.186.254:36577 was elected leader, sending a full tablet report...
I20260709 13:15:50.916952 10745 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.921262 10186 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.930536 10111 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:50.937325  9936 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.196733 10773 ts_tablet_manager.cc:933] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:51.202775 10773 tablet_copy_client.cc:323] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:15:51.214646 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 778034d202c94f46bfe767ecaf503d1e from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:15:51.215297 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 778034d202c94f46bfe767ecaf503d1e from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-778034d202c94f46bfe767ecaf503d1e
I20260709 13:15:51.223675 10199 tablet_copy_source_session.cc:215] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:51.229247 10773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778034d202c94f46bfe767ecaf503d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.243534 10773 tablet_copy_client.cc:806] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:51.244297 10773 tablet_copy_client.cc:670] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:51.249251 10776 ts_tablet_manager.cc:933] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:51.251657 10773 tablet_copy_client.cc:538] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:51.261583 10773 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:51.262347 10776 tablet_copy_client.cc:323] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.193:38563
I20260709 13:15:51.273854 10778 ts_tablet_manager.cc:933] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:51.282554 10050 tablet_copy_service.cc:140] P 9a67604b91f54791b1316fd327793337: Received BeginTabletCopySession request for tablet a31abbd8853749ac891b56f5989949b0 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:55698)
I20260709 13:15:51.283242 10050 tablet_copy_service.cc:161] P 9a67604b91f54791b1316fd327793337: Beginning new tablet copy session on tablet a31abbd8853749ac891b56f5989949b0 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:55698: session id = 2f672b54d4754c5aa62b5b919597a14e-a31abbd8853749ac891b56f5989949b0
I20260709 13:15:51.293433 10050 tablet_copy_source_session.cc:215] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:51.297326 10778 tablet_copy_client.cc:323] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:15:51.308976 10776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31abbd8853749ac891b56f5989949b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.354629 10773 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:51.370615 10773 tablet_bootstrap.cc:492] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:51.378954 10773 ts_tablet_manager.cc:1403] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.017s
I20260709 13:15:51.382613 10773 raft_consensus.cc:359] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.388060 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet 342754e0259d4d1197a5da7433555a8b from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:15:51.388731 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet 342754e0259d4d1197a5da7433555a8b from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-342754e0259d4d1197a5da7433555a8b
I20260709 13:15:51.383642 10773 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
W20260709 13:15:51.438824 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 127943us
W20260709 13:15:51.492835 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 96977.6us
I20260709 13:15:51.524523 10125 tablet_copy_source_session.cc:215] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:51.520385 10773 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.554440 10776 tablet_copy_client.cc:806] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:51.555104 10776 tablet_copy_client.cc:670] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:51.556582 10785 ts_tablet_manager.cc:933] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:51.573547 10778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342754e0259d4d1197a5da7433555a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.598575 10778 tablet_copy_client.cc:806] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:51.599162 10778 tablet_copy_client.cc:670] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:51.620523 10778 tablet_copy_client.cc:538] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:51.627105 10773 ts_tablet_manager.cc:1434] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.248s	user 0.013s	sys 0.012s
I20260709 13:15:51.629567 10778 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:51.632117 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-778034d202c94f46bfe767ecaf503d1e received from {username='slave'} at 127.0.0.1:47762
I20260709 13:15:51.632644 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-778034d202c94f46bfe767ecaf503d1e on tablet 778034d202c94f46bfe767ecaf503d1e with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:51.643843 10785 tablet_copy_client.cc:323] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.193:38563
I20260709 13:15:51.646276 10776 tablet_copy_client.cc:538] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:51.684852 10776 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:51.694289 10050 tablet_copy_service.cc:140] P 9a67604b91f54791b1316fd327793337: Received BeginTabletCopySession request for tablet 085543d3b9b94f2d806b9cd16489951a from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:55698)
I20260709 13:15:51.694921 10050 tablet_copy_service.cc:161] P 9a67604b91f54791b1316fd327793337: Beginning new tablet copy session on tablet 085543d3b9b94f2d806b9cd16489951a from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:55698: session id = 2f672b54d4754c5aa62b5b919597a14e-085543d3b9b94f2d806b9cd16489951a
I20260709 13:15:51.704700 10716 raft_consensus.cc:1217] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:51.705137 10050 tablet_copy_source_session.cc:215] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:51.712522 10785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085543d3b9b94f2d806b9cd16489951a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.732705 10785 tablet_copy_client.cc:806] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:51.733373 10785 tablet_copy_client.cc:670] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:51.740455 10778 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:51.741353 10778 tablet_bootstrap.cc:492] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:51.742058 10778 ts_tablet_manager.cc:1403] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.045s
I20260709 13:15:51.745138 10778 raft_consensus.cc:359] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.746019 10778 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:51.746708 10778 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.749111 10778 ts_tablet_manager.cc:1434] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:51.756412 10785 tablet_copy_client.cc:538] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:51.757612 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-342754e0259d4d1197a5da7433555a8b received from {username='slave'} at 127.0.0.1:53672
I20260709 13:15:51.758056 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-342754e0259d4d1197a5da7433555a8b on tablet 342754e0259d4d1197a5da7433555a8b with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:51.760664 10776 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:51.761559 10776 tablet_bootstrap.cc:492] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:51.762248 10776 ts_tablet_manager.cc:1403] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.008s
I20260709 13:15:51.765196 10776 raft_consensus.cc:359] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.766031 10776 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:51.766146 10785 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:51.766712 10776 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.769428 10776 ts_tablet_manager.cc:1434] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:51.771916 10050 tablet_copy_service.cc:342] P 9a67604b91f54791b1316fd327793337: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-a31abbd8853749ac891b56f5989949b0 received from {username='slave'} at 127.0.0.1:55698
I20260709 13:15:51.772542 10050 tablet_copy_service.cc:434] P 9a67604b91f54791b1316fd327793337: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-a31abbd8853749ac891b56f5989949b0 on tablet a31abbd8853749ac891b56f5989949b0 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:51.802309 10785 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:51.803028 10785 tablet_bootstrap.cc:492] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:51.803627 10785 ts_tablet_manager.cc:1403] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.018s
I20260709 13:15:51.806246 10785 raft_consensus.cc:359] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.807050 10785 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:51.807650 10785 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:51.809751 10785 ts_tablet_manager.cc:1434] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:51.811177 10050 tablet_copy_service.cc:342] P 9a67604b91f54791b1316fd327793337: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-085543d3b9b94f2d806b9cd16489951a received from {username='slave'} at 127.0.0.1:55698
I20260709 13:15:51.811582 10050 tablet_copy_service.cc:434] P 9a67604b91f54791b1316fd327793337: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-085543d3b9b94f2d806b9cd16489951a on tablet 085543d3b9b94f2d806b9cd16489951a with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:51.887880 10716 raft_consensus.cc:1217] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:51.919643 10716 raft_consensus.cc:1217] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:52.148741 10791 raft_consensus.cc:1064] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:52.155224 10791 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.164225 10716 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.165540 10037 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.165927 10107 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.166605 10791 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.169344 10746 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.170305 10747 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.189112 10746 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.190974 10037 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.193794 10716 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.205636 10107 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.212422  9935 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.256646 10716 raft_consensus.cc:1217] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:52.257225 10186 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.283851 10716 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.288810 10107 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.289696 10746 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.290793 10791 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.307780 10787 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.315021 10107 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.323944  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 778034d202c94f46bfe767ecaf503d1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:52.327566 10716 raft_consensus.cc:2955] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.333724  9935 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.352571 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 778034d202c94f46bfe767ecaf503d1e with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:15:52.356861 10807 tablet_replica.cc:333] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:15:52.357642 10807 raft_consensus.cc:2243] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.358265 10807 raft_consensus.cc:2272] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.361419 10807 ts_tablet_manager.cc:1916] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:52.376734 10807 ts_tablet_manager.cc:1929] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:52.377213 10807 log.cc:1199] T 778034d202c94f46bfe767ecaf503d1e P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/778034d202c94f46bfe767ecaf503d1e
I20260709 13:15:52.379419  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 778034d202c94f46bfe767ecaf503d1e (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:52.411787 10789 raft_consensus.cc:1064] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:52.414515 10789 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.439484 10716 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.440884 10186 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.440930 10809 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:52.444314 10745 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.481835 10112 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.483817 10809 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.487159 10745 raft_consensus.cc:1064] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:52.490176 10745 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.526121 10809 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.532178 10186 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.562057  9936 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.586143 10715 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.585440 10716 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.591825 10810 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:52.616426 10107 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.619530 10810 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.623265 10186 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.644991 10518 raft_consensus.cc:1064] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:52.609223 10112 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.647461 10518 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.679363 10037 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.685441 10789 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.697376 10716 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.702272 10809 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.714490 10186 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.715922 10813 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:52.727120 10189 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.725629 10819 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.748826 10715 raft_consensus.cc:2955] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.751058 10813 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.752727  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 085543d3b9b94f2d806b9cd16489951a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:52.754791 10716 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.756304  9938 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.757170 10040 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.757308 10790 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.762331 10189 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.762980 10790 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:52.766664 10189 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.769318 10714 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.776638 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet 085543d3b9b94f2d806b9cd16489951a with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:15:52.775895 10790 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:52.786252 10827 tablet_replica.cc:333] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:15:52.787354 10827 raft_consensus.cc:2243] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.788116 10827 raft_consensus.cc:2272] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.794073 10827 ts_tablet_manager.cc:1916] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:52.803450 10112 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.813594 10823 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.819413  9937 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.824689 10186 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.826161 10715 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.838550 10037 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.842118  9935 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.851375 10827 ts_tablet_manager.cc:1929] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:52.852002 10827 log.cc:1199] T 085543d3b9b94f2d806b9cd16489951a P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/085543d3b9b94f2d806b9cd16489951a
I20260709 13:15:52.854403  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet 085543d3b9b94f2d806b9cd16489951a (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:52.866772 10112 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.874118 10035 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:52.879338 10035 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.880831 10518 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.882092 10716 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.884327 10715 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.885802 10518 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.887677 10819 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.888538 10790 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.893030 10035 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.897083 10186 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:52.899844 10809 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.901363 10716 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.901464 10714 raft_consensus.cc:2955] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.903548 10813 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:52.906620  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 342754e0259d4d1197a5da7433555a8b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:52.913640  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a31abbd8853749ac891b56f5989949b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:52.918788 10189 raft_consensus.cc:2955] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.930188  9938 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:52.952032  9935 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.959039 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet 342754e0259d4d1197a5da7433555a8b with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:15:52.976393 10829 tablet_replica.cc:333] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:15:52.977387 10829 raft_consensus.cc:2243] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.978112 10829 raft_consensus.cc:2272] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.981748 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet a31abbd8853749ac891b56f5989949b0 with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:15:52.982684 10827 tablet_replica.cc:333] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:15:52.985638 10829 ts_tablet_manager.cc:1916] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:52.994016 10827 raft_consensus.cc:2243] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:52.994778 10827 raft_consensus.cc:2272] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:52.998026 10827 ts_tablet_manager.cc:1916] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:53.001228 10829 ts_tablet_manager.cc:1929] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:53.001684 10829 log.cc:1199] T 342754e0259d4d1197a5da7433555a8b P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/342754e0259d4d1197a5da7433555a8b
I20260709 13:15:53.003676  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet 342754e0259d4d1197a5da7433555a8b (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:53.011143 10827 ts_tablet_manager.cc:1929] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:53.011525 10827 log.cc:1199] T a31abbd8853749ac891b56f5989949b0 P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/a31abbd8853749ac891b56f5989949b0
I20260709 13:15:53.012672  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet a31abbd8853749ac891b56f5989949b0 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:54.045320 10186 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.053036 10112 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:54.053778 10035 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:54.054191 10153 consensus_peers.cc:597] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b5bb7b33f6c4f0da898f288eb770258. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.055050 10746 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.056099 10791 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.063297 10787 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.064803 10040 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.067030 10112 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.083303  9938 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.090876 10112 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.100158 10186 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:54.100670 10079 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a17d1dcb93ee43aeb594457df0185659. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.101311 10831 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.101724 10040 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:54.103250 10837 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.109460 10831 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.113620 10186 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.116698 10040 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.135777 10037 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.140112  9936 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.152369 10186 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:54.153977 10830 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:54.155684 10004 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9fbf8d873bf4f76894423df3dee3e74. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.154045 10112 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:54.158672 10830 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.168620 10832 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.170382 10112 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.170600 10186 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.185698  9938 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.186044 10112 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:15:54.199255 10079 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b57d4d09773c44b6b5b6a6c1002cf19f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.200767 10037 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:54.201107 10186 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:54.202265 10790 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.203244 10831 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.215693 10831 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.217783 10037 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.218093 10186 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:54.232172  9935 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.504343 10852 ts_tablet_manager.cc:933] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:54.506376 10852 tablet_copy_client.cc:323] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:15:54.508042 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet a17d1dcb93ee43aeb594457df0185659 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:15:54.508481 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet a17d1dcb93ee43aeb594457df0185659 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-a17d1dcb93ee43aeb594457df0185659
I20260709 13:15:54.513958 10125 tablet_copy_source_session.cc:215] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:54.518256 10852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d1dcb93ee43aeb594457df0185659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:54.528787 10852 tablet_copy_client.cc:806] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:54.529326 10852 tablet_copy_client.cc:670] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:54.532359 10852 tablet_copy_client.cc:538] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:54.538324 10852 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:54.559346 10852 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:54.560361 10852 tablet_bootstrap.cc:492] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:54.561002 10852 ts_tablet_manager.cc:1403] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.009s
I20260709 13:15:54.563862 10852 raft_consensus.cc:359] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.564672 10852 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:54.565292 10852 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.572403 10852 ts_tablet_manager.cc:1434] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:15:54.575465 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-a17d1dcb93ee43aeb594457df0185659 received from {username='slave'} at 127.0.0.1:53672
I20260709 13:15:54.575932 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-a17d1dcb93ee43aeb594457df0185659 on tablet a17d1dcb93ee43aeb594457df0185659 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:54.613623 10852 ts_tablet_manager.cc:933] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:54.616504 10856 ts_tablet_manager.cc:933] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:15:54.627626 10852 tablet_copy_client.cc:323] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:15:54.629376 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 8b5bb7b33f6c4f0da898f288eb770258 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:15:54.629905 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 8b5bb7b33f6c4f0da898f288eb770258 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-8b5bb7b33f6c4f0da898f288eb770258
I20260709 13:15:54.642822 10199 tablet_copy_source_session.cc:215] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:54.646669 10852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bb7b33f6c4f0da898f288eb770258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:54.652410 10856 tablet_copy_client.cc:323] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:15:54.654057 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet b57d4d09773c44b6b5b6a6c1002cf19f from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:15:54.654597 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet b57d4d09773c44b6b5b6a6c1002cf19f from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-b57d4d09773c44b6b5b6a6c1002cf19f
I20260709 13:15:54.661789 10125 tablet_copy_source_session.cc:215] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:54.663103 10852 tablet_copy_client.cc:806] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:54.663678 10852 tablet_copy_client.cc:670] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:54.664839 10856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57d4d09773c44b6b5b6a6c1002cf19f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:54.670763 10852 tablet_copy_client.cc:538] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:54.679615 10852 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:54.681653 10856 tablet_copy_client.cc:806] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:54.684351 10856 tablet_copy_client.cc:670] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:54.693492 10856 tablet_copy_client.cc:538] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:54.702284 10852 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:54.704016 10852 tablet_bootstrap.cc:492] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:54.705538 10852 ts_tablet_manager.cc:1403] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:15:54.709661 10852 raft_consensus.cc:359] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.710938 10852 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:54.711570 10852 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.714141 10852 ts_tablet_manager.cc:1434] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:54.716068 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-8b5bb7b33f6c4f0da898f288eb770258 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:15:54.716495 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-8b5bb7b33f6c4f0da898f288eb770258 on tablet 8b5bb7b33f6c4f0da898f288eb770258 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:54.717111 10856 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:54.737393 10856 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:54.738279 10856 tablet_bootstrap.cc:492] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:54.739046 10856 ts_tablet_manager.cc:1403] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:15:54.741998 10856 raft_consensus.cc:359] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.742712 10856 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:54.743397 10856 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.745601 10856 ts_tablet_manager.cc:1434] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:15:54.747664 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-b57d4d09773c44b6b5b6a6c1002cf19f received from {username='slave'} at 127.0.0.1:53672
I20260709 13:15:54.748005 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-b57d4d09773c44b6b5b6a6c1002cf19f on tablet b57d4d09773c44b6b5b6a6c1002cf19f with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:54.758414 10856 ts_tablet_manager.cc:933] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:54.759953 10856 tablet_copy_client.cc:323] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.193:38563
I20260709 13:15:54.761504 10050 tablet_copy_service.cc:140] P 9a67604b91f54791b1316fd327793337: Received BeginTabletCopySession request for tablet a9fbf8d873bf4f76894423df3dee3e74 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:55698)
I20260709 13:15:54.762012 10050 tablet_copy_service.cc:161] P 9a67604b91f54791b1316fd327793337: Beginning new tablet copy session on tablet a9fbf8d873bf4f76894423df3dee3e74 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:55698: session id = 2f672b54d4754c5aa62b5b919597a14e-a9fbf8d873bf4f76894423df3dee3e74
I20260709 13:15:54.769272 10050 tablet_copy_source_session.cc:215] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:54.772257 10856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fbf8d873bf4f76894423df3dee3e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:54.787179 10856 tablet_copy_client.cc:806] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:54.787719 10856 tablet_copy_client.cc:670] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:54.791136 10856 tablet_copy_client.cc:538] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:54.799589 10856 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:54.819159 10856 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:54.820026 10856 tablet_bootstrap.cc:492] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:54.820662 10856 ts_tablet_manager.cc:1403] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.003s
I20260709 13:15:54.823431 10856 raft_consensus.cc:359] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.824262 10856 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:54.824865 10856 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:54.827461 10856 ts_tablet_manager.cc:1434] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:54.841632 10050 tablet_copy_service.cc:342] P 9a67604b91f54791b1316fd327793337: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-a9fbf8d873bf4f76894423df3dee3e74 received from {username='slave'} at 127.0.0.1:55698
I20260709 13:15:54.842092 10050 tablet_copy_service.cc:434] P 9a67604b91f54791b1316fd327793337: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-a9fbf8d873bf4f76894423df3dee3e74 on tablet a9fbf8d873bf4f76894423df3dee3e74 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:54.941022 10716 raft_consensus.cc:1217] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:55.063228 10716 raft_consensus.cc:1217] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:55.089071 10716 raft_consensus.cc:1217] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:55.280066 10716 raft_consensus.cc:1217] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:55.434319 10831 raft_consensus.cc:1064] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:55.436452 10831 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.442502 10791 raft_consensus.cc:1064] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:55.444808 10791 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.452752 10716 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.453563 10037 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.456311 10186 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.458019 10831 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.460187 10112 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.461902 10790 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.462527 10746 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.463652 10790 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.469911 10716 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.472589 10787 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.479029 10040 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.481063 10787 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.509987 10831 raft_consensus.cc:1064] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:55.546114 10831 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.545733 10790 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.552193 10746 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.562928 10036 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.579031 10186 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.582820 10189 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.579998 10716 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.584142 10040 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.589558 10837 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.599053 10837 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.602833 10716 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.605396  9936 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.617978 10036 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.613673 10112 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:15:55.650156 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62024.3us
W20260709 13:15:55.640096 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 54101.9us
I20260709 13:15:55.661489 10876 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.664279 10714 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:15:55.685367 10873 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:55.691021  9934 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.694173 10848 raft_consensus.cc:1064] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:55.697034 10848 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.715229 10876 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.721479 10716 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.739001 10040 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.744691 10716 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.743785 10186 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.749591 10863 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.765990 10112 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.767290 10186 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.771710 10848 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.772547 10863 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.791953 10848 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.793287  9936 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.811110 10716 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.813782 10108 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.834640 10186 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.839093 10113 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.845301  9935 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.847002 10716 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.849036 10035 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.848838 10875 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.850409 10876 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.850910 10186 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.846419 10108 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.857890 10876 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.860739 10113 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.861865 10715 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.861364 10035 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.863600 10837 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.864032 10040 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.866443 10866 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.868592 10790 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.873014 10714 raft_consensus.cc:2955] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.876502 10036 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:55.880986 10837 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.883620 10715 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.891093  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b57d4d09773c44b6b5b6a6c1002cf19f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:55.892468 10186 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.892479 10714 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.893810 10848 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.898111 10848 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.901281 10863 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.902043  9938 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.906471 10188 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.906751 10787 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.908407 10111 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.915956  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a9fbf8d873bf4f76894423df3dee3e74 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:55.925360  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a17d1dcb93ee43aeb594457df0185659 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:55.926549 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet b57d4d09773c44b6b5b6a6c1002cf19f with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:15:55.925866 10714 raft_consensus.cc:2955] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.936803  9938 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.861857 10716 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:55.944322 10791 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:55.949404 10714 raft_consensus.cc:2955] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.953378  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b5bb7b33f6c4f0da898f288eb770258 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:55.955117  9936 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.957132 10178 tablet_service.cc:1558] Processing DeleteTablet for tablet a17d1dcb93ee43aeb594457df0185659 with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:15:55.966945  9938 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.972731 10891 tablet_replica.cc:333] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:15:55.974701 10891 raft_consensus.cc:2243] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.974436 10035 raft_consensus.cc:2955] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:55.975469 10891 raft_consensus.cc:2272] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.978875 10891 ts_tablet_manager.cc:1916] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:55.987578 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet a9fbf8d873bf4f76894423df3dee3e74 with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:15:55.996174 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b5bb7b33f6c4f0da898f288eb770258 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:15:56.000454 10891 ts_tablet_manager.cc:1929] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:56.000986 10891 log.cc:1199] T b57d4d09773c44b6b5b6a6c1002cf19f P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/b57d4d09773c44b6b5b6a6c1002cf19f
I20260709 13:15:56.003049 10891 tablet_replica.cc:333] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:15:56.003486  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet b57d4d09773c44b6b5b6a6c1002cf19f (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:56.004010 10891 raft_consensus.cc:2243] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:56.004781 10891 raft_consensus.cc:2272] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:56.008077 10891 ts_tablet_manager.cc:1916] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:56.010942 10893 tablet_replica.cc:333] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:15:56.011920 10893 raft_consensus.cc:2243] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:56.012617 10893 raft_consensus.cc:2272] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:56.014776 10894 tablet_replica.cc:333] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:15:56.017441 10894 raft_consensus.cc:2243] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:56.018086 10894 raft_consensus.cc:2272] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:56.018229 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46918.9us
I20260709 13:15:56.019831 10893 ts_tablet_manager.cc:1916] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:56.023420 10891 ts_tablet_manager.cc:1929] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:56.023840 10891 log.cc:1199] T a17d1dcb93ee43aeb594457df0185659 P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/a17d1dcb93ee43aeb594457df0185659
I20260709 13:15:56.030104 10894 ts_tablet_manager.cc:1916] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:56.040656  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet a17d1dcb93ee43aeb594457df0185659 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:56.042091 10893 ts_tablet_manager.cc:1929] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:56.042507 10893 log.cc:1199] T a9fbf8d873bf4f76894423df3dee3e74 P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/a9fbf8d873bf4f76894423df3dee3e74
I20260709 13:15:56.044193  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet a9fbf8d873bf4f76894423df3dee3e74 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:56.047288 10894 ts_tablet_manager.cc:1929] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:56.047688 10894 log.cc:1199] T 8b5bb7b33f6c4f0da898f288eb770258 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/8b5bb7b33f6c4f0da898f288eb770258
I20260709 13:15:56.049284  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 8b5bb7b33f6c4f0da898f288eb770258 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:57.077895 10186 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.084291 10108 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.084309 10035 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:57.084878 10153 consensus_peers.cc:597] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11d1d6b12e0b4e5b9006189784101119. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.085898 10892 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.086882 10787 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.098599 10787 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.100216 10035 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.102174 10108 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.114900 10036 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.116693  9934 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.132108 10186 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.133900 10863 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:57.138346 10004 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d2bb95bebdf4e86b0b5a76ee511bbee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.143940 10113 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.146267 10863 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.151254 10863 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.157079 10186 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.172636  9935 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.174045 10186 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.173943 10113 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
W20260709 13:15:57.187803 10153 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6e8de93fa794635a32ba4eb6cdc82ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.188892 10113 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.189013 10036 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.190279 10787 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.192058 10787 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.199900 10787 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.201972 10113 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.210793 10036 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.220559  9935 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.222064 10186 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:15:57.229054 10153 consensus_peers.cc:597] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c62c17c1a96045a9a7d8729d053776f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.229243 10113 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.229629 10036 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:57.230752 10892 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.231712 10746 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.241645 10746 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.243593 10036 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.246606 10113 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.261018  9936 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:15:57.514988 10916 ts_tablet_manager.cc:933] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:15:57.517256 10916 tablet_copy_client.cc:323] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.193:38563
I20260709 13:15:57.519138 10050 tablet_copy_service.cc:140] P 9a67604b91f54791b1316fd327793337: Received BeginTabletCopySession request for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:55698)
I20260709 13:15:57.519728 10050 tablet_copy_service.cc:161] P 9a67604b91f54791b1316fd327793337: Beginning new tablet copy session on tablet 1d2bb95bebdf4e86b0b5a76ee511bbee from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:55698: session id = 2f672b54d4754c5aa62b5b919597a14e-1d2bb95bebdf4e86b0b5a76ee511bbee
I20260709 13:15:57.526895 10050 tablet_copy_source_session.cc:215] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:57.530426 10916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.544178 10916 tablet_copy_client.cc:806] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:57.544876 10916 tablet_copy_client.cc:670] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:57.549396 10916 tablet_copy_client.cc:538] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:57.549506 10918 ts_tablet_manager.cc:933] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:57.558037 10918 tablet_copy_client.cc:323] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:15:57.560839 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 11d1d6b12e0b4e5b9006189784101119 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:15:57.561388 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 11d1d6b12e0b4e5b9006189784101119 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-11d1d6b12e0b4e5b9006189784101119
I20260709 13:15:57.563561 10916 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:57.586345 10199 tablet_copy_source_session.cc:215] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:57.589507 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d1d6b12e0b4e5b9006189784101119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.599242 10916 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.600455 10916 tablet_bootstrap.cc:492] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:57.601209 10916 ts_tablet_manager.cc:1403] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.012s
I20260709 13:15:57.604943 10916 raft_consensus.cc:359] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.605845 10916 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:57.607460 10916 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.612399 10918 tablet_copy_client.cc:806] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:57.613029 10918 tablet_copy_client.cc:670] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:57.619205 10916 ts_tablet_manager.cc:1434] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:15:57.621417 10050 tablet_copy_service.cc:342] P 9a67604b91f54791b1316fd327793337: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-1d2bb95bebdf4e86b0b5a76ee511bbee received from {username='slave'} at 127.0.0.1:55698
I20260709 13:15:57.621794 10050 tablet_copy_service.cc:434] P 9a67604b91f54791b1316fd327793337: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-1d2bb95bebdf4e86b0b5a76ee511bbee on tablet 1d2bb95bebdf4e86b0b5a76ee511bbee with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:57.625325 10918 tablet_copy_client.cc:538] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:57.626024 10922 ts_tablet_manager.cc:933] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:57.633437 10922 tablet_copy_client.cc:323] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:15:57.634723 10918 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:57.634819 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet d6e8de93fa794635a32ba4eb6cdc82ca from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:15:57.635349 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet d6e8de93fa794635a32ba4eb6cdc82ca from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-d6e8de93fa794635a32ba4eb6cdc82ca
I20260709 13:15:57.641621 10199 tablet_copy_source_session.cc:215] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:57.644256 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e8de93fa794635a32ba4eb6cdc82ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.665913 10918 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.667100 10918 tablet_bootstrap.cc:492] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:57.667810 10918 ts_tablet_manager.cc:1403] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 13:15:57.670751 10918 raft_consensus.cc:359] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.671550 10918 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:57.672154 10918 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.674247 10918 ts_tablet_manager.cc:1434] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:57.675583 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-11d1d6b12e0b4e5b9006189784101119 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:15:57.676017 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-11d1d6b12e0b4e5b9006189784101119 on tablet 11d1d6b12e0b4e5b9006189784101119 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:57.677335 10922 tablet_copy_client.cc:806] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:57.677918 10922 tablet_copy_client.cc:670] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:57.683615 10922 tablet_copy_client.cc:538] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:57.689357 10922 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:57.708585 10922 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.709198 10922 tablet_bootstrap.cc:492] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:57.709668 10922 ts_tablet_manager.cc:1403] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.003s
I20260709 13:15:57.712007 10922 raft_consensus.cc:359] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.712744 10922 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:57.713402 10922 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.716593 10922 ts_tablet_manager.cc:1434] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:57.718391 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-d6e8de93fa794635a32ba4eb6cdc82ca received from {username='slave'} at 127.0.0.1:47762
I20260709 13:15:57.718788 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-d6e8de93fa794635a32ba4eb6cdc82ca on tablet d6e8de93fa794635a32ba4eb6cdc82ca with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:57.824613 10922 ts_tablet_manager.cc:933] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:15:57.827399 10922 tablet_copy_client.cc:323] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:15:57.828809 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet c62c17c1a96045a9a7d8729d053776f8 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:15:57.829329 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet c62c17c1a96045a9a7d8729d053776f8 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-c62c17c1a96045a9a7d8729d053776f8
I20260709 13:15:57.836745 10199 tablet_copy_source_session.cc:215] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:57.839416 10922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62c17c1a96045a9a7d8729d053776f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:57.851400 10922 tablet_copy_client.cc:806] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:57.852085 10922 tablet_copy_client.cc:670] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:57.863816 10922 tablet_copy_client.cc:538] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:57.872641 10922 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:15:57.888937 10922 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.890077 10922 tablet_bootstrap.cc:492] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:15:57.890733 10922 ts_tablet_manager.cc:1403] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:15:57.893388 10922 raft_consensus.cc:359] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.893965 10922 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:15:57.894470 10922 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:15:57.896337 10922 ts_tablet_manager.cc:1434] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:15:57.898243 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-c62c17c1a96045a9a7d8729d053776f8 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:15:57.898662 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-c62c17c1a96045a9a7d8729d053776f8 on tablet c62c17c1a96045a9a7d8729d053776f8 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:15:58.021220 10715 raft_consensus.cc:1217] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:58.037398 10715 raft_consensus.cc:1217] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:58.067546 10715 raft_consensus.cc:1217] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:58.418100 10715 raft_consensus.cc:1217] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:58.525240 10911 raft_consensus.cc:1064] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:58.527915 10911 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.535633 10715 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.537449 10111 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.540169 10037 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.541292 10892 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.542109 10787 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.543057 10911 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.565511 10863 raft_consensus.cc:1064] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:58.567868 10863 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.569602 10787 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.577800 10714 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.578744 10188 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.580615 10863 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.582700 10928 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.585999 10113 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.592607 10714 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.581758 10111 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.602104 10863 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.607677 10911 raft_consensus.cc:1064] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:58.616086 10911 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.614490  9934 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.663163 10863 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.682001 10188 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.706075 10714 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.707623 10113 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.715929 10787 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.723335 10746 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.725220 10036 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.720696 10037 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.740936 10746 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.750663 10715 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.781078 10942 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.785185 10714 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.800264  9936 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.806684 10113 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.808398 10186 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.816119 10714 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:58.818516 10111 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.819414 10892 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:58.829026  9934 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.835508 10037 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:58.835078 10036 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.838310 10942 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:58.844058 10035 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.845916 10940 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.852281 10714 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:58.853631 10863 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:58.854698 10111 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:58.857595 10715 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.860611 10948 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:58.861192 10037 raft_consensus.cc:2955] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.866618  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6e8de93fa794635a32ba4eb6cdc82ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:58.888013 10188 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.891593 10935 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.900604 10111 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.906725  9936 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.910621 10714 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:58.911360  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:58.913524 10940 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:58.914283 10113 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:58.912851 10715 raft_consensus.cc:2955] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.925312 10911 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:58.926455 10787 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.927325 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet d6e8de93fa794635a32ba4eb6cdc82ca with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:15:58.941318 10714 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.951669 10113 raft_consensus.cc:2955] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.959910  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11d1d6b12e0b4e5b9006189784101119 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:58.953436  9938 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.964963 10746 raft_consensus.cc:1064] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:15:58.965580 10951 tablet_replica.cc:333] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:15:58.966838 10746 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:58.974076  9936 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:58.978247 10951 raft_consensus.cc:2243] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:58.979126 10951 raft_consensus.cc:2272] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:58.987964 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 11d1d6b12e0b4e5b9006189784101119 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:15:58.996518 10715 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:58.997952 10953 tablet_replica.cc:333] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:15:59.007503 10953 raft_consensus.cc:2243] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.008205 10953 raft_consensus.cc:2272] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.001163 10113 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:59.002421 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d2bb95bebdf4e86b0b5a76ee511bbee with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:15:59.003196 10911 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.998446 10037 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:59.004690 10951 ts_tablet_manager.cc:1916] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:59.017102 10940 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:59.027361 10911 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:59.036312 10953 ts_tablet_manager.cc:1916] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:59.039925 10951 ts_tablet_manager.cc:1929] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:59.044731 10951 log.cc:1199] T d6e8de93fa794635a32ba4eb6cdc82ca P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/d6e8de93fa794635a32ba4eb6cdc82ca
I20260709 13:15:59.056573  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet d6e8de93fa794635a32ba4eb6cdc82ca (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:59.069079 10911 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.072355 10954 tablet_replica.cc:333] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:15:59.073611 10954 raft_consensus.cc:2243] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.074467 10954 raft_consensus.cc:2272] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.079667 10954 ts_tablet_manager.cc:1916] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:59.083366 10715 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.088168 10953 ts_tablet_manager.cc:1929] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:59.088774 10953 log.cc:1199] T 11d1d6b12e0b4e5b9006189784101119 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/11d1d6b12e0b4e5b9006189784101119
I20260709 13:15:59.081110 10113 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.090435  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 11d1d6b12e0b4e5b9006189784101119 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:59.097548  9938 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.099900 10954 ts_tablet_manager.cc:1929] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:59.100404 10954 log.cc:1199] T 1d2bb95bebdf4e86b0b5a76ee511bbee P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/1d2bb95bebdf4e86b0b5a76ee511bbee
I20260709 13:15:59.102074  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet 1d2bb95bebdf4e86b0b5a76ee511bbee (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:15:59.108842 10036 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.120486 10189 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:15:59.126426 10715 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:59.128180 10746 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:59.138800 10892 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.140296 10113 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:59.150310 10715 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.154170  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c62c17c1a96045a9a7d8729d053776f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:59.156560 10787 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:59.165720  9938 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.196746 10111 raft_consensus.cc:2955] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:15:59.203028 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet c62c17c1a96045a9a7d8729d053776f8 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:15:59.204022 10953 tablet_replica.cc:333] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:15:59.205132 10953 raft_consensus.cc:2243] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:59.205940 10953 raft_consensus.cc:2272] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:59.213232 10953 ts_tablet_manager.cc:1916] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:59.226569 10953 ts_tablet_manager.cc:1929] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:59.228111 10953 log.cc:1199] T c62c17c1a96045a9a7d8729d053776f8 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/c62c17c1a96045a9a7d8729d053776f8
I20260709 13:15:59.229612  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet c62c17c1a96045a9a7d8729d053776f8 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:00.273672 10111 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.285953 10036 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.286289 10188 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:00.287045 10079 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fe760ac48e44c2d9fce1d214088eb0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.287403 10915 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.288264 10929 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.300952 10915 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.302848 10188 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.303735 10036 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.315177 10189 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.317749  9934 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.328838 10111 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.332357 10911 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:00.334772 10153 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 380d0cf74fa74de9b77a62b31da282f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.335474 10036 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.336902 10911 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.349992 10911 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.353744 10111 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.356879 10036 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.371284 10189 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.379370  9934 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:00.381876 10153 consensus_peers.cc:597] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e34dad81aac43a1aac71ca8c862321d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.382622 10036 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.383931 10942 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.391644 10942 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.398398 10111 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.400035 10892 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.396359 10035 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.412595 10111 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.421054 10113 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.425611  9934 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:00.430065 10079 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc4197bea6d247b289e63500fc5bc56e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.430912 10189 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.432339 10960 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.433143 10035 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:00.434289 10915 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.442230 10915 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.444396 10188 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.449018 10035 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.469427  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:00.700031 10981 ts_tablet_manager.cc:933] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:00.703027 10981 tablet_copy_client.cc:323] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:16:00.704918 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet 4fe760ac48e44c2d9fce1d214088eb0e from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:16:00.705361 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet 4fe760ac48e44c2d9fce1d214088eb0e from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-4fe760ac48e44c2d9fce1d214088eb0e
I20260709 13:16:00.711131 10125 tablet_copy_source_session.cc:215] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:00.713850 10981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe760ac48e44c2d9fce1d214088eb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:00.737216 10981 tablet_copy_client.cc:806] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:00.737747 10981 tablet_copy_client.cc:670] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:00.741269 10981 tablet_copy_client.cc:538] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:00.750317 10981 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:00.770571 10981 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.771428 10981 tablet_bootstrap.cc:492] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:00.772075 10981 ts_tablet_manager.cc:1403] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.004s
I20260709 13:16:00.774916 10981 raft_consensus.cc:359] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.775779 10981 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:00.776443 10981 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.779626 10981 ts_tablet_manager.cc:1434] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:00.781358 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-4fe760ac48e44c2d9fce1d214088eb0e received from {username='slave'} at 127.0.0.1:53672
I20260709 13:16:00.781785 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-4fe760ac48e44c2d9fce1d214088eb0e on tablet 4fe760ac48e44c2d9fce1d214088eb0e with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:00.797924 10981 ts_tablet_manager.cc:933] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:00.799505 10981 tablet_copy_client.cc:323] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:00.800911 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 380d0cf74fa74de9b77a62b31da282f1 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:00.801352 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 380d0cf74fa74de9b77a62b31da282f1 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-380d0cf74fa74de9b77a62b31da282f1
I20260709 13:16:00.806438 10199 tablet_copy_source_session.cc:215] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:00.817010 10981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380d0cf74fa74de9b77a62b31da282f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:00.829931 10981 tablet_copy_client.cc:806] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:00.830516 10981 tablet_copy_client.cc:670] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:00.833776 10981 tablet_copy_client.cc:538] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:00.842972 10981 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:00.876482 10981 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.877280 10981 tablet_bootstrap.cc:492] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:00.877818 10981 ts_tablet_manager.cc:1403] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.020s
I20260709 13:16:00.879923 10981 raft_consensus.cc:359] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.880529 10981 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:00.881222 10981 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:00.883035 10981 ts_tablet_manager.cc:1434] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:00.885285 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-380d0cf74fa74de9b77a62b31da282f1 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:00.885726 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-380d0cf74fa74de9b77a62b31da282f1 on tablet 380d0cf74fa74de9b77a62b31da282f1 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:00.932708 10981 ts_tablet_manager.cc:933] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:00.934342 10981 tablet_copy_client.cc:323] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:00.935726 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 2e34dad81aac43a1aac71ca8c862321d from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:00.936304 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 2e34dad81aac43a1aac71ca8c862321d from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-2e34dad81aac43a1aac71ca8c862321d
I20260709 13:16:00.944218 10199 tablet_copy_source_session.cc:215] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:00.950377 10981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e34dad81aac43a1aac71ca8c862321d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:00.984181 10981 tablet_copy_client.cc:806] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:00.984740 10981 tablet_copy_client.cc:670] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:00.987094 10988 ts_tablet_manager.cc:933] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:00.988411 10981 tablet_copy_client.cc:538] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:00.993547 10988 tablet_copy_client.cc:323] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:16:00.995605 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet dc4197bea6d247b289e63500fc5bc56e from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:16:00.996378 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet dc4197bea6d247b289e63500fc5bc56e from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-dc4197bea6d247b289e63500fc5bc56e
I20260709 13:16:00.997040 10981 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:01.006132 10125 tablet_copy_source_session.cc:215] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:01.009650 10988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4197bea6d247b289e63500fc5bc56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:01.013517 10981 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:01.014371 10981 tablet_bootstrap.cc:492] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:01.014945 10981 ts_tablet_manager.cc:1403] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 13:16:01.020036 10981 raft_consensus.cc:359] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:01.020784 10981 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:01.021347 10981 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:01.026630 10981 ts_tablet_manager.cc:1434] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:01.030067 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-2e34dad81aac43a1aac71ca8c862321d received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:01.030532 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-2e34dad81aac43a1aac71ca8c862321d on tablet 2e34dad81aac43a1aac71ca8c862321d with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:01.039383 10988 tablet_copy_client.cc:806] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:01.040006 10988 tablet_copy_client.cc:670] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:01.044235 10988 tablet_copy_client.cc:538] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:01.050997 10988 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:01.074812 10988 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:01.075714 10988 tablet_bootstrap.cc:492] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:01.076812 10988 ts_tablet_manager.cc:1403] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.010s
I20260709 13:16:01.081327 10988 raft_consensus.cc:359] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:01.082165 10988 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:01.082674 10988 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:01.085290 10988 ts_tablet_manager.cc:1434] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:01.086756 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-dc4197bea6d247b289e63500fc5bc56e received from {username='slave'} at 127.0.0.1:53672
I20260709 13:16:01.087105 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-dc4197bea6d247b289e63500fc5bc56e on tablet dc4197bea6d247b289e63500fc5bc56e with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:01.212078 10716 raft_consensus.cc:1217] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:01.335246 10716 raft_consensus.cc:1217] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:01.417613 10716 raft_consensus.cc:1217] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:01.482867 10716 raft_consensus.cc:1217] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:01.623904 10960 raft_consensus.cc:1064] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:01.626057 10960 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:01.632593 10716 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.634123 10915 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.636358 10036 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.635485 10188 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.638969 10915 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.643231 10960 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.646589 10960 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.652362 10040 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.665416 10716 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.666162 10188 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.683881  9938 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.713374 10108 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:01.719120 10716 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:01.720733 10040 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:01.720795 10997 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:01.722505 10929 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:01.728890 10997 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.730732 10716 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.730799 10035 raft_consensus.cc:2955] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.739192  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fe760ac48e44c2d9fce1d214088eb0e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:01.750844  9934 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.763363 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fe760ac48e44c2d9fce1d214088eb0e with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:16:01.777262 11002 tablet_replica.cc:333] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:16:01.778605 11002 raft_consensus.cc:2243] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:01.779209 11002 raft_consensus.cc:2272] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:01.784520 11002 ts_tablet_manager.cc:1916] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:01.804051 11002 ts_tablet_manager.cc:1929] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:01.804450 11002 log.cc:1199] T 4fe760ac48e44c2d9fce1d214088eb0e P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/4fe760ac48e44c2d9fce1d214088eb0e
I20260709 13:16:01.806643  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet 4fe760ac48e44c2d9fce1d214088eb0e (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:01.882735 10997 raft_consensus.cc:1064] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:01.885228 10997 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:01.886098 10980 raft_consensus.cc:1064] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:01.888849 10980 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:01.900202 10040 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.902468 10716 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.905249 10188 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.906419 10040 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.901803 10997 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:16:01.907634 10960 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.909004 10915 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.914973 10108 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.916641 10892 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.918308 10892 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.919657 10715 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:01.943598 10892 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.961915 10915 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.963541 10036 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.979660 10716 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:01.987052  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:16:01.997077 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 57213.8us
I20260709 13:16:02.006558 10188 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.010673 10111 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:02.015338 10892 raft_consensus.cc:1064] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:02.018445 10892 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:02.029039 10040 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:02.031708 10915 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:02.034185 10714 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:02.039366 10929 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.040578 10036 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.044260 10960 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:02.050405 10037 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:02.051769 11010 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:02.053344  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc4197bea6d247b289e63500fc5bc56e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:02.064513 10716 raft_consensus.cc:2955] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.066567 10111 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:02.067405 10714 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:02.071363 10892 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:02.078742 11011 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:02.079607 11008 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.080500  9934 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:02.132001 10716 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.134402 10040 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.161248  9934 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.161573 11010 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.164646 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet dc4197bea6d247b289e63500fc5bc56e with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:16:02.165654 11002 tablet_replica.cc:333] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:16:02.166651 11002 raft_consensus.cc:2243] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:02.167285 11002 raft_consensus.cc:2272] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:02.173291 11002 ts_tablet_manager.cc:1916] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:02.187975 10108 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.188149 10111 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.193182 10040 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.205775 11002 ts_tablet_manager.cc:1929] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:02.206453 11002 log.cc:1199] T dc4197bea6d247b289e63500fc5bc56e P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/dc4197bea6d247b289e63500fc5bc56e
I20260709 13:16:02.209887  9935 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.215488  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet dc4197bea6d247b289e63500fc5bc56e (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:02.220332 10714 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.224325 10188 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:02.228397 10716 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:02.230001 10040 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:02.231609 11011 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:02.232445 10965 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:02.241729 10040 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.240347 11010 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.253556 10714 raft_consensus.cc:2955] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.261062 10188 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:02.264962  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 380d0cf74fa74de9b77a62b31da282f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:02.268136 10716 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:02.278215  9936 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.281002 10111 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:02.285051 10965 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:02.289762 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet 380d0cf74fa74de9b77a62b31da282f1 with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:16:02.297916 11011 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:02.304039 10892 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.305845 10716 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.317979  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e34dad81aac43a1aac71ca8c862321d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:02.320308 11020 tablet_replica.cc:333] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:16:02.321444 11020 raft_consensus.cc:2243] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:02.321110 10111 raft_consensus.cc:2955] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.322142 11020 raft_consensus.cc:2272] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:02.326428 11020 ts_tablet_manager.cc:1916] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:02.328981  9935 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:02.340368 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e34dad81aac43a1aac71ca8c862321d with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:02.356611 11021 tablet_replica.cc:333] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:16:02.357682 11021 raft_consensus.cc:2243] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:02.358526 11021 raft_consensus.cc:2272] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:02.361107 11021 ts_tablet_manager.cc:1916] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:02.364271 11020 ts_tablet_manager.cc:1929] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:02.364743 11020 log.cc:1199] T 380d0cf74fa74de9b77a62b31da282f1 P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/380d0cf74fa74de9b77a62b31da282f1
I20260709 13:16:02.366410  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet 380d0cf74fa74de9b77a62b31da282f1 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:02.373174 11021 ts_tablet_manager.cc:1929] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:02.373535 11021 log.cc:1199] T 2e34dad81aac43a1aac71ca8c862321d P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/2e34dad81aac43a1aac71ca8c862321d
I20260709 13:16:02.374792  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 2e34dad81aac43a1aac71ca8c862321d (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:03.400741 10188 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:03.406816 10153 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fbda83574ee42f494a2a55e59683596. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.407048 10034 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:03.407786 10111 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:03.409020 11010 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.409909 11024 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.418731 11024 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.420706 10040 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.422752 10113 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.437906  9936 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.457181 10186 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.463558 10040 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:03.463950 10153 consensus_peers.cc:597] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 811060649d664704b4b7ab08b2d4a419. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.465556 11010 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.466648 10113 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:03.468209 11010 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.479574 11022 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.485364 10040 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.490599 10111 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.512205 10186 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.512730  9935 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.525918 10113 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:03.527123 10153 consensus_peers.cc:597] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8352b62df8ae441f825cf2075b4f63cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.531400 11036 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.536998 10040 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:03.539346 11010 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.541128 11010 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.544453 10111 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.548734 10036 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.558329 10188 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.559005  9936 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.573748 10111 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:03.574153 10153 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4a137ce092c4e1f93e053d05a21cb5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:03.577098 11010 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.580883 10040 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:03.582332 11037 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.586344 11010 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.587939 10111 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.592919 10040 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:03.604305  9935 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.838425 11044 ts_tablet_manager.cc:933] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:03.841347 11044 tablet_copy_client.cc:323] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:03.842831 11046 ts_tablet_manager.cc:933] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:03.843147 10199 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 5fbda83574ee42f494a2a55e59683596 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:03.843676 10199 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 5fbda83574ee42f494a2a55e59683596 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-5fbda83574ee42f494a2a55e59683596
I20260709 13:16:03.844930 11046 tablet_copy_client.cc:323] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:03.846796 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 811060649d664704b4b7ab08b2d4a419 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:03.847319 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 811060649d664704b4b7ab08b2d4a419 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-811060649d664704b4b7ab08b2d4a419
I20260709 13:16:03.851331 10199 tablet_copy_source_session.cc:215] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:03.854065 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbda83574ee42f494a2a55e59683596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:03.854903 10198 tablet_copy_source_session.cc:215] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:03.859185 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811060649d664704b4b7ab08b2d4a419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:03.868121 11044 tablet_copy_client.cc:806] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:03.869997 11044 tablet_copy_client.cc:670] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:03.874687 11044 tablet_copy_client.cc:538] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:03.877288 11046 tablet_copy_client.cc:806] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:03.877858 11046 tablet_copy_client.cc:670] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:03.883414 11044 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:03.883846 11046 tablet_copy_client.cc:538] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:03.893401 11046 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:03.904125 11044 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:03.905143 11044 tablet_bootstrap.cc:492] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:03.906170 11044 ts_tablet_manager.cc:1403] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 13:16:03.909111 11044 raft_consensus.cc:359] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.909972 11044 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:03.910645 11044 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.932013 11044 ts_tablet_manager.cc:1434] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.013s
I20260709 13:16:03.934855 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-5fbda83574ee42f494a2a55e59683596 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:03.935310 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-5fbda83574ee42f494a2a55e59683596 on tablet 5fbda83574ee42f494a2a55e59683596 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:03.946348 11046 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:03.947160 11046 tablet_bootstrap.cc:492] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:03.947834 11046 ts_tablet_manager.cc:1403] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.011s
I20260709 13:16:03.950693 11046 raft_consensus.cc:359] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.951481 11046 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:03.952113 11046 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:03.954149 11046 ts_tablet_manager.cc:1434] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:03.955855 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-811060649d664704b4b7ab08b2d4a419 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:03.956284 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-811060649d664704b4b7ab08b2d4a419 on tablet 811060649d664704b4b7ab08b2d4a419 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:04.089882 11046 ts_tablet_manager.cc:933] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:04.091467 11046 tablet_copy_client.cc:323] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:04.093227 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 8352b62df8ae441f825cf2075b4f63cb from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:04.093770 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 8352b62df8ae441f825cf2075b4f63cb from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-8352b62df8ae441f825cf2075b4f63cb
I20260709 13:16:04.101310 10198 tablet_copy_source_session.cc:215] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:04.103961 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8352b62df8ae441f825cf2075b4f63cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:04.119670 11046 tablet_copy_client.cc:806] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:04.120290 11046 tablet_copy_client.cc:670] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:04.123786 11046 tablet_copy_client.cc:538] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:04.132525 11046 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:04.148833 11044 ts_tablet_manager.cc:933] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:04.153580 11044 tablet_copy_client.cc:323] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:04.155427 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet b4a137ce092c4e1f93e053d05a21cb5c from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:04.156109 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet b4a137ce092c4e1f93e053d05a21cb5c from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-b4a137ce092c4e1f93e053d05a21cb5c
I20260709 13:16:04.159572 11046 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:04.160435 11046 tablet_bootstrap.cc:492] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:04.161098 11046 ts_tablet_manager.cc:1403] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 13:16:04.163774 10198 tablet_copy_source_session.cc:215] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:04.164384 11046 raft_consensus.cc:359] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:04.166182 11046 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:04.166955 11046 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:04.169647 11046 ts_tablet_manager.cc:1434] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:16:04.170228 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a137ce092c4e1f93e053d05a21cb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:04.175938 10199 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-8352b62df8ae441f825cf2075b4f63cb received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:04.176359 10199 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-8352b62df8ae441f825cf2075b4f63cb on tablet 8352b62df8ae441f825cf2075b4f63cb with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:04.184155 11044 tablet_copy_client.cc:806] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:04.184769 11044 tablet_copy_client.cc:670] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:04.187520 11044 tablet_copy_client.cc:538] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:04.196310 11044 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:04.212729 11044 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:04.213421 11044 tablet_bootstrap.cc:492] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:04.213920 11044 ts_tablet_manager.cc:1403] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:16:04.216238 11044 raft_consensus.cc:359] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:04.216815 11044 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:04.217392 11044 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:04.219571 11044 ts_tablet_manager.cc:1434] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:16:04.221599 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-b4a137ce092c4e1f93e053d05a21cb5c received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:04.222010 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-b4a137ce092c4e1f93e053d05a21cb5c on tablet b4a137ce092c4e1f93e053d05a21cb5c with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:04.249079 10716 raft_consensus.cc:1217] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:04.346143 10716 raft_consensus.cc:1217] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:04.518356 10716 raft_consensus.cc:1217] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:04.714735 10716 raft_consensus.cc:1217] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:04.762041 11056 raft_consensus.cc:1064] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:04.765457 11056 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:04.773350 10716 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:04.774075 10113 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:04.775789 11057 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.777608 11057 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.814952 10034 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:04.816569 11056 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.820302 11037 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.831560 10113 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.833506 11010 raft_consensus.cc:1064] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:04.836787 10716 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.838514 11010 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:04.840312  9934 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.870793 10716 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:04.870981 10111 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:04.872134 10040 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:04.872643 11024 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.873704 11056 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.881974 11010 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.886581 10036 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.901270 11024 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.904913 10111 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.933187 10034 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.935652 10716 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.959472  9936 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.978340 10188 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:04.981488 10186 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:04.985554 10716 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:04.986200 10036 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:04.987561 11024 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:04.991310 11010 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:04.992425 10716 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:04.995030 11010 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:04.996721 11024 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:04.997408 10111 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:04.996236 10036 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.003460 11024 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.005967 11057 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.012423 10714 raft_consensus.cc:2955] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.017607  9935 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.029610 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fbda83574ee42f494a2a55e59683596 with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:16:05.032166  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fbda83574ee42f494a2a55e59683596 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:05.033371 10113 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.053020  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 811060649d664704b4b7ab08b2d4a419 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:05.054015 10716 raft_consensus.cc:2955] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.060631  9935 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.068027 11071 tablet_replica.cc:333] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:16:05.087531 11071 raft_consensus.cc:2243] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:05.088249 11071 raft_consensus.cc:2272] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:05.091293 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 811060649d664704b4b7ab08b2d4a419 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:05.094372 11071 ts_tablet_manager.cc:1916] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:05.131827 11072 tablet_replica.cc:333] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:16:05.132977 11072 raft_consensus.cc:2243] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:05.133832 11072 raft_consensus.cc:2272] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:05.134575 11071 ts_tablet_manager.cc:1929] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:05.135063 11071 log.cc:1199] T 5fbda83574ee42f494a2a55e59683596 P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/5fbda83574ee42f494a2a55e59683596
I20260709 13:16:05.137209 11072 ts_tablet_manager.cc:1916] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:05.139875 11024 raft_consensus.cc:1064] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:05.139875  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet 5fbda83574ee42f494a2a55e59683596 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:05.142378 11024 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:05.153730 11072 ts_tablet_manager.cc:1929] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:05.154299 11072 log.cc:1199] T 811060649d664704b4b7ab08b2d4a419 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/811060649d664704b4b7ab08b2d4a419
I20260709 13:16:05.155989  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 811060649d664704b4b7ab08b2d4a419 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:05.162196 10034 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:05.162642 10716 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:05.163612 10108 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:05.165437 11010 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:05.167122 11024 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:05.169481 11057 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:05.186647 11056 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.188447 10036 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.200181 10111 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.209188  9938 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.261946 10714 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.300141 11024 raft_consensus.cc:1064] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:05.306154 11024 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:05.312969 10186 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:05.313983 10111 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:05.315388 10036 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:05.317072 10714 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:05.317520 11037 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:05.318290 11010 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:05.319702 10716 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:05.322485 10111 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:05.323261 11010 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.323616 11057 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:05.325894 11057 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.343959 11056 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.354295 10716 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.358139 10112 raft_consensus.cc:2955] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.367982  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8352b62df8ae441f825cf2075b4f63cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:05.373885  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.392649 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 8352b62df8ae441f825cf2075b4f63cb with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:05.393589 11072 tablet_replica.cc:333] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:16:05.394528 11072 raft_consensus.cc:2243] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:05.395295 11072 raft_consensus.cc:2272] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:05.401409 10036 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.400024 11072 ts_tablet_manager.cc:1916] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:05.396849 11010 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.417156 10714 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.436556 11072 ts_tablet_manager.cc:1929] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:05.436153  9934 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.437076 11072 log.cc:1199] T 8352b62df8ae441f825cf2075b4f63cb P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/8352b62df8ae441f825cf2075b4f63cb
I20260709 13:16:05.440249  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 8352b62df8ae441f825cf2075b4f63cb (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:05.441282 10111 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.479312 10186 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:05.483774 10714 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:05.484772 10036 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:05.485881 11010 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.488739 11024 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.491966 11037 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.502091  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4a137ce092c4e1f93e053d05a21cb5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:05.505025 10714 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.509429 10036 raft_consensus.cc:2955] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.518905  9934 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:05.531133 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet b4a137ce092c4e1f93e053d05a21cb5c with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:16:05.533824 11071 tablet_replica.cc:333] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:16:05.534654 11071 raft_consensus.cc:2243] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:05.535192 11071 raft_consensus.cc:2272] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:05.539023 11071 ts_tablet_manager.cc:1916] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:05.552220 11071 ts_tablet_manager.cc:1929] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:05.552522 11071 log.cc:1199] T b4a137ce092c4e1f93e053d05a21cb5c P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/b4a137ce092c4e1f93e053d05a21cb5c
I20260709 13:16:05.553853  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet b4a137ce092c4e1f93e053d05a21cb5c (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:06.631776 10112 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:06.638604 10034 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:06.639436 10079 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffbced50ff05471aae6f2f593710055e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.638604 10188 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:06.641945 10960 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:06.644338 11051 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:06.652734 10960 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.654042 10188 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.657192 10034 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.672554 10188 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:06.672852  9938 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.681160 10112 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:06.682847 10034 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:06.683825 11082 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:06.684769 10153 consensus_peers.cc:597] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ff24b1804914099b167420853598f48. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.684777 11024 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:06.702593 11010 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.703768 10034 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.709069 10112 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.732442  9938 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.737856 10188 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:06.750479 10036 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:06.751724 11010 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.753051 10112 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:06.754218 10153 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ab28ea212034df2acdf22eab1b39bdd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.755221 11024 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.759680 11010 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.761307 10036 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.767976 10112 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.778875  9938 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.777285 10036 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:06.811462 10188 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:06.812778 10004 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9339757002c64268bb483f1a5bfe0ccf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:06.812938 11077 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:06.813832 10112 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:06.815028 11077 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.823640 11023 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.834595 10188 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.840965 10111 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:06.854844  9935 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:07.096356 11103 ts_tablet_manager.cc:933] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:07.098832 11103 tablet_copy_client.cc:323] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:16:07.100551 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet ffbced50ff05471aae6f2f593710055e from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:16:07.101037 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet ffbced50ff05471aae6f2f593710055e from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-ffbced50ff05471aae6f2f593710055e
I20260709 13:16:07.106989 10125 tablet_copy_source_session.cc:215] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:07.109742 11103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbced50ff05471aae6f2f593710055e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:07.122176 11103 tablet_copy_client.cc:806] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:07.122777 11103 tablet_copy_client.cc:670] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:07.130210 11103 tablet_copy_client.cc:538] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:07.136308 11103 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:07.154049 11103 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:07.154934 11103 tablet_bootstrap.cc:492] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:07.155577 11103 ts_tablet_manager.cc:1403] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:16:07.158720 11103 raft_consensus.cc:359] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.159472 11103 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:07.160013 11103 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.163532 11103 ts_tablet_manager.cc:1434] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:07.165472 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-ffbced50ff05471aae6f2f593710055e received from {username='slave'} at 127.0.0.1:53672
I20260709 13:16:07.165943 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-ffbced50ff05471aae6f2f593710055e on tablet ffbced50ff05471aae6f2f593710055e with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:07.186615 11103 ts_tablet_manager.cc:933] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:07.188017 11103 tablet_copy_client.cc:323] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:07.189558 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 1ab28ea212034df2acdf22eab1b39bdd from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:07.189960 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 1ab28ea212034df2acdf22eab1b39bdd from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-1ab28ea212034df2acdf22eab1b39bdd
I20260709 13:16:07.195488 10198 tablet_copy_source_session.cc:215] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:07.198087 11103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab28ea212034df2acdf22eab1b39bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:07.208495 11108 ts_tablet_manager.cc:933] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:07.210448 11108 tablet_copy_client.cc:323] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:07.212062 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 2ff24b1804914099b167420853598f48 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:07.212569 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 2ff24b1804914099b167420853598f48 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-2ff24b1804914099b167420853598f48
I20260709 13:16:07.213124 11103 tablet_copy_client.cc:806] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:07.213661 11103 tablet_copy_client.cc:670] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:07.221306 11103 tablet_copy_client.cc:538] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:07.224665 10198 tablet_copy_source_session.cc:215] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:07.230083 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff24b1804914099b167420853598f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:07.231072 11103 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:07.249307 11108 tablet_copy_client.cc:806] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:07.249861 11108 tablet_copy_client.cc:670] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:07.262485 11108 tablet_copy_client.cc:538] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:07.273555 11108 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:07.274721 11103 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:07.273607 11112 ts_tablet_manager.cc:933] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:07.284821 11103 tablet_bootstrap.cc:492] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:07.285691 11103 ts_tablet_manager.cc:1403] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.004s
I20260709 13:16:07.293239 11103 raft_consensus.cc:359] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.294102 11103 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:07.295780 11112 tablet_copy_client.cc:323] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.193:38563
I20260709 13:16:07.298069 10050 tablet_copy_service.cc:140] P 9a67604b91f54791b1316fd327793337: Received BeginTabletCopySession request for tablet 9339757002c64268bb483f1a5bfe0ccf from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:55698)
I20260709 13:16:07.298585 10050 tablet_copy_service.cc:161] P 9a67604b91f54791b1316fd327793337: Beginning new tablet copy session on tablet 9339757002c64268bb483f1a5bfe0ccf from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:55698: session id = 2f672b54d4754c5aa62b5b919597a14e-9339757002c64268bb483f1a5bfe0ccf
I20260709 13:16:07.294749 11103 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.301694 11103 ts_tablet_manager.cc:1434] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:16:07.303395 11108 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:07.303459 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-1ab28ea212034df2acdf22eab1b39bdd received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:07.304039 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-1ab28ea212034df2acdf22eab1b39bdd on tablet 1ab28ea212034df2acdf22eab1b39bdd with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:07.304404 11108 tablet_bootstrap.cc:492] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:07.305097 11108 ts_tablet_manager.cc:1403] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.000s
I20260709 13:16:07.306655 10050 tablet_copy_source_session.cc:215] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:07.308658 11108 raft_consensus.cc:359] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.309513 11108 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:07.310137 11108 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.312885 11108 ts_tablet_manager.cc:1434] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:16:07.314546 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-2ff24b1804914099b167420853598f48 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:07.314941 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-2ff24b1804914099b167420853598f48 on tablet 2ff24b1804914099b167420853598f48 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:07.318158 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9339757002c64268bb483f1a5bfe0ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:07.340929 11112 tablet_copy_client.cc:806] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:07.341483 11112 tablet_copy_client.cc:670] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:07.355566 11112 tablet_copy_client.cc:538] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:07.370318 11112 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:07.394817 11112 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:07.395717 11112 tablet_bootstrap.cc:492] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:07.396409 11112 ts_tablet_manager.cc:1403] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.007s
I20260709 13:16:07.399411 11112 raft_consensus.cc:359] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.400276 11112 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:07.400915 11112 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:07.403793 11112 ts_tablet_manager.cc:1434] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:07.408813 10050 tablet_copy_service.cc:342] P 9a67604b91f54791b1316fd327793337: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-9339757002c64268bb483f1a5bfe0ccf received from {username='slave'} at 127.0.0.1:55698
I20260709 13:16:07.409202 10050 tablet_copy_service.cc:434] P 9a67604b91f54791b1316fd327793337: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-9339757002c64268bb483f1a5bfe0ccf on tablet 9339757002c64268bb483f1a5bfe0ccf with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:07.596383 10715 raft_consensus.cc:1217] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:07.646658 10715 raft_consensus.cc:1217] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:07.717743 10715 raft_consensus.cc:1217] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:07.722090 10715 raft_consensus.cc:1217] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:08.127044 11010 raft_consensus.cc:1064] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:08.132488 11117 raft_consensus.cc:1064] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:08.132618 11010 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.135573 11117 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.141436 10714 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.143335 11111 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.144868 10036 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.147118 10112 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.146394 11111 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:08.151177 11084 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.188768 10715 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.190557 11086 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:08.194094 10188 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.197521 11086 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:08.212654 10036 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.214265 11086 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.218784 11123 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.219781 11086 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.220717 10037 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.224359 10188 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.228791 10715 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.240471 10112 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.247607  9935 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.257546 11116 raft_consensus.cc:1064] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:08.269117 10714 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.280887 11116 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.293625 10036 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.304440 11084 raft_consensus.cc:1064] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:08.307154 11084 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.310505  9936 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:08.336593 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71341.6us
I20260709 13:16:08.344638 10714 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.349664 10186 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.351833 11130 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.346297 10112 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.355958 10715 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.357017 10112 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.358417 11024 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.358676 11116 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.366675 11024 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.362716 10186 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.386513 10716 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.388803 11123 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:08.397382 10036 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:08.399015 11132 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:08.405552 10037 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.406899 11123 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.410089 11111 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.411369 11010 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:08.416262 10037 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.425984 10111 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.471130 10715 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.474251 11126 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:08.478273 10715 raft_consensus.cc:2955] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.482923 10036 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.489380 11086 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:08.500167  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ab28ea212034df2acdf22eab1b39bdd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:08.502458  9935 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.522181 10107 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.501955 11117 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.516848 11084 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.539965 11133 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.534850 10040 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.585348 10189 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:16:08.593502 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67939.2us
W20260709 13:16:08.627579 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 61439.9us
I20260709 13:16:08.632682 10714 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.639389 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ab28ea212034df2acdf22eab1b39bdd with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33498
I20260709 13:16:08.640509 10715 raft_consensus.cc:2955] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.628386 10713 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.663328  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.666934  9938 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.676144 10108 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.684423 11152 tablet_replica.cc:333] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:16:08.685819 11152 raft_consensus.cc:2243] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.688127 11152 raft_consensus.cc:2272] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:08.684404 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 104462us
I20260709 13:16:08.705492 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet ffbced50ff05471aae6f2f593710055e with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:16:08.717244  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffbced50ff05471aae6f2f593710055e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:16:08.718794 11150 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:16:08.721141 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 99692us
I20260709 13:16:08.730880  9938 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.784862 11152 ts_tablet_manager.cc:1916] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:08.795449 10037 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.820963 11157 tablet_replica.cc:333] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:16:08.822883 10715 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.832267 10108 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.832705 10189 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:08.834255 11157 raft_consensus.cc:2243] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.850096 11157 raft_consensus.cc:2272] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:08.863142 10715 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.863483 11152 ts_tablet_manager.cc:1929] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:08.863658 10113 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:08.863991 11152 log.cc:1199] T 1ab28ea212034df2acdf22eab1b39bdd P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/1ab28ea212034df2acdf22eab1b39bdd
I20260709 13:16:08.866055  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet 1ab28ea212034df2acdf22eab1b39bdd (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:08.866918 11157 ts_tablet_manager.cc:1916] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:08.877940 11155 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:08.887840 11157 ts_tablet_manager.cc:1929] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:08.888383 11157 log.cc:1199] T ffbced50ff05471aae6f2f593710055e P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/ffbced50ff05471aae6f2f593710055e
I20260709 13:16:08.888060 11151 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:08.889662 11151 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:08.894625 11156 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:08.899243  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet ffbced50ff05471aae6f2f593710055e (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:08.903403 11130 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.905620 10714 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.910670 11010 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.921864  9934 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.925283 10113 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.927963 10107 raft_consensus.cc:2955] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.939079  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ff24b1804914099b167420853598f48 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:08.942451 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet 9339757002c64268bb483f1a5bfe0ccf with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:16:08.943427 11157 tablet_replica.cc:333] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:16:08.944495 11157 raft_consensus.cc:2243] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.945259 11157 raft_consensus.cc:2272] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:08.946135  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9339757002c64268bb483f1a5bfe0ccf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:08.946156  9934 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.948056 10715 raft_consensus.cc:2955] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:08.948866 11157 ts_tablet_manager.cc:1916] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:08.958735 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff24b1804914099b167420853598f48 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:08.962494 11158 tablet_replica.cc:333] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:16:08.964629 11158 raft_consensus.cc:2243] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.965309 11158 pending_rounds.cc:70] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Trying to abort 1 pending ops.
I20260709 13:16:08.965631 11158 pending_rounds.cc:77] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305637758179893248 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2ff24b1804914099b167420853598f48" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } } }
I20260709 13:16:08.966931 11158 raft_consensus.cc:2917] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:16:08.967305 11158 raft_consensus.cc:2889] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:16:08.967630 11158 raft_consensus.cc:2272] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:08.973253 11158 ts_tablet_manager.cc:1916] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:08.990018 11157 ts_tablet_manager.cc:1929] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:08.990489 11157 log.cc:1199] T 9339757002c64268bb483f1a5bfe0ccf P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/9339757002c64268bb483f1a5bfe0ccf
I20260709 13:16:08.992203  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet 9339757002c64268bb483f1a5bfe0ccf (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:08.994727 11158 ts_tablet_manager.cc:1929] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:08.995059 11158 log.cc:1199] T 2ff24b1804914099b167420853598f48 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/2ff24b1804914099b167420853598f48
I20260709 13:16:08.996265  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 2ff24b1804914099b167420853598f48 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:09.894284  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.941952 10186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ff24b1804914099b167420853598f48"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:09.942472 10186 raft_consensus.cc:606] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:09.944881 10186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:09.945353 10186 raft_consensus.cc:606] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:09.947558 10186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:09.948091 10186 raft_consensus.cc:606] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:09.950901 10186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:09.951452 10186 raft_consensus.cc:606] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:09.953847 10186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:09.954377 10186 raft_consensus.cc:606] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:09.955381  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:09.956899  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:09.972352 11151 raft_consensus.cc:993] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:09.972849 11151 raft_consensus.cc:1081] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:09.974381 10040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:09.974821 10040 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.975060 10040 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.979667 10040 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:09.981446 10040 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:09.982769 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:09.983289 10186 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.983466 10186 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:09.984126 10186 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:09.985122 10186 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.988171 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:09.988821 10113 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.992690 10186 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:09.995101 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:09.995954 11130 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.996448 11130 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:09.997262 11130 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:09.998611 10113 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:10.016988  9936 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.050559 10186 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:10.056644 10153 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 230ae7ec0d4d46b88977591c29ce761b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.056792 10113 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.056892 10040 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.058219 11151 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.059393 11167 raft_consensus.cc:993] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:10.059983 11153 raft_consensus.cc:1081] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:10.059640 11010 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.061478 10715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ff24b1804914099b167420853598f48"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:10.061975 10715 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.062309 10715 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.069463 10715 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:10.072921 10715 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.073470 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:10.073002 10040 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.071220 11010 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.074344 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:10.074515 10113 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.074882 10186 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.075209 10186 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:10.076032 10186 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:10.078670 11153 raft_consensus.cc:993] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:10.079169 11153 raft_consensus.cc:1081] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:10.077409 10111 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.078853 10186 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.087960 10107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:16:10.088532 10107 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.088892 10107 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.091456 10113 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:10.092633 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:10.092891  9936 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.095618 11171 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.096553 10189 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.103544 10107 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.105515 10107 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.107352 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:10.108068 10188 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.108390 10188 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:10.107764 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:10.109162 10188 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.110206 10188 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.109254 10037 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.133342 10037 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:10.149541 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:10.150097 11171 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:10.151093 11174 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.151693 11174 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:10.151131 11171 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:10.152652 11174 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.149839 10188 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
W20260709 13:16:10.164234 10153 consensus_peers.cc:597] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 133523a809584dd5b44a19acf589801d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.165213 10107 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.131054 10186 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:10.166520 11167 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.170553 10035 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.172385 11170 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.175033  9934 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.190768 10035 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.188571 11167 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.198066 10111 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.217969 10111 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.217782  9934 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.221864  9935 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:10.228857 10079 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9a32b1065fb4ad3a7f2a86329f56464. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.229130 10189 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.229882 10035 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.231019 11174 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.231933 11117 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.242395 11174 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.243561 10040 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.262354 10186 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.265928  9934 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.283885 11170 raft_consensus.cc:993] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:10.284385 11170 raft_consensus.cc:1081] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:10.286197 10107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:16:10.286623 10111 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:10.286800 10107 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.286095 10186 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.287216 10107 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.289520 10040 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:10.290460 10153 consensus_peers.cc:597] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e127deec1bdf4a7883aec8a35942fb23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:10.290894 11151 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.294814 11167 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.296320 10107 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.302099 10107 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.302297 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:10.302853 10037 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.308127 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:10.308756 10186 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.309036 10186 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:10.309762 10186 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.309509 11167 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.310957 10186 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.312325 10037 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:10.313473 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:10.314369 11179 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.314805 11179 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:10.315670 11179 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.320909 10107 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.322780 10037 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:10.326849 10186 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:10.341686  9934 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.341753  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.407966 10189 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.409673 11130 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.440421 10111 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.445534 11151 raft_consensus.cc:993] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:10.446038 11151 raft_consensus.cc:1081] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:10.446992 11130 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.453171 10040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:10.453709 10040 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.454064 10040 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.465008 10040 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.467855 10040 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.468928 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:10.469503 10107 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.469784 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:10.470302 10189 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.470566 10189 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:10.471330 10189 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.472136 10189 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.475258 10107 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:10.476894 10189 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:10.478526 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:10.479270 11130 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.479689 11130 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:10.480515 11130 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:10.497659  9938 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.537230 10040 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.538461 11179 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.542963 11194 ts_tablet_manager.cc:933] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.545888 11194 tablet_copy_client.cc:323] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:10.547593 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 230ae7ec0d4d46b88977591c29ce761b from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:10.548157 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 230ae7ec0d4d46b88977591c29ce761b from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-230ae7ec0d4d46b88977591c29ce761b
I20260709 13:16:10.553851 10189 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.555632 11175 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.557955 10189 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:10.559273 11171 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:10.579459 10198 tablet_copy_source_session.cc:215] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:10.585547 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230ae7ec0d4d46b88977591c29ce761b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:10.604424 11194 tablet_copy_client.cc:806] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:10.604997 11194 tablet_copy_client.cc:670] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:10.609236 11194 tablet_copy_client.cc:538] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:10.610991 10111 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:10.612550 11172 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:10.618710 11194 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:10.661353 11194 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.662283 11194 tablet_bootstrap.cc:492] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:10.662993 11194 ts_tablet_manager.cc:1403] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.012s
I20260709 13:16:10.665728 11194 raft_consensus.cc:359] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.666540 11194 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:10.667078 11202 ts_tablet_manager.cc:933] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.667196 11194 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.670337 11194 ts_tablet_manager.cc:1434] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:16:10.673230 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-230ae7ec0d4d46b88977591c29ce761b received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:10.673673 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-230ae7ec0d4d46b88977591c29ce761b on tablet 230ae7ec0d4d46b88977591c29ce761b with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:10.696529 11202 tablet_copy_client.cc:323] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:10.697284 11194 ts_tablet_manager.cc:933] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:10.703171 11194 tablet_copy_client.cc:323] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:16:10.705982 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 133523a809584dd5b44a19acf589801d from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:10.706501 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 133523a809584dd5b44a19acf589801d from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-133523a809584dd5b44a19acf589801d
I20260709 13:16:10.712924 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet f9a32b1065fb4ad3a7f2a86329f56464 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:16:10.713398 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet f9a32b1065fb4ad3a7f2a86329f56464 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-f9a32b1065fb4ad3a7f2a86329f56464
I20260709 13:16:10.719955 10125 tablet_copy_source_session.cc:215] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:10.723327 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a32b1065fb4ad3a7f2a86329f56464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:10.723775 10198 tablet_copy_source_session.cc:215] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:10.726788 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133523a809584dd5b44a19acf589801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:10.742413 11194 tablet_copy_client.cc:806] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:10.742956 11194 tablet_copy_client.cc:670] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:10.746645 11194 tablet_copy_client.cc:538] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:10.747195 11202 tablet_copy_client.cc:806] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:10.748010 11202 tablet_copy_client.cc:670] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:10.751222 11202 tablet_copy_client.cc:538] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:10.756423 11194 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:10.757721 11202 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:10.766832 10037 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.771255 11175 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.786751 11202 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.787889 11202 tablet_bootstrap.cc:492] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:10.788715 11202 ts_tablet_manager.cc:1403] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.007s
I20260709 13:16:10.791595 11202 raft_consensus.cc:359] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.792409 11202 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:10.792909 11202 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.794988 11202 ts_tablet_manager.cc:1434] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:16:10.797689 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-133523a809584dd5b44a19acf589801d received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:10.798135 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-133523a809584dd5b44a19acf589801d on tablet 133523a809584dd5b44a19acf589801d with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:10.797780 11194 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.805608 11194 tablet_bootstrap.cc:492] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:10.806298 11194 ts_tablet_manager.cc:1403] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.050s	user 0.027s	sys 0.005s
I20260709 13:16:10.809644 11194 raft_consensus.cc:359] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.810542 11194 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:10.811549 11194 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.814040 11194 ts_tablet_manager.cc:1434] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:10.816447 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-f9a32b1065fb4ad3a7f2a86329f56464 received from {username='slave'} at 127.0.0.1:53672
I20260709 13:16:10.816933 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-f9a32b1065fb4ad3a7f2a86329f56464 on tablet f9a32b1065fb4ad3a7f2a86329f56464 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:10.826692 10186 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.828385 11179 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.891884 11194 ts_tablet_manager.cc:933] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:10.895424 11194 tablet_copy_client.cc:323] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:16:10.896899 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet e127deec1bdf4a7883aec8a35942fb23 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:16:10.897315 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet e127deec1bdf4a7883aec8a35942fb23 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-e127deec1bdf4a7883aec8a35942fb23
I20260709 13:16:10.903362 10198 tablet_copy_source_session.cc:215] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:10.906132 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e127deec1bdf4a7883aec8a35942fb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:10.917373 11194 tablet_copy_client.cc:806] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:10.917881 11194 tablet_copy_client.cc:670] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:10.920948 11194 tablet_copy_client.cc:538] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:10.926635 11194 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:10.942351 11194 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:10.943308 11194 tablet_bootstrap.cc:492] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:10.944098 11194 ts_tablet_manager.cc:1403] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.003s
I20260709 13:16:10.946677 11194 raft_consensus.cc:359] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.947422 11194 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:10.948217 11194 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:10.950649 11194 ts_tablet_manager.cc:1434] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:10.952440 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-e127deec1bdf4a7883aec8a35942fb23 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:16:10.952852 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-e127deec1bdf4a7883aec8a35942fb23 on tablet e127deec1bdf4a7883aec8a35942fb23 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:10.957419 10107 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.957770  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.958798 11130 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.974335 10186 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.975859 11130 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.015002 10714 raft_consensus.cc:1217] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:11.063714  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.113701 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:11.114310 10189 raft_consensus.cc:606] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:11.116968 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133523a809584dd5b44a19acf589801d"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:11.117425 10189 raft_consensus.cc:606] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:11.119537 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:11.120060 10189 raft_consensus.cc:606] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:11.122541 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:11.123132 10189 raft_consensus.cc:606] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:11.125129 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:11.125525 10189 raft_consensus.cc:606] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:11.126565  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:11.127588  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:11.142369 11167 raft_consensus.cc:993] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:11.142928 11167 raft_consensus.cc:1081] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:11.144248 10035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:11.144678 10035 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.145005 10035 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.149878 10035 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:11.154832 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:11.155261 10035 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:11.156653 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:11.158310 10189 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.158623 10189 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:11.158972 10107 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.159590 10189 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:11.161224 10189 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.165061 10107 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:11.166178 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:11.166930 11209 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.167374 11209 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:11.168234 11209 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:11.170403 10189 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:11.180207  9938 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.208914 10714 raft_consensus.cc:1217] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:11.210371 11167 raft_consensus.cc:993] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:11.210834 11167 raft_consensus.cc:1081] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:11.212915 10111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133523a809584dd5b44a19acf589801d"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:16:11.213379 10111 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.213768 10111 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.221729 10111 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:11.225168 10111 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:11.225660 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:11.226228 10189 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.226501 10189 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:11.226662 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:11.227193 10035 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.227327 10189 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:11.229039 10189 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.230795 10714 raft_consensus.cc:1217] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:11.235301 10035 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:11.236711 10081 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:11.237511 11174 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.237967 11174 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:11.238833 11174 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:11.242348 10189 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:11.261853  9938 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.311932 11170 raft_consensus.cc:993] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:11.312400 11170 raft_consensus.cc:1081] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:11.313772 10111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:16:11.314193 10111 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.314466 10111 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.319029 10111 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:11.321985 10111 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:11.323665 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:11.324317 10037 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.328553 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:11.329282 10189 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.329641 10189 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:11.331534 10037 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:11.332347 10189 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:11.332863 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:11.333699 11174 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.334192 11174 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:11.334247 10189 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.335038 11174 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:11.348398 10189 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:11.347826  9938 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.385160 10715 raft_consensus.cc:1217] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:11.502490 11151 raft_consensus.cc:993] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:11.503002 11170 raft_consensus.cc:1081] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:11.504313 10715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:11.504724 10715 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.505021 10715 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.514333 10715 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.516870 10715 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:11.516911 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:11.517556 10111 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.523375 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:11.524472 10189 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.524870 10189 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:11.526093 10189 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.527385 10189 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.529663 10111 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:11.530808 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:11.531665 11217 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.532166 11217 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:11.533005 11217 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.533496 10189 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:11.543644  9935 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.616201 10113 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:11.617466 11130 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.625769 10715 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Advancing to term 2
I20260709 13:16:11.626885 10040 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:11.627159 10186 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:11.628438 11175 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.629089 11179 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.636189 10715 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:11.637967 11209 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.658469 10189 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:11.687513 11209 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.690234 11151 raft_consensus.cc:993] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:11.695001 11151 raft_consensus.cc:1081] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:11.700711 10713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:11.701375 10713 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.750761 10713 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.793936 10713 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.803095 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:11.803700 10035 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.823470 10035 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:11.834113 10037 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:11.839586 11228 raft_consensus.cc:1064] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:11.840698 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:11.841605 11217 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.842078 11217 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:11.842907 11217 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.856629 10713 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:11.869405 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:11.869894 10716 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Advancing to term 2
I20260709 13:16:11.870051 10185 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.870388 10185 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:11.871191 10185 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.872164 10185 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.879989 10185 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:11.884763 10186 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.891925 10716 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:11.903100 11174 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.905000 11175 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.883297 11228 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.909770 11233 raft_consensus.cc:1064] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:11.912570 11233 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.922024  9936 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.925899 11167 raft_consensus.cc:1064] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:11.928370 11167 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:11.939978 10714 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEARNER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:11.942842 11130 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:11.954490 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 53694.8us
I20260709 13:16:11.957633 10185 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:11.960027 11230 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:11.968948 11209 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:11.977281 10185 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:11.989503 10186 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:11.991088 11217 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.001380 10111 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.001441 10713 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.003021 11217 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.003108 11235 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.024925 10040 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:16:12.040838 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 76894.8us
I20260709 13:16:12.044739 11235 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.048292 10040 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:12.049171 10107 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:12.050661 11242 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.056417 10113 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.058416  9935 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.062930 11170 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.068670 10037 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.069329 10713 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.070331 11175 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.072209 11242 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:12.077855 11245 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:12.082633 11174 raft_consensus.cc:1064] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:12.085180 11174 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:12.091903 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 191516us
I20260709 13:16:12.094954 10715 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:12.100476 10188 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.100353 11174 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.108023 10035 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:12.109705 11175 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:12.116858 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 60477.2us
I20260709 13:16:12.119771 11230 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.118332 11167 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.125121 11241 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.126441 10186 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:12.128434  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.128739 10113 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.130898 10716 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.155511 10034 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.176196 10715 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.176658 10108 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.194633 11239 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.209306 11240 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.211551  9938 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.219326  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.233011 11233 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.221684 10040 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.224408 10713 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.231232 10037 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.240880 10716 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.247291 10189 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.249017 11230 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:12.251263 10714 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.257095 10189 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.269877 10034 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.271569 11217 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:12.256737 10187 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.258687 10037 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.288748 10186 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.282506 11130 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.307611 11209 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.314255  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 230ae7ec0d4d46b88977591c29ce761b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:12.311712 10715 raft_consensus.cc:2955] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.316043 10188 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.328198 10714 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:12.336651 11151 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.356514  9934 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.389405 10111 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:12.393326  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.420336 11170 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:12.419224 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 94379.2us
I20260709 13:16:12.426424 11151 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.433671 10187 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.435163 11217 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.441699  9936 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 4 to 5, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.450714  9922 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e127deec1bdf4a7883aec8a35942fb23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:12.451023 10715 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.458160 10108 raft_consensus.cc:2955] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.464870 10111 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.508388 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet 230ae7ec0d4d46b88977591c29ce761b with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33498
I20260709 13:16:12.528999 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:12.529621 10189 raft_consensus.cc:606] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:12.537087  9936 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 3 to 4, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.564146 10715 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:12.567226 10034 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:12.568238 11233 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.569612 11241 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.585107 10108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133523a809584dd5b44a19acf589801d"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:16:12.585700 10108 raft_consensus.cc:606] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:12.588656 11175 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.594008 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet e127deec1bdf4a7883aec8a35942fb23 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:12.597834 10715 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.600607 10035 raft_consensus.cc:2955] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.603430 11263 tablet_replica.cc:333] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:16:12.604504 11263 raft_consensus.cc:2243] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:12.605317 11263 raft_consensus.cc:2272] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:12.618870 11267 tablet_replica.cc:333] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:16:12.618881  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9a32b1065fb4ad3a7f2a86329f56464 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:12.620021 11267 raft_consensus.cc:2243] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:12.620832 11267 raft_consensus.cc:2272] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:12.626647 11263 ts_tablet_manager.cc:1916] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:12.630738 11267 ts_tablet_manager.cc:1916] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:12.629037  9934 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 4, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:12.639622 11175 raft_consensus.cc:993] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.640245 11233 raft_consensus.cc:1081] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.642112 10715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133523a809584dd5b44a19acf589801d"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42392
I20260709 13:16:12.642616 10715 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.642951 10715 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.647271 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet f9a32b1065fb4ad3a7f2a86329f56464 with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39154
I20260709 13:16:12.652283 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:12.652897 10040 raft_consensus.cc:606] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:12.656409 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:12.657117 10187 raft_consensus.cc:606] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:12.656455 10715 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.662940 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:12.663417 11263 ts_tablet_manager.cc:1929] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:16:12.663915 11263 log.cc:1199] T 230ae7ec0d4d46b88977591c29ce761b P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/230ae7ec0d4d46b88977591c29ce761b
I20260709 13:16:12.664019 10187 raft_consensus.cc:606] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:12.664683 10715 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:12.665608 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:12.666416 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:12.667491 10189 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.667430 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:12.668413 10035 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.667793 10111 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:12.670061 10111 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:12.670598 11268 tablet_replica.cc:333] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:16:12.670789 10111 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.672010 11268 raft_consensus.cc:2243] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:12.672667 11268 raft_consensus.cc:2272] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:12.672957 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:12.673529 10187 raft_consensus.cc:606] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:12.673669 11267 ts_tablet_manager.cc:1929] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:12.674175 11267 log.cc:1199] T e127deec1bdf4a7883aec8a35942fb23 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/e127deec1bdf4a7883aec8a35942fb23
I20260709 13:16:12.674091 10189 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:12.676579 11268 ts_tablet_manager.cc:1916] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:12.677379  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet 230ae7ec0d4d46b88977591c29ce761b (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:12.672688 10111 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.680724  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:12.682236  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:12.685724 10111 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:12.687037 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:12.687935  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet e127deec1bdf4a7883aec8a35942fb23 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:12.688146 11219 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:12.688695 11219 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:12.689549 11219 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.691699 10035 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:12.704694 11268 ts_tablet_manager.cc:1929] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:12.705192 11268 log.cc:1199] T f9a32b1065fb4ad3a7f2a86329f56464 P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/f9a32b1065fb4ad3a7f2a86329f56464
I20260709 13:16:12.705085 11259 raft_consensus.cc:993] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:12.707356 11259 raft_consensus.cc:1081] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:12.708765  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet f9a32b1065fb4ad3a7f2a86329f56464 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:12.707407  9936 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.709616 10040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:12.710115 10040 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.710440 10040 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.715497 10040 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:12.718401 10040 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:12.719614 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:12.720237 10187 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.720530 10187 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:12.721148 10187 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:12.722334 10187 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.724115 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:12.728303 10111 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.741119 10111 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:12.741663 10187 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:12.742563 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:12.742770 11151 raft_consensus.cc:993] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.743471 11209 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.743403 11151 raft_consensus.cc:1081] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.744002 11209 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:12.744881 11209 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:12.745410 10713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:12.746001 10713 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.746373 10713 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.760715 10713 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.763634 10713 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:12.763866 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:12.766696 10040 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.770409 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:12.771023 10189 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.771307 10189 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:12.772037 10189 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.772921 10040 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:12.773051  9936 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.773808 10189 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.774587 10682 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:12.775498 11219 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.775985 11219 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:12.776798 11219 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.780745 10189 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:12.798489  9936 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.850152 11209 raft_consensus.cc:993] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.850696 11230 raft_consensus.cc:1081] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.854442 11151 raft_consensus.cc:993] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.856161 10713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42422
I20260709 13:16:12.857115 10713 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.857795 10713 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.857095 11151 raft_consensus.cc:1081] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:12.864037 10715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:12.864593 10715 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.864989 10715 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.872578 10715 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.875138 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:12.875773 10111 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.881570 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:12.882181 10189 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.882476 10189 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:12.883213 10111 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:12.875483 10713 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.883185 10189 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.884474 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:12.885356 10713 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:12.885568 10189 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.885922 11219 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.886425 11219 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:12.887252 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:12.887480 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:12.887217 11219 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.887887 10108 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.888041 10040 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.888413 10040 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:12.895139 10108 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:12.896087 10040 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.896369 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:12.897461 10040 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.897428 11217 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.900663 10715 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:12.902743 10189 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:12.904374 11217 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:12.905294 11217 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:12.905690 10040 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:12.905573  9936 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.952306  9935 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.100565 10187 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:13.102463 11217 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:13.113907 10111 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:13.115053 11217 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.119405 11258 raft_consensus.cc:993] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:13.119911 11258 raft_consensus.cc:1081] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:13.121656 10040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:13.122170 10040 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.122483 10040 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.135078 10040 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:13.138173 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:13.139008 10187 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:13.139329 10187 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:13.140133 10187 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:13.142093 10187 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.150040 10187 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:13.154701 10035 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:13.156829 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:13.156538 10040 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:13.157536 10108 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.158754 11219 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.157644 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:13.160180 11209 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:13.160673 11209 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:13.161531 11209 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:13.165453 10108 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:13.182016  9936 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.211386 10040 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.213281 11219 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.231123 10185 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.232534 11217 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.247789 10108 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.249523 11130 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.254834 10715 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:13.265224 10185 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.267289 11209 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.291694 10111 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.293463 11217 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.309780 10112 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:13.311262 11217 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:13.313725 10187 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:13.320214 11272 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:13.323103 11272 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:13.330982 10112 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:13.343875 10189 raft_consensus.cc:2955] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:13.376703 10185 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.388913 11217 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.400781  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 133523a809584dd5b44a19acf589801d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:13.400620  9936 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 4 to 6, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:13.407970 10108 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.410430 11272 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.435055 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 133523a809584dd5b44a19acf589801d with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:13.443408 11290 tablet_replica.cc:333] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:16:13.445116 10035 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.457155 11290 raft_consensus.cc:2243] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.457821 11290 raft_consensus.cc:2272] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.457881 11286 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.463704 11290 ts_tablet_manager.cc:1916] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:13.479653 11290 ts_tablet_manager.cc:1929] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:16:13.479972 11290 log.cc:1199] T 133523a809584dd5b44a19acf589801d P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/133523a809584dd5b44a19acf589801d
I20260709 13:16:13.481319  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 133523a809584dd5b44a19acf589801d (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:16:13.619234 10108 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.621430 11130 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.635916 10185 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.637346 11130 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.683100  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.724040  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.757004 10185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:13.757556 10185 raft_consensus.cc:606] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:13.759979 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:13.760425 10040 raft_consensus.cc:606] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:13.762605 10185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:13.763060 10185 raft_consensus.cc:606] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:13.765476 10185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "366d253a473243de9090f7b03b1c955b"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:13.765913 10185 raft_consensus.cc:606] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:13.774911 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:13.775502 10040 raft_consensus.cc:606] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:13.776615  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:13.777768  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:13.992300 11260 raft_consensus.cc:993] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:13.992678 11258 raft_consensus.cc:1081] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:13.993911 10040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:13.994328 10040 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.994585 10040 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.999951 10040 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.001705 10040 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:14.002735 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:14.002735 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:14.003175 11258 raft_consensus.cc:993] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:14.003463 10112 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.003546 10189 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.003724 11260 raft_consensus.cc:1081] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:14.003962 10189 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:14.004741 10189 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.005169 10715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:14.005560 10715 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.005856 10715 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.005914 10189 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.011791 10715 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:14.012743 10189 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:14.014135 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:14.014523 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:14.014820 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:14.015022 11293 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.015162 10108 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.015377 10185 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.015534 11293 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:14.015918 10185 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:14.016744 10185 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:14.016661 11293 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.017913 10185 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.014457 10112 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:14.035851 10185 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:14.025173 10108 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:14.040637 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:14.040592  9936 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:14.041644 11219 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.014473 10715 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:14.042759 11219 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:14.043684 11219 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:14.055161  9934 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:14.183233 11293 raft_consensus.cc:993] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:14.183806 11209 raft_consensus.cc:1081] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:14.185250 10112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33512
I20260709 13:16:14.185715 10112 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.186007 10112 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.191432 10112 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.194247 10112 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:14.196592 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:14.196945 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:14.197252 10035 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.197573 10035 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:14.197611 10185 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.198307 10035 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.199389 10035 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.207955 11258 raft_consensus.cc:993] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:14.208571 11258 raft_consensus.cc:1081] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:14.211721 10035 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:14.213127 10040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "366d253a473243de9090f7b03b1c955b"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:14.213160 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:14.213683 10040 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.214046 10040 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.214095 11239 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.214619 11239 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:14.215461 11239 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.216872 10185 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:14.223124 10040 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.228440 10040 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:14.228948 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:14.229516 10111 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.231528 11130 raft_consensus.cc:993] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:14.231984 11130 raft_consensus.cc:1081] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:14.233556 10112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33512
I20260709 13:16:14.233952 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:14.234552 10185 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.234211 10112 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.234913 10185 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:14.235270 10112 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.236065 10185 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.237389 10185 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.239199 10111 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:14.238828  9936 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:14.240214 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:14.241431 11209 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.241926 11209 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:14.241887 10112 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.243017 11209 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.243489 10185 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:14.244449 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:14.244972 10035 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.245260 10035 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:14.245956 10035 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.246660 10112 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:14.246927 10035 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.248617 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:14.249101 10185 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.253473 10185 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:14.253576 10035 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:14.254630 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:14.255790 11239 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.256248 11239 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:14.257020 11239 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:14.263911  9936 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:14.268743  9934 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:14.425849 10185 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.428135 11209 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.435564 10111 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:14.437702 11219 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:14.451678 10111 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.453414 11209 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.470201 10189 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:14.476212 11219 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:14.535719 10189 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:14.542266 10112 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:14.542464 10153 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1fa3c9e8a7a496eaa49ec78b5a92103. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.542500 10040 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:14.543529 11260 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.544243 11258 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.556427 11295 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:14.560706 10040 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
W20260709 13:16:14.573559  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 2597dc9899784d6eb96b916d235dc5b2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:14.573097 10112 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:14.581240 10111 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:14.581557  9936 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:14.592456 10189 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:14.593859 11175 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:14.594945 10079 consensus_peers.cc:597] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8111eefbfbe3442e98fd2c9b054ee1a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.597206 10034 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:14.599371 11175 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.609030 11239 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:14.611673 10189 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:14.616640 10034 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:16:14.631037 10189 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.632618 11230 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.633365  9935 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 2, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 1 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:14.634931  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 63a2fe5619be481399904909f88ce441: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:14.647528 10034 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.650061 11175 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.663391 10112 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.665321 11230 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.696980 10187 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.698490 11322 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.778620  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:14.799453 10034 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.803651 11322 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.831893 10187 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:14.833750 11321 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.845101  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:14.908939 10034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:14.909534 10034 raft_consensus.cc:606] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:14.912340 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:14.912919 10187 raft_consensus.cc:606] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:14.917789 10034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:14.918359 10034 raft_consensus.cc:606] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:14.920930 10111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:16:14.921346 10111 raft_consensus.cc:606] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:14.923995 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:14.924618 10187 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:14.925843  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:14.927451  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:14.933305 11317 raft_consensus.cc:993] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:14.933821 11317 raft_consensus.cc:1081] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 2f672b54d4754c5aa62b5b919597a14e to start an election
I20260709 13:16:14.936606 10715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42408
I20260709 13:16:14.937124 10715 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.937453 10715 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.946291 10715 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:14.948151 10715 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:14.960278 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:14.960980 10111 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.961534 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:14.962167 10187 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.962487 10187 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:14.963270 10187 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:14.964601 10187 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.971297 10111 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:14.972560 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:14.973574 11329 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.974709 11329 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:14.976045 11329 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:14.977771 10187 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:14.987955  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:15.006790 11331 ts_tablet_manager.cc:933] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:15.008589 11331 tablet_copy_client.cc:323] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:16:15.011477 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:16:15.012012 11316 raft_consensus.cc:993] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:15.012027 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet 8111eefbfbe3442e98fd2c9b054ee1a5 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-8111eefbfbe3442e98fd2c9b054ee1a5
I20260709 13:16:15.012614 11316 raft_consensus.cc:1081] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:15.014122 10034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:15.014516 10034 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:15.014776 10034 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.020201 10125 tablet_copy_source_session.cc:215] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:15.020730 10034 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:15.023129 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:15.023669 10111 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.024852 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:15.025393 10189 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:15.025666 10189 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:15.026373 10189 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:15.027622 10189 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.034443 10111 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:15.035606 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:15.036671 11209 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:15.023290 10034 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:15.037113 11209 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:15.037966 11209 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:15.052414 11130 raft_consensus.cc:993] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:15.052852 11130 raft_consensus.cc:1081] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:15.055245 10186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:15.055788 10186 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:15.056159 10186 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.057291  9935 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.060396 10189 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:15.023728 11331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8111eefbfbe3442e98fd2c9b054ee1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.063565 10186 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:15.066337 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:15.067009 10034 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:15.067353 10034 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:15.067893 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:15.068500 10111 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.068427 10034 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:15.069715 10034 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.075381 10111 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:15.076552 10034 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:15.077093 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:15.077934 11317 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:15.078416 11317 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:15.079201 11317 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:15.075901 10186 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:15.096424 11331 tablet_copy_client.cc:806] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:15.097074 11331 tablet_copy_client.cc:670] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:15.098160  9934 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:15.101691 11331 tablet_copy_client.cc:538] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:15.119952 11331 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:15.139155 11239 raft_consensus.cc:993] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:15.139776 11322 raft_consensus.cc:1081] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:15.141939 10034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39426
I20260709 13:16:15.142554 10034 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:15.142915 10034 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.174520 10034 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:15.176975 10034 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:15.202623 11331 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:15.607427 11331 tablet_bootstrap.cc:492] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:15.609133 11331 ts_tablet_manager.cc:1403] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.489s	user 0.036s	sys 0.022s
I20260709 13:16:15.614516 11331 raft_consensus.cc:359] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:16.418053 11331 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:16.418848 11331 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:15.931500  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:16.139540 11337 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.420076 11337 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:16.422293 11337 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.202822 11335 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.291060 11209 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.394601 11339 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.425614 11209 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.425701 11339 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.426901 11337 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.427457 11209 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.394413 11340 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.430305 11340 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.432691 11340 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.399127 11342 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.399575 11343 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.433447 11343 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.412868 11130 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.434509 11130 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.436337 11130 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.422933 11335 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.416363 11295 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.436667 11343 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.427956 11339 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.387029 11341 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.437047 11295 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.437376 11341 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.438796 11295 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.427412 11337 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.433391 11342 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.429515 11331 ts_tablet_manager.cc:1434] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.818s	user 0.014s	sys 0.011s
W20260709 13:16:16.440410 11331 ts_tablet_manager.cc:1467] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Tablet startup took 828ms
I20260709 13:16:16.439465 11341 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.442790 11335 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.440763 11337 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.446463 11209 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.449136 11209 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.453615 10715 raft_consensus.cc:1217] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:16.454624 11337 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.455134 11337 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.447561 11339 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.440872 11342 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:16.440717 11331 ts_tablet_manager.cc:1469] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Trace:
0709 13:16:15.005446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.005554 (+   108us) service_pool.cc:224] Handling call
0709 13:16:15.007037 (+  1483us) ts_tablet_manager.cc:934] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
0709 13:16:15.022374 (+ 15337us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:15.087186 (+ 64812us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:15.087309 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:15.095359 (+  8050us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:15.095656 (+   297us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:15.096006 (+   350us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:15.096066 (+    60us) inbound_call.cc:177] Queueing success response
0709 13:16:15.119552 (+ 23486us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:16:15.611528 (+491976us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:16:15.612155 (+   627us) tablet_replica.cc:261] Starting instrumentation
0709 13:16:15.612801 (+   646us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":256,"raft.queue_time_us":14106,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"tablet-copy.queue_time_us":869,"tablet-download-pool.queue_time_us":158,"tablet-download-pool.run_cpu_time_us":944,"tablet-download-pool.run_wall_time_us":2906,"thread_start_us":1450,"threads_started":2}
I20260709 13:16:16.457564 11337 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.457396 11339 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:16.460554 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:16.461225 11338 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.461724 11338 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.462628 11340 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.463125 11340 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.464824 11346 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.465000 11340 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.465010 11338 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.466325 11340 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.481388 11209 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.469779 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:16.471544 11260 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.479030 11348 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.487169 11209 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.488583 11130 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.496250 11130 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.476300 11341 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.488729 11342 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.510435 11209 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.480803 11219 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.466789 11321 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.513427 11219 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.467204 11293 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.466569 11339 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:16.690065 11130 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.690665 11130 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.691068 11130 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.506664 11329 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.742616 11354 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.743220 11354 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.745589 11354 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.746061 11354 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.746526 11354 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:16.509150 11358 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.751701 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:16.752321 10715 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.752998 11209 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.753543 11209 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.754455 11209 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.488416 11260 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.761648 11209 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.762149 11209 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.747684 11362 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.577369 11343 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.514008 11321 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.766144 11130 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.772380 11130 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.772697 11360 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.772809 11130 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.766846 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:16.519784 11340 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.748842 11354 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.765364 11339 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.755321 11329 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.775516 11356 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.762548 11209 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.511729 11342 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.511899 11341 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.781540 11347 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.781952 11344 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.784538 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:16.758944 11293 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.783470 11130 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.778471 11361 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:16.770714 11343 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.869093 11209 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.866624 10714 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:16.871996 11365 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:16.872674 11365 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.875178 11321 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.875849 11345 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.781127 11295 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.782825 11337 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.896392 11359 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:16.488080 11346 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.519913 11348 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.899354 10715 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:16.773201 11360 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.779280 11353 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:16.879102 11219 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.767369 11358 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.936969 11342 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.937441 11361 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.835978 11362 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.781152 11339 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.865029 11356 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.950441 11329 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.880482 11347 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.876411 11345 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.973757 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:16.880313 11344 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.941171 11295 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.962214 11341 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.966341 11348 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.968284 11346 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.969614 11343 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.970773 11293 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.953438 11340 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.961006 11339 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.981174 11358 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.942929 11337 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:16.951442 11353 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.948302 11359 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:16.989336 11360 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.990527 11365 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.994303 11345 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:16.996376 11337 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:16.984251 11329 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.002066 11356 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:16.999323 11347 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.009087 11362 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.004397 11295 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.011551 11359 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.012701 11353 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.003651 11329 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.015473 11329 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.007603 11361 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.007726 11344 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:17.041081  9969 debug-util.cc:398] Leaking SignalData structure 0x7b08000912e0 after lost signal to thread 8942
W20260709 13:16:17.042995  9969 debug-util.cc:398] Leaking SignalData structure 0x7b08000919c0 after lost signal to thread 9972
W20260709 13:16:17.044982 10003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.006s
W20260709 13:16:17.045483 10003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.006s
W20260709 13:16:16.765586 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 291390us
I20260709 13:16:17.122843 11321 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.151145 11339 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.151348 11321 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.152249 11339 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:17.155210 11321 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.161515 11357 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.155401 11339 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.122712 11175 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.170622 11362 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.171979 11358 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.172964 11358 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.176061 11175 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.179132 11175 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.186394 11369 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.162703 11357 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.190783 11295 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.187222 11369 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:17.191735 11295 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.193861 11337 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.194741 11337 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.195214 11295 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.195777 11339 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.201848 11339 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.196921 11341 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.199767 11348 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.199853 11343 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.204198 11341 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.204809 11343 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.206773 11341 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.200600 11344 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.165987 11347 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.207197 11343 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.198004 11350 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.197417 11321 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.208292 11358 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.171600 11362 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.208616 11337 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.215795 11355 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.221611 11293 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.221932 11366 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.215679 11367 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.223397 11350 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.212057 11354 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.212224 11368 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.212131 11344 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.233522 11369 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.234104 11337 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.234277 11130 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.204280 11348 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.234172 11293 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.218212 11342 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.221711 11347 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.236476 11367 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.241261 11354 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.232304 10712 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:17.248440 11362 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.253312 11347 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.234102 11357 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.261000 11368 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.230348 11358 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.265370 11372 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.242245 11366 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.270368 11130 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.272354 11342 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.272907 11130 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.243021 11321 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.274281 11339 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.280100 11374 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.284636 11343 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.284471 11337 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.285493 11343 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.275849 11355 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.327631 11375 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.374890 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.377668 11344 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.377823 11342 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.378470 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.379314 10035 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:17.380753 11219 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.381268 11329 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.381569 11219 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.381991 11340 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.382675 11340 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.273415 11349 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.383179 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.286016 11366 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.280345 11358 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.386564 10187 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:17.349637 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.302150 11130 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.380817 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.329588 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.350781 11321 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.392875 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.372627 11293 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.392731 11345 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.394667 11175 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.329075 11348 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.327382 11367 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.395162 11339 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.302382 11350 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.398204  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:17.338622 11260 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.326479 11376 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.418551 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.419626 10182 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:17.420338 10036 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:17.394865 11353 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.422554 11353 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.404963 11346 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.424144 11346 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.425859 11175 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.311949 11370 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.421223 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.327951 11374 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.398370 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.323338 11372 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:17.452245 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.008s	sys 0.025s
I20260709 13:16:17.486668 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:17.495007 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.008s	sys 0.036s
I20260709 13:16:17.375104 11375 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.494690 11130 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.430207 11321 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.448748 11354 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.512108 11175 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.405519 11339 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.468585 11337 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.488878 11219 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.451601 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.522746 10186 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:17.518975 11343 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.515815 11373 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.402491 11329 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.448104 11345 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.486876 11376 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.486214 11370 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.524266 11368 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.590298 11375 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.591007 11377 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.588907 11371 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.562429 11348 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:17.587728 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:17.596045 11353 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.596596 11353 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.596794 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:17.597384  9969 debug-util.cc:398] Leaking SignalData structure 0x7b0800352f80 after lost signal to thread 10064
I20260709 13:16:17.597836 11219 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:17.597934 11286 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:17.598304 11219 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.519766 11175 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.598371 11286 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.598824 11219 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.599116 11286 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.696811 11355 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.697603 11329 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:17.598613  9969 debug-util.cc:398] Leaking SignalData structure 0x7b080034a5c0 after lost signal to thread 10139
I20260709 13:16:17.700183 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.520768 11260 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.534747 11358 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.563689 11340 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.553601 11374 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.561462 11372 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.528122 11337 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.560756 11378 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:17.700047 11175 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.714113 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.692612 11348 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.539161 11321 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.593024 11371 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.722187 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.591830 11377 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.512184 11349 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.722529 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.726233 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.542362 11373 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.726713 11340 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:17.699970 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.746017 10188 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:17.719820 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.724196 11353 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.746560 11378 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.752105 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.737152 11337 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.745513 11339 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.739147 11260 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.758011 11345 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.746639 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.759374 11260 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:17.755030 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.759979 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:17.756012  9969 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed640 after lost signal to thread 10213
I20260709 13:16:17.750322 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.767915 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.766062 11340 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.768496 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.760596 10710 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.770531 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:17.770684 11376 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.757665 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.773372 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.774353 10187 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.775458 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.776311 10187 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.777395 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.785074 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.762969 10182 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.773479 10111 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:17.784130 11353 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.784565 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.765982 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.784198 11337 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.786140 10107 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.784144 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.784579 11370 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.789529 10111 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:17.798313 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.797622 10710 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.796514 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.800438 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.800734 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:17.806933  9969 debug-util.cc:398] Leaking SignalData structure 0x7b080020ee60 after lost signal to thread 10740
I20260709 13:16:17.806502 10111 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.807134 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.807636 10111 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.809168 11371 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.810150 11340 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.810657 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.788058 11380 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.813575 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.802858 11175 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.817003 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.817628 10034 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:17.821892 11348 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.823625 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.824397 10035 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
I20260709 13:16:17.824808 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.825126 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.814556 11380 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:17.826743 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.828226 11380 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.828744 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.825534 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.829955 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.831241 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.829020 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.832540 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.833012 10036 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:16:17.834636 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.835425 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.836440 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.839193 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.840360 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.841405 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.843489 10111 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.846196 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.848891 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.847363 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.847249 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.851943 10181 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.853104 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.853268 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.854369 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.848618 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.851171 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.857272 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.847651 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.858343 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.859169 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.859449 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.859704 11373 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.855608 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.861323 10185 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.862115 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.863389 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.863969 10108 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.865621 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.866212 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.866808 10108 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.865968 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.867473 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.868067 10112 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.864248 11286 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.869737 10112 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:17.868140 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.872051 10189 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.859817 10187 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:17.877736 11348 raft_consensus.cc:1064] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:17.885195 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.856644 11219 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.954397 11130 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.952955 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.897852 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.909271 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.957610 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:17.967693 10108 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.888073 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.969039 11329 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:17.957490 11351 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:16:17.975509 10189 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.978021 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.948730 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.948866 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.952636 11378 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.982102 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.897395 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.954839 11219 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.980087 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.958673 11349 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:17.980064 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.886232 11286 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:17.983805 11348 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.966815 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.008100 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.009181 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.010371 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.958243 11346 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:18.014701 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.011488 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.015974 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.016074 10031 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:18.017047 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.980643 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.957027 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:17.989367 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:17.990688 10153 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.524s (SENT) [suppressed 4 similar messages]
W20260709 13:16:18.017903 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60968.8us
I20260709 13:16:18.017194 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.018366 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.018718 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.019444 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.020746 10036 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.021482 11354 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.021943 11354 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.022315 11354 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.994675 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.995002 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:17.995898 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-8111eefbfbe3442e98fd2c9b054ee1a5 received from {username='slave'} at 127.0.0.1:53672
I20260709 13:16:18.023895 10115 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:18.028378 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.029991 11345 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.030544 11345 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.028390 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-8111eefbfbe3442e98fd2c9b054ee1a5 on tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:18.030946 11345 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.996176 10110 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:17.996313 10180 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.996944 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.997617 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:17.998147 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.035048 10113 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:18.024629 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:17.907949 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.999907 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.000078 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.041115 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:18.001017 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.001708 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:17.987725 11329 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:17.997560 11321 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.004980 10112 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:17.985226 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.019385 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.047228 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:18.049441 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.050621 11130 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.053288 11130 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.053633 11130 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.021520 11209 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.055938 11209 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:18.056295 11209 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.051123 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.023527 11377 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.052291 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:18.060423 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:18.060794 11369 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.061128 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.061324 11369 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:18.061448 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.062342 11369 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.068200 11130 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.070528 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.070638 11376 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.071172 11376 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.071534 11376 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.072049 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.073117 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.073678 10189 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:18.074218 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.074488 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.075023 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.076184 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.076632 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.077059 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.077183 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.077316 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.077775 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.079356 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.080005 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.079483 10115 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:18.075547 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.067306 11209 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.071647 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.073807 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.081255 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:18.068461 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 77909.6us
I20260709 13:16:18.085215 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:18.087342 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.088564 11130 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.088536 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:18.092208 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62463.9us
I20260709 13:16:18.073050 11329 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:18.092629 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.084558 11377 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.080482 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.098590 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.103884 10113 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:18.102535 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.100520 11209 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:18.101697 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:18.105764 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.099159 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:18.102424 11130 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.107007 11130 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.107404 11130 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.108137 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.110025 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.110620 10109 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:18.113019 11340 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.113406 11340 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.113734 11340 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.113961 11345 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.092029 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.123446 11338 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.123907 11338 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.124248 11338 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.121342 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.112803 11209 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.093164 11380 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.104018 11358 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.145632 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.151520 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.152055 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.121887 10110 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:18.103091 11377 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.154549 11376 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:18.143941 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 114428us
I20260709 13:16:18.162724 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.169709 11130 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.163785 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.163641 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:18.162631 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 66185.8us
I20260709 13:16:18.149348 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.170728 10111 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:18.171504 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.173213 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.175468 11130 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.124845 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.176635 11345 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.178318 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.184093 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.179250 11351 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.185318 11351 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.185606 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.186141 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.186717 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.187215 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.188436 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.188025 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.190603 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.191226 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.166852 11358 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.191994 11358 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.192463 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.193109 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.194528 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.197816 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.172748 11377 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.199762 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.202373 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.204900 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.205730 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.204927 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.204198 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.207430 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.204272 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.185652 11351 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.179760 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.209134 11338 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.210558 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.211393 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.211853 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.212183 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.212958 11209 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.213312 11209 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.213621 11209 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.203130 11384 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.217152 11384 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:18.221602 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 115899us
I20260709 13:16:18.222060 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:18.223177 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.212733 11336 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.224467 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.226362 11130 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.217530 11384 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.227259 11130 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.227758 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.228401 11130 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.228636 10187 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:18.217788 11376 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:18.237360 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.238626 10711 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:18.240317 11385 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.226969 11336 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.227533 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.224411 11329 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:16:18.249987 11386 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.243867 11336 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.252154 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.252671 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.252905 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.253566 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.254217 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.254930 11354 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.255177 11209 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.255455 11338 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.256044 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.256771 10709 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.256500 11340 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.257876 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.245113 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.255990 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.233600 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.234553 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:58248
I20260709 13:16:18.293421 10187 raft_consensus.cc:606] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:18.293639 11130 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.294131 10115 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:18.282980 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.299255 11209 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.304832 10188 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:18.261970 11386 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:18.308966 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:18.262408 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49964.6us
I20260709 13:16:18.310292 11130 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.308132 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:18.312050 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 56287.4us
I20260709 13:16:18.313043 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.316982 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:18.318461 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.327845 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.330725 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.332031 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.307384 11373 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.334261 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.334960 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.317574 11380 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.337203 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.308645 11386 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:18.337689 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64600.8us
W20260709 13:16:18.338033 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.338109 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.338201 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.340790 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.338042 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.342177 11349 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.346504 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:18.329278 11348 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:18.356633 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 120009us
I20260709 13:16:18.359265 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.354048 11348 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.361498 11348 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.358078 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.367362 11345 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.364301 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.369458 11387 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.369876 11387 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.370245 11387 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.411253 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:18.417510 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:18.419149 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 106140us
I20260709 13:16:18.420953 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.421047 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:18.365604 11175 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.427659 10035 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.428992 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:18.425683 11391 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:18.426925 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.431202 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.431723 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:18.432134 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.434234 10038 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.435420 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:18.435911 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 82299.3us
I20260709 13:16:18.436673 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.437085 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:18.456935 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:18.445952 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87947us
I20260709 13:16:18.458680 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.448266 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:18.451186 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.461458 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:18.454807 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 233202us
I20260709 13:16:18.424144 11286 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.376209 11373 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:16:18.427649 11345 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.439086 11349 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.471903 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:18.474380 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:18.472147 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46946.3us
I20260709 13:16:18.420014 11385 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:16:18.488762 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:18.428419 11377 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:18.457902 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:18.460131 11329 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:18.509326 11286 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.509622 11351 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.510777 11385 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.508440 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.511797 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:18.465777 11338 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:18.517192 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58600.6us
I20260709 13:16:18.521723 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.522951 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.524791 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.527532 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.535117 10107 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.535426 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.513149 11378 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.538183  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 169) took 1293 ms. Trace:
I20260709 13:16:18.538573  9934 rpcz_store.cc:276] 0709 13:16:17.236341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.241235 (+  4894us) service_pool.cc:224] Handling call
0709 13:16:18.526265 (+1285030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85649,"reported_tablets":9}
I20260709 13:16:18.543604 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.546124 10034 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.551807 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.536670 11329 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.533422 11349 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.539292 11286 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.557343 11130 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.557711 11130 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:18.558022 11130 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.558290 11377 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:18.558900 11286 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.550585 11353 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:18.561988 11329 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.562933 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.564635 11130 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.566474 11130 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.568089 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.535055 11355 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:18.587136 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 74899.5us
I20260709 13:16:18.535351 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.618208 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:18.620131 11351 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.552942 11385 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:18.621630 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 113311us
W20260709 13:16:18.618443 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78211.7us
W20260709 13:16:18.621920 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 108977us
I20260709 13:16:18.581900 11381 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:18.625360 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69349.6us
I20260709 13:16:18.628145 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.614619 10032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:18.620725 11395 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:16:18.636631 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.636188 11355 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.640273 11355 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:18.645179 11340 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.649441 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:18.635893 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 205313us
I20260709 13:16:18.682446 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.636406 10032 raft_consensus.cc:606] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:18.683914 11371 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.627324 11358 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.684554 11371 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.686335 11358 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:18.688215 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50458.5us
I20260709 13:16:18.687417 11387 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.689489 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:18.690203 11387 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.691048 11373 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.693495 11346 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.693877 11346 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:18.730188 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81824.5us
I20260709 13:16:18.646871 11348 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:18.732192 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50505.4us
I20260709 13:16:18.633983 11384 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:18.734752 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52649.2us
W20260709 13:16:18.734858 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52729.3us
W20260709 13:16:18.732098 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 83817.5us
I20260709 13:16:18.732497 11321 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:18.740711 11321 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:18.741086 11321 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:18.741863 11321 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.742372 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.735709 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:18.745577 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56144.9us
I20260709 13:16:18.746654 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.744217 11396 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:18.748281 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:18.748358 11396 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.749459 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:18.750005 10034 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.750376 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:18.748703 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:18.751526 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.752418 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.753005 10032 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.753602 11286 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:18.754153 11286 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:18.743908 11375 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:18.757737 10034 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:18.694150 11336 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.759481 11209 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.759963 11349 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.760288 10033 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.760463 10034 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.762398 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:18.762964 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:18.754276 10038 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.754176 11394 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.764631 11371 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:18.764999 11397 raft_consensus.cc:993] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:18.765395 11397 raft_consensus.cc:1081] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:18.765617 11371 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:18.768365 11378 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.768750 11378 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:18.769593 11378 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.772765 11384 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.773072 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.774590 11371 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:18.744417 11346 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:18.774593 11386 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:18.775954 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.767513 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:18.925388 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 178793us
I20260709 13:16:18.928210 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:18.796100 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.778451 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:18.967869 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 217533us
I20260709 13:16:18.942266 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:18.950004 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.775882 11346 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.023914 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.025090 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.026052 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.758435 11373 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.027904 10038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:18.782510 11354 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.983359 11339 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.937562 11286 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.846046 11175 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
I20260709 13:16:18.985139 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:18.986620 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 219171us
W20260709 13:16:18.991035 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 48236.8us
I20260709 13:16:19.015442 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.020993 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:18.987763 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:18.777135 10039 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.031848 11348 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.785290 11385 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.855697 11396 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:18.777318 11336 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.848920 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.038312 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:18.777100 11386 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:18.785817 11358 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:19.048228 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 269837us
W20260709 13:16:18.988960 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46800.2us
I20260709 13:16:19.049975 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.021687 11355 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.024017 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.030321 11378 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.054315 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:19.030575 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:19.032603 11337 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.075482 11337 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:19.075937 11337 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.849448 11381 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 13:16:19.038017 10038 raft_consensus.cc:606] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.058691 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:19.067909 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82813.9us
I20260709 13:16:19.049770 11385 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:19.070597 11335 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.072381 11321 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.087908 11335 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:18.983314 11380 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:16:19.036260 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.083530 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.084915 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.064903 11396 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.060953 11371 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.092480 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.101044 11329 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.101718 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.102909 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.103346 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.104982 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.094803 11353 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.107618 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.096221 11377 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.096889 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:19.097728 11380 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.098698 11339 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.089210 11335 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.112490 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:19.122464 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.123901 11130 raft_consensus.cc:993] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:19.124301 11130 raft_consensus.cc:1081] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:19.114764 11380 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:19.099677 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 111627us
I20260709 13:16:19.113415 11340 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.114750 11354 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.129173 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.113261 11358 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.130299 11130 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.130702 11130 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.131111 11130 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.119160 11339 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:19.120797 11175 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.121415 11336 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.150916 11392 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.151338 11392 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.151686 11392 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.123596 11348 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.124475 11398 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.150322 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:19.130890 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46068.3us
I20260709 13:16:19.126377 11321 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.114555 11351 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:19.163537 11130 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.131126 11354 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.168390 10114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:16:19.168854 11354 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.148597 11373 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.149498 11377 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:19.172724 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44469.7us
I20260709 13:16:19.174479 11130 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.178653 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:19.166656 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.152633 11336 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.181972 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.182765 11175 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.185245 11339 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.180968 11336 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.172874 11373 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:19.191145 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.166887 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.189893 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.196233 11394 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.196527 10182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:19.197724 10182 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:19.198088 10182 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.199471 11339 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:19.200368 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 77992.9us
I20260709 13:16:19.201067 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.166014 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.206995 11355 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.207389 11355 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:19.208274 11355 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.203315 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.209245 11355 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.193045 11373 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.194685 11377 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:16:19.211210 11390 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.213310 11387 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:19.213516 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60673.6us
I20260709 13:16:19.214619 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.215358 11394 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.219723 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.204541 11376 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.160204 11380 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.149868 11385 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.193396 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.223146 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.224882 11358 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.225226 11358 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.225580 11358 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.193923 11348 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.223657 11376 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.228665 11376 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.229019 11376 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.232306 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:19.232546 11377 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.235867 11353 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.237360 11353 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:19.238834 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45537.9us
I20260709 13:16:19.239532 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.238153 11353 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.247565 11353 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.238073 11380 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:19.264178 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 97357.5us
I20260709 13:16:19.264911 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:19.265195 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 83289.5us
I20260709 13:16:19.248639 11371 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.266870 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.269318 11209 raft_consensus.cc:2764] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:19.251572 11392 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.236763 11354 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.260118 11375 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.259935 11397 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.272028 11390 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.277972 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.278434 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.284407 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.285702 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.281603 10040 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.286712 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.267570 11385 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.282202 11373 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.288228 11405 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.288661 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.289143 11386 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:19.282712 11335 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.301019 11335 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:19.301841  9936 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 4, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.306739 11336 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.291987 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.292697 11130 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.294732 11354 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.295841 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:19.297354 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.298272 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.316385 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.317191 11130 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.318549 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.319326 11130 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.308802 11371 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.320602 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.321018 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.322250 10106 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:19.317817 11354 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.322321 11393 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.328999 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.330576 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.331096 11335 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.331732 11335 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.290383 11369 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.324265 11397 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.299578 11386 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:19.340987 11386 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.342679 10115 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:19.331650 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.335278 10040 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:19.338310 10711 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:19.338207 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.338692 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.334587 11376 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.340420 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.345224 11409 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.331759 11390 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.311978 11337 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:19.346638 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:19.346941 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.365126 11329 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.345455 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.351684 11376 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.349562 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:19.356190 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.354283 11407 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:19.373118 11394 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.374230 11393 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.374691 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.375175 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:19.375830 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.376525 11375 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.376931 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.377149 11375 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.377703 11375 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.378024 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.378468 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.379132 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.379662 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.334481 10182 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.380051 10113 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:16:19.380837 11405 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.381686 10182 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:19.382659 10183 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:19.382921 10114 raft_consensus.cc:606] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.383297 10114 raft_consensus.cc:614] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:19.383791 11335 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.384186 11335 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:19.384555 11335 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.388067 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.389720 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.391964 11393 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.393098 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.393795 11405 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.394923 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.395583 11405 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.395489 11376 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.396978 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.397346 11376 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.397614 11405 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.397725 11376 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.398734 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.398584 11376 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.399398 11405 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.357334 11337 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:19.354936 11397 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.399696 11376 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.358151 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.402846 11407 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.403218 11407 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:19.358376 11390 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.404022 11407 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.359187 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.405162 11407 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.359670 11346 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.406548 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.406963 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.405397 10110 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:19.367611 10112 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:19.368562 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.395574 10713 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.357235 11336 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.379776 11398 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.419972 10110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:16:19.420542 10110 raft_consensus.cc:606] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.420725 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.409847 11358 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:19.422108 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.422767 11358 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.411057 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.424062 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.424659 11377 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.425103 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.425762 11377 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.426839 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.406512 11346 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:19.428833 11346 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.430132 11346 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.431192 11397 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.431900 11337 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.432479 11337 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.433377 11337 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.433676 11337 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.434469 11337 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:19.419620 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.437798 11397 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.438575 10711 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.420655 10189 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:16:19.413599 10108 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:19.413621 11390 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.435539 11337 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.443706 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.444242 11377 raft_consensus.cc:993] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:19.444664 11377 raft_consensus.cc:1081] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:16:19.447901  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:19.449512  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:19.450696 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.451498 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.455888 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:19.457309 10108 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:19.459862 10108 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:19.446496 11386 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.463135 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.463703 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.464589 10115 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:19.470425 11392 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.471247 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.471150 11335 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.473234 11335 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:19.475036 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.475270 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:19.411712 11373 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:19.475947 10110 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:19.464030 11386 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.477250 11373 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.471379 10707 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.484251 10039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39426
I20260709 13:16:19.485037 10039 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:19.485435 10039 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.500042 10713 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:19.501588 10711 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.504702 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.505350 10108 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.513283 10108 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:19.520411 10182 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:19.518653 11390 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:16:19.522717 10039 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.524220 11397 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.524628 11397 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.525617 11336 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:19.526780 11336 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.527151 11336 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.527490 11335 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:19.527541 10039 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:19.528770 11398 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.528299 11336 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.529151 11398 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:19.513489 10004 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1fa3c9e8a7a496eaa49ec78b5a92103. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.529994 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.530054 11398 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.530875 11376 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.531966 11398 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.533039 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.525475 11397 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.534394 11392 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.534462 11397 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.541512 11335 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.542738 11390 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.543082 11390 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.543952 11390 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.545811 11390 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.529855 11336 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.550345 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.556231 11335 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:19.556243 11392 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.558084 11337 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.558470 11337 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.559311 11337 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.562193 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:19.562225 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.556902 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.566648 11337 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.567167 11392 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.568471 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.571606 11392 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.571939 11335 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.572697 11335 consensus_queue.cc:1243] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:19.573268 11335 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:19.573921 11335 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.564868 11395 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.588503 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.589010 11392 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:19.589530 11376 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:19.590044 11376 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.590323 11392 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.590750 11392 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.590920 11376 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.591670 11392 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.593333 11392 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.597672 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.598419 10109 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.599306 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.608336 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.608743 10711 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.609478 10110 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 2: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:19.611558 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.614239 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.588994 11395 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:19.575949 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:19.574951 11335 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.620151 11335 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.626909 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.627619 10110 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.629189 10711 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:19.628141 10110 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:19.630108  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.631016 10110 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.633709 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:19.635798 10711 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.641139 10182 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:19.641574 10182 pending_rounds.cc:85] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 2
I20260709 13:16:19.642017 10182 pending_rounds.cc:107] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:19.642313 10182 raft_consensus.cc:2889] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.642695 10110 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.643448 10039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:16:19.644101 10039 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:19.647691 11407 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.644465 10039 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.656746 10040 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:19.659420 10040 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.660506 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:19.660943 10034 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.661273 10036 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:19.661993 10034 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.662325 11335 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.662808 11335 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:19.663235 11335 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.663364 11418 ts_tablet_manager.cc:933] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:19.663545 11376 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.666198 10036 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.666368 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.667130 10038 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.667066 11376 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.667447 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:19.668521 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 92644.3us
I20260709 13:16:19.669196 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.670518 11386 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.671733 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:19.673367 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:19.674870 10034 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.674329 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:19.673437 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.672885 10032 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.676100 10033 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.678617 11337 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:19.681740 11337 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.682649 11337 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.680068 11358 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.685326 10039 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.687084 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.688254 10031 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:19.675884 11386 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:16:19.689129 11386 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.689471 11386 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.690299 11386 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:19.690934 10039 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:19.692687 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.692843 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:19.672219 11376 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.693532 10189 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.694916 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.694416 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.698450 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.675580 10109 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
W20260709 13:16:19.700124 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.699705 11409 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.702054 11407 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.702526 11407 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.704604 11407 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:19.705524 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:19.706183 10713 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:19.699971 11392 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:19.706561 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:19.707053 11392 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.707232 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:19.697536 11336 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.708034 11407 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.705307 11390 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.708420 11407 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.710131 11407 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.709139 11392 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.696935 11386 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.696593 11358 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:19.716046 11358 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.716920 11358 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.718183 10189 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:19.720909 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:19.721745 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.721760 11369 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:19.722697 11335 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.722734 11369 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.725777 11369 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.722702 10040 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:19.730105 10037 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:19.732972 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.734676 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.734289 11336 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.736690  9935 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:19.748189 11376 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.748558 10110 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:19.749586 10037 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:19.753221 11346 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.751783 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.758327 11369 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.692167 11395 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.758322 10711 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:19.760655 11418 tablet_copy_client.cc:323] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.193:38563
I20260709 13:16:19.762224 11395 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.762624 10050 tablet_copy_service.cc:140] P 9a67604b91f54791b1316fd327793337: Received BeginTabletCopySession request for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:55698)
I20260709 13:16:19.763193 10050 tablet_copy_service.cc:161] P 9a67604b91f54791b1316fd327793337: Beginning new tablet copy session on tablet f1fa3c9e8a7a496eaa49ec78b5a92103 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:55698: session id = 2f672b54d4754c5aa62b5b919597a14e-f1fa3c9e8a7a496eaa49ec78b5a92103
I20260709 13:16:19.768550 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:19.767697 11335 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:19.772601 10050 tablet_copy_source_session.cc:215] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:19.776467 10110 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:19.774890 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:19.776957 11407 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.777704 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:19.778010 11358 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:19.778499 11358 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.778684 11418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fa3c9e8a7a496eaa49ec78b5a92103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:19.778466 11335 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:19.779323 11335 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.779511 11358 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.780397 11335 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.784071 11407 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:19.790874 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:19.794232 11376 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:19.794811 11376 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.795691 11376 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.803431 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:19.791419 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:19.807888 10711 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.808519 11418 tablet_copy_client.cc:806] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:19.809214 11418 tablet_copy_client.cc:670] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
W20260709 13:16:19.809278 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.811987 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.813464 11391 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:19.814100 11391 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.815028 11391 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.815896 11397 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.816232 11397 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.824828 10108 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.816962 11397 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.834239 11397 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.837704 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:19.839092 10713 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.839955 11418 tablet_copy_client.cc:538] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:19.840947 11390 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.848023 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:19.841986 11390 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.845604 11405 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:19.851874 11375 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:19.842327 11391 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:19.844996 11337 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:19.859052 11390 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.876633 11390 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.846271 11398 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:19.878153 11390 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.878835 11398 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.879217 11398 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.878188 11393 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.880487 11393 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.880053 11398 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.881438 11393 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.882797 11393 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.876541 11337 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.885250 11337 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.886111 11337 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.887444 11337 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.873502 10110 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:19.889829  9935 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:19.881479 11398 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.900839 11209 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.918272 11386 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.918669 11392 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.921667 10039 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:19.922513 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:19.923207 10037 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:19.924459 11391 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.925408 11391 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.925734 11391 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.926510 11391 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.930749 11336 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.931804 11369 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:19.918689 11386 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.934857 11353 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.934429 11391 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.917622 10713 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:19.932139 11369 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:19.938577 10711 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:19.954057 11335 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:19.942445 11375 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.972918 11369 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.974275 11369 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.974956 10707 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:19.971382 11386 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:19.953878 11353 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:19.997449 11353 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:19.999529 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.000171 10189 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:20.001062 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.001673 10040 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:20.001956 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.003588 11373 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.003974 11373 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.004307 11373 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.962815 11335 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:19.993618 11386 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.007490 11335 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.021427 11335 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.040560  9935 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.045153  9935 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.046739  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.043865 11418 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:16:20.065258 11373 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.073526 10110 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.076967 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:20.079021 11373 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.079301 11353 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:20.079895 11353 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:20.077129  9935 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 2 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.080724 11353 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.081166 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.075733 11337 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:16:20.081724  9935 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.083361 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.088794 10037 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.091405 10183 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.109467 11375 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.134019 10106 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.136096 11386 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.139806 10183 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:20.142935 10182 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.157073 10040 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.145071 10707 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:20.159192 11335 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.149364 10189 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:20.161787 11386 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:20.163394 11386 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:20.173365 10182 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.176133 11386 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.144003 10037 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:20.180594 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.181481 11353 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.182045 11353 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:20.182900 11353 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.184100 11418 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:20.185146 11418 tablet_bootstrap.cc:492] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:16:20.185899 11418 ts_tablet_manager.cc:1403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.194s	user 0.028s	sys 0.004s
I20260709 13:16:20.188189 10180 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.209020  9935 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.222577 11418 raft_consensus.cc:359] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:20.223508 11418 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:16:20.224177 11418 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:20.225198 11395 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.225641 11395 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.227623 11395 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.228929 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.229606 10037 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:20.230609 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:20.245659  9936 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.247859 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.249886 11432 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.260144 11418 ts_tablet_manager.cc:1434] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.006s
I20260709 13:16:20.260540 10180 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.262959 11376 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.266860 10050 tablet_copy_service.cc:342] P 9a67604b91f54791b1316fd327793337: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-f1fa3c9e8a7a496eaa49ec78b5a92103 received from {username='slave'} at 127.0.0.1:55698
I20260709 13:16:20.267349 10050 tablet_copy_service.cc:434] P 9a67604b91f54791b1316fd327793337: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-f1fa3c9e8a7a496eaa49ec78b5a92103 on tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:20.274102  9934 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.274797 10109 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.270295 10040 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.261343 11395 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:20.279088 10110 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:20.279100 11335 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.279933 10106 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.281451 11395 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.256486 11432 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.282410 11432 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.290235 11395 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.291452 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.292303 10037 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:20.293303 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.294014 10189 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 2: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:20.295279 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:20.300318 11209 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.302291 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:20.303017 10106 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:20.303115 11386 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:20.311064 11369 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.330662 10189 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:20.315402 11395 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.344090 11385 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.347437 11385 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.351003 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.353747 11385 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.351704 10040 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:20.344929 10181 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.356884 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:20.358546 11329 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.358960 11329 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.359287 11329 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.360509 11338 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:20.361832 11369 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.364131 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.366727 10707 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:20.368242 10711 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:20.368884 11385 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.369431 11385 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.372516 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.373220 10040 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:20.373818 11392 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:20.374305 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:20.375214 11392 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:20.378096 11346 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.378578 11346 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.382107 11329 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.384330 11385 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.386029  9936 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.372422 10108 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.391161 11335 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.394032 11346 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.396703 11432 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.397827 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.398541 10039 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:20.399003 11432 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.400053 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.397037 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.400477 11329 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.399596 11432 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.401634 10189 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:20.422223 11353 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.424053 11353 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.424399 11353 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.426453 11395 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:20.423008 11432 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.427672 11432 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:20.421948 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53757.9us
W20260709 13:16:20.420152 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45931.1us
I20260709 13:16:20.445392 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.446060 10039 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.450834 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.454382 11432 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.456235 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.456889 10037 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.465075 10037 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:20.467109 11353 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.477535 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:20.479209 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.480728 11432 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.484766 11353 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.485736 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.514310 10182 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.517127 11432 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.517594 11432 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:20.518435 11432 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.487969 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.450640  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:20.520161 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.520732 10040 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.503139 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.504892 10039 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:20.507823 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.532886 10037 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.540339 10040 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:20.550614 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:20.554107 10037 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:20.558399 10182 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:20.559764 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.564549 11346 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.565058 11346 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:20.565910 11346 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.573578 10039 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:20.573974 10039 pending_rounds.cc:85] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 4
I20260709 13:16:20.574196 10039 pending_rounds.cc:107] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:20.574441 10039 raft_consensus.cc:2889] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:20.576839 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:20.580560 11353 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:20.586453 11385 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:20.587041 11385 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:20.587939 11385 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.581396 11454 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.589905 11454 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:20.590801 11454 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.607491 10709 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:20.608973 11456 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:20.649261 11373 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.649794 11373 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.656900 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.657552 10037 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:20.658629 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.659492 11456 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.659886 11456 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.661602 10108 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.660239 11456 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.672415 10108 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.674468 11337 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.683085 11373 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.684343 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.724391 11456 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.731622 10037 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:20.733510 11337 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.737485  9936 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.740267  9936 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.742830  9936 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.747002 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.749053 11456 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.749912  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:20.753707 10040 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:20.757915 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.758522 10039 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.762296 11456 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.775225 10181 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:20.777004 11346 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.786751 10039 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:20.788235 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:20.789013 11456 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:20.789498 11456 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:20.790362 11456 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.807097  9938 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.859025 11373 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.859563 11373 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.864833 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.868223 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.868904 10039 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:20.873504 11392 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.874059 11392 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.875144 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:20.876036 11456 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.876457 11456 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.876765 11456 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.877985 11392 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.879832 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.881037 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:20.881775 10108 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:20.883764 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:20.887337 11376 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.887861 11376 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.888289 11376 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.884335 11373 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.905471 11376 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.906059  9938 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.907496 11391 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:20.908082 11391 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.910151 11391 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:20.910275 11337 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:20.910771 11337 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.912241 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:20.912881 11337 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:20.912977 10108 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:20.914808 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.915122 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.915570 10031 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:20.916906 10155 leader_election.cc:400] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:20.917188 10155 leader_election.cc:403] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.917960 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:20.920980 11391 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:20.925305 11391 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:20.925760 11391 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:20.921497 11337 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.922451 11397 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:20.927271 11376 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.927357 11397 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.928961 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.929651 11397 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:20.931339 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.932134 10031 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:20.932297 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:20.915508 11456 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.937981 10110 raft_consensus.cc:2368] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:20.922621 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.938606 10039 raft_consensus.cc:2368] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:20.939826 11456 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.942163 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:20.942680 10153 leader_election.cc:400] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:20.942847 10184 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.942152 10155 leader_election.cc:400] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:20.939893 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.943802 10031 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.923671 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:20.946461 10108 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.949723 10153 leader_election.cc:403] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.952632 10184 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:20.953197 11397 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:20.955025 11335 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.955538 11335 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.957696 11335 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:20.959128 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.960316 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.961024 11456 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.961309 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:20.961592 11456 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:20.961869 11337 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:20.962483 10031 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:20.963204 11346 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:20.963487 11391 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.962636 11456 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.963757 11346 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.964722 10182 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.965535 11373 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.965999 11373 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:20.972258 10182 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:20.973582 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:20.974141 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:20.974359 10184 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:20.975247 11376 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:20.975627 11353 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:20.976091 11376 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:20.976150 11353 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:20.977267 11376 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.980500 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:20.981418 11458 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:20.982620 11458 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:20.983537 10108 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:20.984560 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:20.984823 11458 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.985380 11458 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.985657 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.985740 11458 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.986423 11458 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.986426 10039 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:20.979972 11353 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:20.993712 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:20.994566 10711 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:20.994654 11373 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:20.961992 10707 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:20.995860 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:20.996707 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:20.996975 11346 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:20.996483 10039 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:20.997551 11337 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.997973 11337 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.998299 11337 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.003381 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.005501 11458 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:21.007355 11391 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:21.011853 10182 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.012216 11373 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.011783 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:21.012703 11456 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.013103 10110 raft_consensus.cc:2368] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:21.012838 11373 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.013280 11456 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.014370 10153 leader_election.cc:400] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:21.014657 10153 leader_election.cc:403] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.017030 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.017752 10037 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.016155 11391 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:21.018968 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.019147 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.018712 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.019778 10184 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.020434 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.016652 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.021036 10181 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.018255 11335 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.019554 10188 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.022394 11335 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.023486 10037 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:21.021178 10031 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.024432 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.024981 10040 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.025602 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.015616 11373 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.028198 11458 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:21.028991 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.029690 10031 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:21.031730 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:21.033649 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:21.038579 11353 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.039007 11353 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.039366 11353 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.039239 11337 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.039568 11432 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:21.041738 11337 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:21.042932 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:21.043409 10181 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.044538 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:21.045153 10711 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.046986 10188 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.045320 10039 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.024437 11335 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:21.049360 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.049590 11335 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:21.050091 11335 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.038497 11397 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.052968 11397 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.053309 11397 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.058419 11353 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.060122 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.060770 10037 raft_consensus.cc:2368] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:21.061960 10155 leader_election.cc:400] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:21.061988 10040 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:21.062347 10155 leader_election.cc:403] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.064136 11373 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.064627 11373 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.065044 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:21.065367 11391 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.068195 11346 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.068558 11335 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:21.068676 11346 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:21.069123 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:21.069669 11346 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:21.071614 10039 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:21.072775 10711 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:21.073041 11458 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.074002 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.058465  9938 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.077276 11456 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.078574 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:21.078934 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45372.3us
I20260709 13:16:21.079403 10039 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.079646 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.081064 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.081841 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.084578 11473 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.084611 11458 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.085191 11473 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.085258 11458 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.085846 11458 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.085791 11473 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.095105 11458 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.096916 11456 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.098472 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:21.121994 10711 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:21.099850 11353 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:21.123481 11456 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.123970 11456 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.106788 11335 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.125649 11335 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:21.126467 11335 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.123219 11458 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.106101 10188 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:21.107221 11397 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.116976 10040 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:21.134523 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.133266 10031 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:21.135102 10040 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.135984 11453 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:21.102041 10181 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:21.142505 10040 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:21.143783 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:21.141546 11453 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:21.146301 11337 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:21.149024 11477 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.150286 11477 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:21.150245 11337 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:21.151302 11477 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.152734 11337 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:21.155910 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:21.156610 10110 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.132310 11452 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:21.146605 11373 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.171221 11209 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.172741 11209 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.174633 11209 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:21.095611 11473 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.176365 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.151028 11397 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:21.186473 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 104132us
I20260709 13:16:21.200380  9934 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.196099 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:21.210336 11478 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.210587 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:21.225744 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 143952us
I20260709 13:16:21.232911 11473 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.233242 10031 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.231408 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.235301 10106 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:21.229110 11478 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.245883 11478 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:21.246995 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 103315us
I20260709 13:16:21.248667 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.249317 10034 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:21.251444 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.252063 10189 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.252115 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:21.253556 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.253849 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:21.255225 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.247649 10707 raft_consensus.cc:2368] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3.
I20260709 13:16:21.266490 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:21.255955  9936 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.268733 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.270340 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.271168 10031 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.256866 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.272493 10033 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.250981 10184 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.249791 11369 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.270015 10187 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.275661 11369 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:21.253592 11452 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.276738 11452 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.277829 11369 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.279171 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:21.280062 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.280678 10109 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:21.286535 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:21.287077 11346 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:21.289458 11480 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:21.267963  9938 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.290825 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:21.296029 11453 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:21.296985 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.295547 10004 leader_election.cc:400] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3.
I20260709 13:16:21.298013 10004 leader_election.cc:403] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.256644 11456 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.269238 11478 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.300472 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.302680 11209 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.298431 11453 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.304826 11452 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.304992 11453 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.252781 10183 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:21.310626 11456 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.314600 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.315471 10037 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.318684 10185 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.320278 11456 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.321686 10186 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.322860 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:21.324069 11456 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.296461 11391 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:21.330518 11456 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.330792 11477 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.331195 11458 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.332820 10184 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:21.314391 11478 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:21.324051 10109 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:21.341059 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:21.356096 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 88822.1us
I20260709 13:16:21.344059 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.372332 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.374593 10188 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:21.378193 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.379016 10186 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:21.348618 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:21.357431 10180 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.376539 11391 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.382921 11391 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.383944 10183 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:21.350734 11477 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:21.386811 11373 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.387288 11473 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.387687 11454 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.385654 11477 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.393890 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:21.405145 10185 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:21.361268 11478 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.435027 11493 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.443958 11209 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3.
W20260709 13:16:21.443624 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49833us
I20260709 13:16:21.451328 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:21.462407 11391 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:21.452217 11358 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.432865 10182 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:21.401616 11452 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:21.425693 11454 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.463147 11358 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.487430 11358 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.498375 11456 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.498903 11454 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.511094 10039 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:21.519009 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 131946us
I20260709 13:16:21.520973 10188 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:21.524336 10040 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:21.520198 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 133873us
I20260709 13:16:21.517829 11458 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.529680 11458 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:21.527403 11473 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:21.535811 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.536880 10040 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:21.517633 11353 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:21.539710 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:21.540288 10040 raft_consensus.cc:606] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:21.532582 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.532467 11373 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:21.544590 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:21.545511 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.540330 11493 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:21.583048 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.563308 11456 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.589982 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.562392 11499 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:21.539323 11477 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:21.552435 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:21.566334 11488 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.561206 10184 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:21.600464 10711 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:21.604921 10039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:21.605551 10039 raft_consensus.cc:606] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:21.625007 11209 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.625595 11209 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.581641 11346 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:21.590399 10180 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:21.630338 11392 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.630486 11209 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.632720 10039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:21.598284 11488 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.633302 10039 raft_consensus.cc:606] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:21.553160 11385 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:16:21.632198 11493 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.636535 11477 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:21.584378 11458 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.588693 11453 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.631053 11353 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.645071 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:21.645576 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:21.649072 11209 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.653776 11209 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.660398 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:21.638360 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:21.649874 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:21.643157 11488 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:21.649549 11487 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:21.631220 11392 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.769800 11209 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.686532 10107 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:21.796793 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:21.797444 10188 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:21.633721 11473 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.771755 11501 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:21.796209 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 140477us
I20260709 13:16:21.682277 11353 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:21.819702 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 368450us
I20260709 13:16:21.811096 11501 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.818871 11358 raft_consensus.cc:993] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:21.819535 11507 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.818354 10033 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:21.879029 10113 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:21.675149 11482 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.199s
I20260709 13:16:21.852720 11501 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.890897 11453 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.879978 11358 raft_consensus.cc:1081] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:21.897621 10037 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:21.898722 11353 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:21.885360 11414 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:21.884013 11489 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:21.886507 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:21.908375 11392 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.678136 11373 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:21.918438 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64263.1us
I20260709 13:16:21.922678 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:21.925542 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:21.930336 10037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:21.931028 10037 raft_consensus.cc:606] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:21.949271 10114 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:21.954448  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:21.882005 11507 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.956250  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:21.928695 11369 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.925609 11478 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:21.958947 11482 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:21.944172 11506 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.961313 11369 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.973603 10111 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
W20260709 13:16:21.972383 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 176029us
I20260709 13:16:21.989733 11504 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:16:21.991075 11501 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:21.997548 11501 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.993741 11478 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.973706 11369 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.995131 11507 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:21.969647 11506 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.004304 11506 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.024619 11488 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:22.026997 11488 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:22.032503 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:22.040617 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:22.041327 10107 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.041216 11369 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:22.065393 11369 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:22.069851 10107 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:22.071331 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:22.083510 11452 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:22.084089 11452 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:22.095430 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:22.096154 10187 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.111954 11452 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:22.101673 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:22.099305 10182 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:22.120260 10181 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.159523 10186 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:22.161533 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:22.163618 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:22.162123 10186 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:22.168431 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:22.169170 10189 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:22.174218 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:22.175037 10037 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:22.180564 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:22.183205 11527 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.184120 11527 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:22.185607 11527 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:22.190748 11499 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:22.193219 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:22.194164 10182 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:22.191221 11506 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:22.203212 11506 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:22.204247  9934 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.208580 10187 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
W20260709 13:16:22.208395 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 521392us
I20260709 13:16:22.207015 10180 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:22.207315 10181 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:22.209923 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:22.220917 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:22.223312 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:22.236121 10037 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:22.305078 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:22.305861 10040 raft_consensus.cc:2368] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3.
I20260709 13:16:22.219889 11385 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:22.326359 10114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33512
I20260709 13:16:22.327028 10114 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.327440 10114 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.329098 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:22.314726 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93916.3us
I20260709 13:16:22.312296 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:22.220294 11501 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.332090 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:22.337881 10039 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:22.342645 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:22.343914 10186 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.345350 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:22.345968 10111 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:22.346661 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 93939.3us
I20260709 13:16:22.350277 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:22.351482 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:22.352068 10113 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:22.352733 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 267011us
I20260709 13:16:22.379344 11209 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:22.379842 11209 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.380188 11209 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.382619 10185 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:22.383849 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:22.381024 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:22.341135 11337 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:22.392709 10113 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:22.338682 11385 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:22.400205 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:22.359390 11508 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:22.306885 11491 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 13:16:22.391464 10186 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:22.361989 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:22.424335 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52303.1us
I20260709 13:16:22.431082 10111 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:22.432595 11209 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:22.435019 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:22.438644 11209 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:22.351267 11353 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:16:22.343508 11501 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:22.448052 10186 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.399686 11507 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:22.399855 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:22.413182 11456 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.438211 11458 raft_consensus.cc:2764] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:16:22.438055 10180 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.439985 11508 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:22.540371 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 113702us
I20260709 13:16:22.455706 11507 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:22.551885 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 107320us
I20260709 13:16:22.556020 10081 leader_election.cc:400] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3.
W20260709 13:16:22.558902 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 140207us
I20260709 13:16:22.526219 10181 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:22.570583 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:22.571475 11358 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:22.572032 11358 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:22.573192 11491 raft_consensus.cc:993] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:22.572979 11358 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:22.573766 11491 raft_consensus.cc:1081] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:22.551432 11507 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.577315 10185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:22.580042 10185 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.580518 10185 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.448009 11385 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:22.576439 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:22.556783 11456 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.588580 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:22.598353 10186 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.598891 11456 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:22.664506 11531 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:16:22.665390 11522 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:16:22.680361 11508 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:22.701927 10186 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:22.706607 10185 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:22.738392 11456 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:22.744442 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 168090us
I20260709 13:16:22.745217 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:22.758167 10187 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.764101 10185 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:22.765496 11529 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:22.766043 11529 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:22.774226 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:22.774956 10188 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
W20260709 13:16:22.770888 11524 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:16:22.771848 11492 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:22.775553 11518 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:22.804226 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 385323us
I20260709 13:16:22.769964 11337 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:16:22.828725 11532 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:16:22.872905 10187 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
W20260709 13:16:22.873163 10114 consensus_meta.cc:287] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
I20260709 13:16:22.882718 10114 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:22.911830 10111 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:22.912650 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 358678us
I20260709 13:16:22.859079 11494 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:16:22.919486 10114 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:22.848870 11507 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:22.931195 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:22.933794 11527 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:22.934254 11527 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:22.943825 11509 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:22.944543 11509 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:22.908528 11529 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:22.920805 10181 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.808746 11492 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:22.959175 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 397156us
W20260709 13:16:22.950675 11414 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:22.951033 11541 raft_consensus.cc:993] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:16:22.951910 11523 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.955570 11529 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:22.964154 11501 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:22.997102 11492 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:22.976303 11529 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.010883 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:23.011794 10186 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:22.985605 11507 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:23.013850 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:22.986228 11525 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.538s	user 0.004s	sys 0.000s
I20260709 13:16:22.947706 11509 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:22.977237 11392 raft_consensus.cc:1081] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
W20260709 13:16:23.051791 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 312620us
W20260709 13:16:23.098598 11554 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:16:23.045697 10180 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:22.972582 11523 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.104314 11523 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:23.105525 11529 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:23.120466 11392 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:23.132552 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 209551us
I20260709 13:16:23.141804 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:23.142517 10709 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:23.145759 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:23.146406 10037 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.146698 10037 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:23.129930 11518 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:23.148906 10037 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.152967 10037 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.182082 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.191601 10035 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.194352 10036 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:23.132683 11392 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.293071 11510 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.293704 11510 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.143397 11527 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:23.306684 11553 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:16:23.316658 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:23.323156 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:23.203204 11353 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.372846 11538 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:23.275090 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:23.387946 11538 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.360497 11506 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:23.474459 11555 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:23.479912 11509 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:23.480681 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 184) took 1807 ms. Trace:
I20260709 13:16:23.480580 11509 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.481127 10184 rpcz_store.cc:276] 0709 13:16:21.673189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.675800 (+  2611us) service_pool.cc:224] Handling call
0709 13:16:21.804908 (+129108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.964184 (+159276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.966039 (+  1855us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.004135 (+ 38096us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.171974 (+167839us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:22.881707 (+709733us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.396339 (+514632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.444462 (+ 48123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.449289 (+  4827us) raft_consensus.cc:1685] finished
0709 13:16:23.456733 (+  7444us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.480593 (+ 23860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170987,"prepare.queue_time_us":354582,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3824,"raft.queue_time_us":38198,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":20680,"thread_start_us":1139031,"threads_started":4,"wal-append.queue_time_us":154026}
I20260709 13:16:23.498383 10037 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
W20260709 13:16:23.776139 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 297459us
I20260709 13:16:23.418370 11369 raft_consensus.cc:993] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:23.789248 10189 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.819051 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:23.790536 10188 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:23.811947 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:23.421135 11560 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:16:23.819669 10189 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:23.581597 11548 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.611s	user 0.006s	sys 0.000s
I20260709 13:16:23.821907 10187 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:23.482795 11509 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:23.444121 11482 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:22.957314  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.826122 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:23.826442 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 322828us
I20260709 13:16:23.424429 11514 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:23.832724 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:23.419667 11483 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.472648 11506 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.846823 11506 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.455183 11477 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:23.418072 11498 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:23.485030 11479 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.506153 11510 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:23.483108 10110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33512
I20260709 13:16:23.848795  9936 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 289) took 2609 ms. Trace:
I20260709 13:16:23.719123 11551 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.774799 11538 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:23.783059 11568 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:23.850039 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.811458 11346 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.487309 11392 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:23.379470 11518 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.863889 10189 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:23.864061 11500 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.815268 11549 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.441329 11353 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.873715 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:23.784983 11527 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.830067 11499 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.846972 11561 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:23.846602 11563 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:23.848556 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:23.885053 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.872190 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1095) took 1451 ms. Trace:
I20260709 13:16:23.844787 11509 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:23.838079 11478 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.906172 10040 rpcz_store.cc:276] 0709 13:16:22.413638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.417852 (+  4214us) service_pool.cc:224] Handling call
0709 13:16:22.418222 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.444390 (+ 26168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.444429 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.444892 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.762025 (+317133us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.762976 (+   951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.763051 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.572991 (+809940us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:23.848091 (+275100us) raft_consensus.cc:1685] finished
0709 13:16:23.848112 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.865451 (+ 17339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25805,"raft.queue_time_us":28314,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":2835712,"thread_start_us":226522,"threads_started":1,"wal-append.queue_time_us":418518}
I20260709 13:16:23.877588 10106 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:23.915894 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 931) took 1144 ms. Trace:
I20260709 13:16:23.915334 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.917037 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.867942 11477 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:23.918128 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 81487us
I20260709 13:16:23.916319 10113 rpcz_store.cc:276] 0709 13:16:22.767721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.767895 (+   174us) service_pool.cc:224] Handling call
0709 13:16:22.768211 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.769953 (+  1742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.769980 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.772841 (+  2861us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.120713 (+347872us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:23.120754 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.121130 (+   376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.911545 (+790415us) raft_consensus.cc:1685] finished
0709 13:16:23.911567 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.911703 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1370,"raft.queue_time_us":1755,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2546,"thread_start_us":341536,"threads_started":1,"wal-append.queue_time_us":372265}
I20260709 13:16:23.922736 10037 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:23.912169 10180 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:23.917683 10040 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:23.846661 11483 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.926182 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.883664 11494 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.886040 11497 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.889130 11392 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.928906 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:23.928576 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:23.849656 11482 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.888530 11335 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.943956 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:23.912825 10707 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.886687 11346 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.883883 11498 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.875382 11551 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.921306 11373 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.888432 11549 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:23.934036 11575 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.917435 11478 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.868844  9936 rpcz_store.cc:276] 0709 13:16:21.229390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.240107 (+ 10717us) service_pool.cc:224] Handling call
0709 13:16:23.838914 (+2598807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:21.440222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:21.525109 (+ 84887us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:21.526103 (+   994us) write_op.cc:435] Acquired schema lock
0709 13:16:21.531677 (+  5574us) tablet.cc:662] Decoding operations
0709 13:16:21.550859 (+ 19182us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:21.552458 (+  1599us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:21.561339 (+  8881us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:21.588105 (+ 26766us) tablet.cc:701] Row locks acquired
0709 13:16:21.588644 (+   539us) write_op.cc:260] PREPARE: finished
0709 13:16:21.596614 (+  7970us) write_op.cc:270] Start()
0709 13:16:21.607903 (+ 11289us) write_op.cc:276] Timestamp: P: 1783602981594651 usec, L: 0
0709 13:16:21.609481 (+  1578us) op_driver.cc:348] REPLICATION: starting
0709 13:16:21.780590 (+171109us) log.cc:844] Serialized 537 byte log entry
0709 13:16:22.113320 (+332730us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e3e28 00007f3c72f1e581 00007f3c72f1dd58 00007f3c72f229f1 00007f3c72f229a9 00007f3c72f22939 00007f3c72f22901 00007f3c72f21b2d 000000000038f354 000000000038f199
0709 13:16:22.151165 (+ 37845us) op_driver.cc:464] REPLICATION: finished
0709 13:16:22.425165 (+274000us) write_op.cc:301] APPLY: starting
0709 13:16:22.443123 (+ 17958us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:22.497584 (+ 54461us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:22.501389 (+  3805us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:22.555643 (+ 54254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:22.575528 (+ 19885us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:22.581275 (+  5747us) write_op.cc:312] APPLY: finished
0709 13:16:22.684143 (+102868us) log.cc:844] Serialized 23 byte log entry
0709 13:16:22.684371 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.684464 (+    93us) write_op.cc:454] Released schema lock
0709 13:16:22.684511 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:22.684914 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.684942 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":236093,"apply.run_cpu_time_us":2202,"apply.run_wall_time_us":270460,"num_ops":1,"prepare.queue_time_us":73559,"prepare.run_cpu_time_us":9651,"prepare.run_wall_time_us":685051,"replication_time_us":541520,"spinlock_wait_cycles":5759872,"thread_start_us":64551,"threads_started":1}]]}
I20260709 13:16:23.995373 11503 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.913038 11500 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.964131 11335 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.883852 11568 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.014715 11568 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.015208 11568 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:23.996562 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.016844 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:23.998674 11477 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:23.999444 11397 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.952606 11538 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:23.945202 11494 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.889631 11499 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.042161 11335 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.047263 11499 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.047955 11499 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.049227 11499 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.921667 11509 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:24.010792 11571 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:16:23.915134 11563 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:24.011408 11495 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.011770 11556 raft_consensus.cc:1081] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:24.018144 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:24.019116 10716 raft_consensus.cc:2410] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:24.003750 11575 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.061018 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:24.001930 11373 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.040836 11513 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.034578 11452 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:24.042272 11500 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:23.956959 11392 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:23.987498 11574 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:23.912223 11561 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.050299 10707 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:23.966897 11497 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.057391 11509 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.052335 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.067521 11510 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.071938 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.051218 11477 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.015646 11568 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.075953 11500 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.053297 11397 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:24.072628 11513 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.045899 11576 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.067723 10110 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.051429 11538 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.102245 11346 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.102533 11510 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.082939 11373 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.107955 11561 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.102869 11477 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.073051 11494 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.084674 11452 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.114180 11497 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.108758 11573 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.116041 11500 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.125022 11551 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.087201 11456 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.038652 11503 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.082763 11574 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.118122 11353 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:24.158753 11569 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:16:24.123636 10110 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.073427 11495 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.163045 11498 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.175725 11549 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.135576 11346 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.138984 11477 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.135494 11576 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.196425 11551 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:24.208520 11346 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:24.216046 11500 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.216367 11346 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.221521 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2010) took 1096 ms. Trace:
I20260709 13:16:24.221900 10039 rpcz_store.cc:276] 0709 13:16:23.125481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.125926 (+   445us) service_pool.cc:224] Handling call
0709 13:16:23.126262 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.126611 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.126640 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.131084 (+  4444us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.234912 (+103828us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:23.397271 (+162359us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.435851 (+ 38580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.435945 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.221329 (+785384us) raft_consensus.cc:1685] finished
0709 13:16:24.221349 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.221467 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282045,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":44108,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":65700,"thread_start_us":187034,"threads_started":2,"wal-append.queue_time_us":705466}
I20260709 13:16:24.224208 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 933) took 1454 ms. Trace:
I20260709 13:16:24.224575 10111 rpcz_store.cc:276] 0709 13:16:22.769687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.769831 (+   144us) service_pool.cc:224] Handling call
0709 13:16:22.770918 (+  1087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.912283 (+141365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.223975 (+1311692us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400210f54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:24.224150 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323504512}
I20260709 13:16:24.200335 11482 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.228174 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.230593 10039 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:24.232363 11574 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.205163 11478 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:24.236119 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 292238us
I20260709 13:16:24.197024 11456 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.209766 11513 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.250144 11563 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.252790 11576 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.215025 11575 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.214521 11551 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.216396 11503 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.281144 11495 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.192103 11573 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:24.301385 11533 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.719s	user 0.007s	sys 0.006s
I20260709 13:16:24.304626 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1101) took 1121 ms. Trace:
I20260709 13:16:24.305809 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.306430 10112 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:24.269358 11551 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.266882 11392 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.311874 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 141) took 1110 ms. Trace:
I20260709 13:16:24.312901 10112 rpcz_store.cc:276] 0709 13:16:23.196914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.197162 (+   248us) service_pool.cc:224] Handling call
0709 13:16:24.305649 (+1108487us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:24.306811 (+  1162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9558400}
I20260709 13:16:24.238006 11397 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.323035 11573 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.305070 10038 rpcz_store.cc:276] 0709 13:16:23.182785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.194189 (+ 11404us) service_pool.cc:224] Handling call
0709 13:16:24.303865 (+1109676us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.304084 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.304277 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.304301 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.304342 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.304372 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.304430 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.304568 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29154048}
I20260709 13:16:24.310570 11482 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.298825 11483 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.320851 11538 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.330690 11510 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:24.370232 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 527182us
I20260709 13:16:24.371102 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:24.331492 11482 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:24.312316 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 403727us
W20260709 13:16:24.478797 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 107789us
I20260709 13:16:24.312009 11514 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:24.467643 11573 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.501551 11573 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.484848 11483 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:24.492643 11456 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:24.522682 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.523085 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54658.1us
I20260709 13:16:24.524935 11575 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.528249 11575 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.531687 11575 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.534159 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.536304 11478 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.536839 11478 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.537915 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.536351 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.518739 11483 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.545497 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.545477 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.546200 11473 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.545514 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.547997 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:24.551163 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.547003 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.557068 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:16:24.557336 11495 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.557760 11495 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:24.539029 11478 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.542670 11452 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.550760 11483 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:24.576606 10152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.036s	sys 0.039s
I20260709 13:16:24.577178 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:24.574350 10081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.035s	sys 0.040s
W20260709 13:16:24.587077 10081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.035s	sys 0.040s
I20260709 13:16:24.587612 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.588325 10188 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:24.589283 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.589995 10188 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
W20260709 13:16:24.590885 10152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.036s	sys 0.039s
W20260709 13:16:24.592259 10080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.019s	sys 0.111s
W20260709 13:16:24.594112 10080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.019s	sys 0.111s
W20260709 13:16:24.592875 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.035s	sys 0.041s
W20260709 13:16:24.596246 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.036s	sys 0.042s
W20260709 13:16:24.592612 11504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.014s	sys 0.019s
W20260709 13:16:24.596947 11504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.014s	sys 0.019s
W20260709 13:16:24.597515 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 651134us
I20260709 13:16:24.558943 11482 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:24.600929 10040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.001s	sys 0.015s
I20260709 13:16:24.573921 11456 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:24.562666 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.603987 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:24.603945 10185 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.013s
W20260709 13:16:24.604095 10037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.044s	sys 0.062s
W20260709 13:16:24.604918 10040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.001s	sys 0.016s
W20260709 13:16:24.597962 10154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.003s	sys 0.031s
W20260709 13:16:24.644891 10154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.004s	sys 0.032s
I20260709 13:16:24.606587 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:24.605111 11555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.011s	sys 0.024s
I20260709 13:16:24.573956 11473 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:24.644675 10037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.045s	sys 0.062s
W20260709 13:16:24.644647 10185 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.003s	sys 0.014s
W20260709 13:16:24.646824 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.006s	sys 0.019s
W20260709 13:16:24.649861 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44662.2us
W20260709 13:16:24.649966 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.006s	sys 0.019s
W20260709 13:16:24.645906 10006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.024s	sys 0.033s
W20260709 13:16:24.600212 11518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.023s
W20260709 13:16:24.653556 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 592489us
W20260709 13:16:24.653168 10003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.017s
W20260709 13:16:24.660291 10003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.006s	sys 0.017s
W20260709 13:16:24.653136 10006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.025s	sys 0.034s
W20260709 13:16:24.661757 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 73547.3us
I20260709 13:16:24.662739 11209 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.615325 11353 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.663307 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.664669 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.670269 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1106) took 1469 ms. Trace:
I20260709 13:16:24.673466 11209 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.678581 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.678807 11490 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:24.653224 11555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.011s	sys 0.032s
W20260709 13:16:24.658962 11518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.004s	sys 0.024s
W20260709 13:16:24.683894 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 77365.5us
I20260709 13:16:24.686285 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:24.683631 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.652530 11585 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.643780 11573 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:24.654372 11482 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.696743 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.687948 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:24.670647 10036 rpcz_store.cc:276] 0709 13:16:23.201023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.201346 (+   323us) service_pool.cc:224] Handling call
0709 13:16:24.234846 (+1033500us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.235039 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.235245 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:24.235543 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.669965 (+434422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.670009 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.670047 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.670111 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.670211 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8119,"prepare.queue_time_us":2053,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"spinlock_wait_cycles":18624384,"thread_start_us":425994,"threads_started":1}
I20260709 13:16:24.698057 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.577689 11495 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.655057 11452 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.654620 11587 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:24.698643 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.716326 10107 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:24.701372 11209 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.709482 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.717940 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.644023 11456 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.690093 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.657076 11473 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.713869 11482 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.720896 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.696276 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.723884 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1107) took 1512 ms. Trace:
I20260709 13:16:24.725293 11602 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:16:24.727592 11590 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:24.721660 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:24.728221 11590 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.728565 10032 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.728627 11590 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.722929 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.730185 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.725063 10034 rpcz_store.cc:276] 0709 13:16:23.211576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.211715 (+   139us) service_pool.cc:224] Handling call
0709 13:16:23.212012 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.278528 (+ 66516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.278559 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.278602 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:23.278631 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.723608 (+1444977us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b54000654d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:24.723662 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.723831 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152454912}
I20260709 13:16:24.732383 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.733384 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.681478 11353 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.586277 11514 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.740267 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.679358 11490 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.715374 11494 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:24.745554 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:24.737716 11506 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.001s
I20260709 13:16:24.720981 10708 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:24.698613 11589 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.733497 11555 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.752776 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:24.755097 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:24.733968 11478 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.757187 11209 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:24.768357 11209 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:24.759102 11579 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.762575 11397 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.739514 11373 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.764952 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.765187 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.734869 10032 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:24.769765 11586 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:16:24.770018 11209 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.718699 11452 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.782083 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.782310 11373 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.782356 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.785205 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.784446 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.719872 11583 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:16:24.817955 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59872.5us
I20260709 13:16:24.734174 11500 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:24.785293 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.825898 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.757745 11506 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.771188 11579 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:24.710354 11585 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.798605 11583 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.822381 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.829011 10113 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
W20260709 13:16:24.866223 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45259.2us
I20260709 13:16:24.766237 11555 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.872359 11555 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.873329 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:24.873344 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.874567 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:24.858587 11607 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:24.781999 11598 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.773937 11478 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.853461 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:24.753711 11494 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.832814 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 143) took 1378 ms. Trace:
I20260709 13:16:24.859272 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 823) took 1071 ms. Trace:
W20260709 13:16:24.838920 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 179291us
I20260709 13:16:24.880548 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:24.880995 11538 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:24.782236 10032 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.766469 11589 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.883009 11358 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:24.873373 11590 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.886420 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1071) took 1087 ms. Trace:
I20260709 13:16:24.890192 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:16:24.895529 11603 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:24.895957 11473 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.897056 11494 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:24.889484 10108 rpcz_store.cc:276] 0709 13:16:23.454863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.455524 (+   661us) service_pool.cc:224] Handling call
0709 13:16:24.832129 (+1376605us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.832334 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.832501 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.832526 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.832565 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:24.832591 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.832644 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.832754 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24391552}
I20260709 13:16:24.881762 11616 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.889649 10186 rpcz_store.cc:276] 0709 13:16:23.788200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.788305 (+   105us) service_pool.cc:224] Handling call
0709 13:16:23.795563 (+  7258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.893830 (+ 98267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.893864 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.914529 (+ 20665us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.307524 (+392995us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.307565 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.307638 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.859002 (+551364us) raft_consensus.cc:1685] finished
0709 13:16:24.859024 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.859203 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4588,"raft.queue_time_us":69881,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":7307,"spinlock_wait_cycles":1408,"thread_start_us":475695,"threads_started":2,"wal-append.queue_time_us":665774}
I20260709 13:16:24.734344 11587 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.908390 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.903831 11593 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.895428 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.905516 11482 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:24.907728 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 120075us
I20260709 13:16:24.916471 10079 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:24.914748 10187 rpcz_store.cc:276] 0709 13:16:23.798654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.826724 (+ 28070us) service_pool.cc:224] Handling call
0709 13:16:24.885719 (+1058995us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.885926 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.886120 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.886148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.886184 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.886210 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.886257 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.886368 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7645568}
I20260709 13:16:24.885078 11353 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.906312 11577 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:24.926409 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.926038 11614 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:24.911181 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.910588 11358 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:24.944999 11527 consensus_meta.cc:287] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.055s	user 0.006s	sys 0.006s
I20260709 13:16:24.915211 10032 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:24.933230 11599 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:16:24.933653 11604 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.939587 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:24.940189 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.958977 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.945654 11373 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.883054 11613 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.926025 11519 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.865228 11583 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.950904 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.930891 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:24.927881 10184 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:24.960135 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.960608 11584 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.961581 11506 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.949458 11494 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.945948 11593 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:24.962620 11477 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.000s
I20260709 13:16:24.946753 10038 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:24.954824 11358 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:24.967779 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:24.956633 11614 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:24.927491 11616 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.958333 11577 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:25.001128 11588 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.972968 11551 consensus_meta.cc:287] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.655s	user 0.002s	sys 0.009s
I20260709 13:16:24.972932 11452 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.001266 11614 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.001694 11494 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:25.008442 11579 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:24.968057 11519 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:24.965432 11604 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:24.912006 11598 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.002682 11482 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.006210 10181 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:25.019821 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:24.998172 11477 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.014299 11538 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.033618 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.043704 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2014) took 1224 ms. Trace:
W20260709 13:16:25.044859 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.044617 10040 rpcz_store.cc:276] 0709 13:16:23.819223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.964888 (+145665us) service_pool.cc:224] Handling call
0709 13:16:23.965270 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.965574 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.965600 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.992804 (+ 27204us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.644953 (+652149us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.644992 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.645063 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.043485 (+398422us) raft_consensus.cc:1685] finished
0709 13:16:25.043506 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.043646 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91093,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":13291,"thread_start_us":628880,"threads_started":1,"wal-append.queue_time_us":638092}
I20260709 13:16:25.009631 11551 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:24.973310 11584 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.028167 11588 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.133563 10032 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
W20260709 13:16:25.159256 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1099) took 1977 ms (client timeout 2081 ms). Trace:
I20260709 13:16:25.018821 11604 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.161484 11589 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.162060 10711 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:25.164670 11551 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.064956 11593 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:25.100330 10110 consensus_meta.cc:287] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.897s	user 0.012s	sys 0.000s
I20260709 13:16:25.166198 10110 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.167305 10111 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:25.048049 11538 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.056982 11598 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.058019 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:25.160691 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 145347us
I20260709 13:16:25.027897 11482 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.171208 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:25.172078 10181 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.172535 10181 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.173074 11482 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.057550 11494 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.177497 11588 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.179055 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:25.063230 11577 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.180836 11527 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.181711 11587 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.178203 11604 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:25.133772 11619 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:16:25.159723 10032 rpcz_store.cc:269] 0709 13:16:23.182247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.194243 (+ 11996us) service_pool.cc:224] Handling call
0709 13:16:24.711337 (+1517094us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:25.159163 (+447826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28003200}
I20260709 13:16:25.187984 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.189510 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.188913 10186 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:16:25.135416 11483 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
W20260709 13:16:25.191366 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 142) took 1991 ms (client timeout 1943 ms). Trace:
W20260709 13:16:25.192469 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.182305 11373 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:25.191723 10115 rpcz_store.cc:269] 0709 13:16:23.200388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.447436 (+247048us) service_pool.cc:224] Handling call
0709 13:16:25.189363 (+1741927us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:25.191293 (+  1930us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23942400}
I20260709 13:16:25.153947 11614 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.167441 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.199575 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.200129 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.200783 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.201382 10115 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:25.202142 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.170930 11538 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.203066 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.049325 11583 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.208643 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.209317 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.209968 10108 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:25.195529 11579 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.212302 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:25.213726 10108 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.214843 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:25.215873 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.134554 11358 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.217672 10709 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:25.219069 11346 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.197281 11483 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.215561 11478 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.231045 10112 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:25.231084 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:25.225991 11614 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.216293 11579 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.234944 10108 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:25.240295 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.243024 10108 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:25.246258 11483 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.249373 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1105) took 2052 ms. Trace:
I20260709 13:16:25.236083 11590 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.249770 10035 rpcz_store.cc:276] 0709 13:16:23.197201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.198249 (+  1048us) service_pool.cc:224] Handling call
0709 13:16:25.248699 (+2050450us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:25.248946 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.249098 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.249121 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.249156 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.249182 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.249229 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.249309 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18487168}
I20260709 13:16:25.236893 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.253661 11579 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.254415 10032 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:25.260667 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.261284 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.261920 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.256735 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 821) took 1469 ms. Trace:
I20260709 13:16:25.255358 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.252908 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 295) took 1463 ms. Trace:
I20260709 13:16:25.266750 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.257815 10108 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:25.267495 10036 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:25.268661 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.266737 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.269948 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:25.271505 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:25.272696 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:25.287160 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.265239 10716 rpcz_store.cc:276] 0709 13:16:23.789668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.789835 (+   167us) service_pool.cc:224] Handling call
0709 13:16:25.252642 (+1462807us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540056f4d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:25.252815 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397349248}
I20260709 13:16:25.294618 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:25.262974 10185 rpcz_store.cc:276] 0709 13:16:23.787588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.787720 (+   132us) service_pool.cc:224] Handling call
0709 13:16:23.788050 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.018226 (+230176us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:24.652087 (+633861us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.702700 (+ 50613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.702748 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.703389 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.256510 (+553121us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002d32d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.256562 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.256682 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":577819,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":100,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9524,"spinlock_wait_cycles":528839424,"thread_start_us":661487,"threads_started":2,"wal-append.queue_time_us":226779}
I20260709 13:16:25.266158 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.304919 10716 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.303393 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.294497 11614 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.316630 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.317685 10716 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:16:25.318115 10716 pending_rounds.cc:85] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 2
I20260709 13:16:25.319996 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.320678 10036 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.321136 10035 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:25.292649 10708 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:16:25.318466 10716 pending_rounds.cc:107] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:16:25.329047 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 937) took 2117 ms. Trace:
I20260709 13:16:25.332758 10716 raft_consensus.cc:2917] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:16:25.313294 11614 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:25.332763 10114 rpcz_store.cc:276] 0709 13:16:23.211213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.447396 (+236183us) service_pool.cc:224] Handling call
0709 13:16:25.328129 (+1880733us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:25.328345 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.328535 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.328560 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.328598 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:25.328626 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.328676 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.328774 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25207040}
I20260709 13:16:25.334499 10716 raft_consensus.cc:2889] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.318832 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:25.344484 11621 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:16:25.333936 10033 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.341216 11358 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.340435 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.348234 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 297) took 1418 ms. Trace:
I20260709 13:16:25.356031 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 345) took 1541 ms. Trace:
W20260709 13:16:25.357939 10712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 296) took 1567 ms (client timeout 1938 ms). Trace:
I20260709 13:16:25.336547 11614 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.358961 10713 rpcz_store.cc:276] 0709 13:16:23.814220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.814336 (+   116us) service_pool.cc:224] Handling call
0709 13:16:23.816292 (+  1956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.006522 (+190230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.006555 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.006596 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.006625 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.355773 (+1349148us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54006103d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.355839 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.355971 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437005568}
W20260709 13:16:25.358484 10712 rpcz_store.cc:269] 0709 13:16:23.790112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.795099 (+  4987us) service_pool.cc:224] Handling call
0709 13:16:25.340260 (+1545161us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:25.357863 (+ 17603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14798208}
I20260709 13:16:25.371699 11568 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.375547 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.381381 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.393006 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:25.393965 10109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 144) took 1912 ms (client timeout 1725 ms). Trace:
I20260709 13:16:25.395147 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.396159 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.396821 10108 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:25.398241 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.355487 10181 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.400512 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.400935 10715 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.401372 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.403044 10112 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:25.398942 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:25.404958 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.405505 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:25.405799 10108 raft_consensus.cc:2410] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:25.407971 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.391239 11477 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.357650 10710 rpcz_store.cc:276] 0709 13:16:23.929593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.932508 (+  2915us) service_pool.cc:224] Handling call
0709 13:16:24.018322 (+ 85814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.214258 (+195936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.226505 (+ 12247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.235932 (+  9427us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:24.237869 (+  1937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.347944 (+1110075us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54006801d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.348007 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.348146 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435903872}
W20260709 13:16:25.394337 10109 rpcz_store.cc:269] 0709 13:16:23.481571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.490207 (+  8636us) service_pool.cc:224] Handling call
0709 13:16:25.392817 (+1902610us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:25.393889 (+  1072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64877824}
I20260709 13:16:25.415230 10108 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:25.409891 11479 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:25.407044 11563 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.416733 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.409034 11508 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:25.418557 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.420662 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.422014 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.421833 11614 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.410969 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.429553 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.433391 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.444716 11614 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.433467 10708 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:25.026834 11618 consensus_queue.cc:1175] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f672b54d4754c5aa62b5b919597a14e" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:25.459882 10712 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:16:25.459287 11510 consensus_queue.cc:1175] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:25.426267 11563 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.461583 11490 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.462369 11563 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.464800 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1098) took 2282 ms. Trace:
I20260709 13:16:25.465211 10031 rpcz_store.cc:276] 0709 13:16:23.181957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.194331 (+ 12374us) service_pool.cc:224] Handling call
0709 13:16:24.764209 (+1569878us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.764454 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.882638 (+118184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.882675 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.882724 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.882768 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.464484 (+581716us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002779d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.464533 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.464711 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280142464}
I20260709 13:16:25.476977 10181 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.482043 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:25.482751 10115 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:25.484431 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 586824us
I20260709 13:16:25.485203 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:25.488209 10081 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.081s (SENT) [suppressed 4 similar messages]
W20260709 13:16:25.491492 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.491879 10115 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:25.494235 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:25.491863 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:25.500624 10709 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEARNER]: Advancing to term 4
I20260709 13:16:25.506229 11496 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:25.506696 11496 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:25.511102 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:25.514828 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 340) took 3201 ms. Trace:
I20260709 13:16:25.517041 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 508) took 1396 ms. Trace:
I20260709 13:16:25.494668 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.473209 11477 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:16:25.515254 10715 rpcz_store.cc:276] 0709 13:16:22.313777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.313893 (+   116us) service_pool.cc:224] Handling call
0709 13:16:22.333548 (+ 19655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.403784 (+3070236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.514543 (+110759us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b54006919d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.514740 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7053928320}
I20260709 13:16:25.517481 10707 rpcz_store.cc:276] 0709 13:16:24.120194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.123349 (+  3155us) service_pool.cc:224] Handling call
0709 13:16:25.258027 (+1134678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.296546 (+ 38519us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:25.347642 (+ 51096us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.407214 (+ 59572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.409107 (+  1893us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:25.411878 (+  2771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.413405 (+  1527us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.516827 (+103422us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540056f4d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:25.516973 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54783,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":41,"raft.queue_time_us":3937,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3065,"spinlock_wait_cycles":2527747328,"thread_start_us":51193,"threads_started":2,"wal-append.queue_time_us":66734}
I20260709 13:16:25.518821 11385 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:25.530503 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:25.528419 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.544204 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 337) took 3322 ms. Trace:
I20260709 13:16:25.544739 10711 rpcz_store.cc:276] 0709 13:16:22.221512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.223226 (+  1714us) service_pool.cc:224] Handling call
0709 13:16:23.889346 (+1666120us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.233179 (+343833us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3f8c 00007f3c6c3c3ef6 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:24.233326 (+   147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.162493 (+929167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.543914 (+381421us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54004b9bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.544125 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171333760}
I20260709 13:16:25.553331 11585 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.556823 11584 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.560439 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:25.565897 11604 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.507516 11496 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.572602 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:25.576779 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:25.581358 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:25.582165 11568 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.582726 11568 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.583575 11456 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.585075 11568 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.585606 11568 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.586055 11568 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.588047 11495 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.588554 11508 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.589085 11508 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.591177 11508 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.592784 11588 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:25.593297 11588 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.594048 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1096) took 2412 ms. Trace:
I20260709 13:16:25.581975 10037 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.594496 10033 rpcz_store.cc:276] 0709 13:16:23.181338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.191397 (+ 10059us) service_pool.cc:224] Handling call
0709 13:16:25.263068 (+2071671us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:25.296242 (+ 33174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.359258 (+ 63016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.593765 (+234507us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b5400156dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:25.593976 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91735296}
I20260709 13:16:25.588230 11568 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.600112 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.601594 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:25.603071 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:25.603729 11601 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.604250 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:25.606958 11358 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:25.606833 11376 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.624706 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:25.627573 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.628152 11589 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.628302 10183 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:25.629060 11616 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.627710 11482 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.630461 10713 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:25.572546 11496 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.636463 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.637162 10181 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:25.638034 11432 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:25.638461 11432 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:25.638824 11432 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.641680 10714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 505) took 1753 ms. Trace:
I20260709 13:16:25.642788 11508 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.643290 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.644783 10180 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:25.644443 11610 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:25.646150 11610 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:25.646518 11610 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:25.644210 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 114032us
I20260709 13:16:25.648675 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.607795 11479 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:25.649991 11479 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.652057 11479 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.652575 11479 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:25.653016 11479 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.654872 11479 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.595196 11588 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:25.643332 11508 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.642059 10714 rpcz_store.cc:276] 0709 13:16:23.888339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.892453 (+  4114us) service_pool.cc:224] Handling call
0709 13:16:25.309718 (+1417265us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:25.332427 (+ 22709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.332592 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.332616 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.332679 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.332709 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.332767 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.641506 (+308739us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54004a9050. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:25.641620 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82299904}
I20260709 13:16:25.656452 11432 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.686079 10037 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:25.687609 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:25.658638 11508 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:25.711124 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 189760us
I20260709 13:16:25.717582 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.626147 11358 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:16:25.703320 11559 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.729636 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.719713 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.731833 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.732475 10115 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:25.702216 11552 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:25.702106 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.720853 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:25.735456 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:25.748073 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:25.716995 11583 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:25.749331 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.752079 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.736052 10187 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:25.737965 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.753264 10185 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:25.741299 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:25.753767 10186 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.662922 11589 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:25.717438 11581 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.772719 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.663022 11482 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.767218 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.703598 11456 consensus_queue.cc:1059] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:25.720541 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.705729 11582 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:25.741235 11479 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.765893 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:25.749703 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.761850 11552 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:25.750751 11519 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.767640 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:25.749269 11610 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.746174 11559 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:25.772845 11508 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:25.852407 11581 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.002023 11508 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.002776 10115 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:26.003424 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:26.004360 11508 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.909772 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:25.793147 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 304936us
I20260709 13:16:26.006457 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:25.458649  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:25.890811 11601 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.852365 11432 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:25.847755  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 282) took 3908 ms. Trace:
I20260709 13:16:25.879097 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:26.009248 10709 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.000s
W20260709 13:16:26.009452 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 130434us
I20260709 13:16:26.010347 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.010839 11614 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.011809 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.007568 11601 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:25.897344 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:25.859656 10186 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:26.029390 10188 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:25.948670 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.010996 11503 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:25.765069 11550 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:26.001365 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.899173 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.037580 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:26.038580 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 267407us
I20260709 13:16:25.912896 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:26.006659 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:26.063446 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:25.815758 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:26.039243 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:25.899314 11541 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:26.031483 11564 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.030705 11496 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.010847 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.000083 11482 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:25.999294 11589 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:26.066299 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 167184us
I20260709 13:16:26.041599 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.034885 11456 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:16:26.066937 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.004870 11508 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.009080  9934 rpcz_store.cc:276] 0709 13:16:21.939514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.939680 (+   166us) service_pool.cc:224] Handling call
0709 13:16:25.847660 (+3907980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:22.247055 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:22.442726 (+195671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:22.449329 (+  6603us) write_op.cc:435] Acquired schema lock
0709 13:16:22.455254 (+  5925us) tablet.cc:662] Decoding operations
0709 13:16:22.557674 (+102420us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:22.558731 (+  1057us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:22.561705 (+  2974us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:22.590504 (+ 28799us) tablet.cc:701] Row locks acquired
0709 13:16:22.604565 (+ 14061us) write_op.cc:260] PREPARE: finished
0709 13:16:22.743028 (+138463us) write_op.cc:270] Start()
0709 13:16:22.759802 (+ 16774us) write_op.cc:276] Timestamp: P: 1783602982740468 usec, L: 0
0709 13:16:22.759838 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:16:22.855949 (+ 96111us) log.cc:844] Serialized 541 byte log entry
0709 13:16:23.522529 (+666580us) op_driver.cc:464] REPLICATION: finished
0709 13:16:23.967053 (+444524us) write_op.cc:301] APPLY: starting
0709 13:16:23.991437 (+ 24384us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:24.005004 (+ 13567us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:24.051068 (+ 46064us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:24.074439 (+ 23371us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:24.102789 (+ 28350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:24.109905 (+  7116us) write_op.cc:312] APPLY: finished
0709 13:16:24.128987 (+ 19082us) log.cc:844] Serialized 23 byte log entry
0709 13:16:24.140751 (+ 11764us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:24.161584 (+ 20833us) write_op.cc:454] Released schema lock
0709 13:16:24.168099 (+  6515us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:24.204270 (+ 36171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:24.206151 (+  1881us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":410193,"apply.run_cpu_time_us":2800,"apply.run_wall_time_us":236554,"num_ops":1,"prepare.queue_time_us":554,"prepare.run_cpu_time_us":4447,"prepare.run_wall_time_us":649857,"replication_time_us":758977,"thread_start_us":314636,"threads_started":1}]]}
I20260709 13:16:26.092684 11482 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:26.096101 11482 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:26.013342 11552 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.101191 11519 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.102337 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.030395 10709 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:26.078610 10188 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:26.037560 11550 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:26.099004 11508 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.104351 11550 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.105582 11550 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.107230 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:26.107781 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:26.079387 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.064814 11497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.046s	sys 0.135s
I20260709 13:16:26.059854 11584 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.083492 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:26.087179 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45664.1us
I20260709 13:16:26.067595 10189 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:26.113545 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:26.081651 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68516.2us
I20260709 13:16:26.089555 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.114691 10186 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:26.117908 10186 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:26.108374 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
W20260709 13:16:26.089965 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 228410us
I20260709 13:16:26.072964 11392 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.103015 10184 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:26.114135 10111 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:26.124771 10187 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:26.036262 11479 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:26.111992 11497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.046s	sys 0.135s
I20260709 13:16:26.130789 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:26.143847 10111 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:26.094554 11582 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.143047 10188 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.079674 11541 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.148555 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.149178 10034 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:26.113049 11491 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:26.144214 10111 pending_rounds.cc:85] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 1
I20260709 13:16:26.153746 10111 pending_rounds.cc:107] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:26.154038 10111 raft_consensus.cc:2889] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.094157 11544 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:26.159188 11479 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:26.135329 11513 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:26.160703 11491 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.173652 11541 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:26.174592 11581 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:26.175063 11592 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:26.175534 11592 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.177517 11592 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:26.177929 11518 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:26.178457 11518 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:26.180462 11508 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:26.180644 11518 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:26.138916 11616 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:26.181780 11616 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:26.182112 11616 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:26.182607 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:26.182897 11616 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.174649 10182 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:26.188063 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:26.166579 11585 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.163811 10183 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:16:26.168845 10184 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:26.212517 11508 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:26.168238 11514 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:16:26.218568 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.221444 10115 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:26.219775 10112 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.223842 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.224627 10108 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:26.210280 11585 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:26.232848 11491 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:26.233058 11527 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:26.236009 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:26.236313 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:26.238691 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 197218us
I20260709 13:16:26.220448 11559 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:26.241357 11527 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:26.248466 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:26.249577 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 61584.5us
I20260709 13:16:26.250946 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.237881 11616 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.239115 11585 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.231410 10109 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:26.255797 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.248165 11614 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.269404 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.247619 11508 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.278558 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.262223 10109 pending_rounds.cc:85] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 1
I20260709 13:16:26.309476 11641 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.305579 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:26.308291 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.253243 11639 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.270121 11614 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.316295 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.281899 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.283073 11479 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.283952 11456 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.318226 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.281519 11550 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.313237 11639 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:26.320814 11614 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.321233 11589 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.312318 10109 pending_rounds.cc:107] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:26.330886 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.335556 10111 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:26.337352 10111 pending_rounds.cc:85] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 1
I20260709 13:16:26.337625 10111 pending_rounds.cc:107] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:26.337841 10111 raft_consensus.cc:2889] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.325277 11456 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:26.339597 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.341005 10034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:26.341554 10034 raft_consensus.cc:606] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.342896 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.313086 11527 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.343885 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.336598 10109 raft_consensus.cc:2889] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.332231 11639 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:26.345333 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 219463us
I20260709 13:16:26.346150 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.340412 11456 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.340447 11479 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:26.349821 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 98918.4us
W20260709 13:16:26.344656 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 260774us
W20260709 13:16:26.351368 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 240560us
I20260709 13:16:26.342867 11589 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.348814 11568 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.353456 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.354975 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:26.356377 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.357002 10037 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:26.358085 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.343083 10110 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:26.359906 11634 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:16:26.360113 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33512 (request call id 939) took 2911 ms. Trace:
I20260709 13:16:26.352488 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.360667 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:26.362205 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.363767 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.366015 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.366321 11638 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:26.387169 11496 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.387452 11592 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:26.388103 11592 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:26.388934 11592 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.393438 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.375053 10034 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:26.395494 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.398577 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:26.400184 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.363430 11508 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:26.361629 11527 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.403328 10032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:26.404121 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.403956 10032 raft_consensus.cc:606] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.403496 11583 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.406080 11583 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:26.406894 11583 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.408033 11583 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:26.410275 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46606.7us
I20260709 13:16:26.399085 10035 raft_consensus.cc:2376] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2. Re-sending same reply.
I20260709 13:16:26.411428 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:26.409703  9936 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.413172  9936 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.418480 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:26.419133 10039 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:26.419473 10039 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:26.425153 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.425871 10035 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:26.359683 11610 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:26.430297 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:26.431231 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.429843 10039 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:26.432386 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83155.8us
I20260709 13:16:26.434098 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.438648 10035 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.438175 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.431960 11508 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.360543 10110 rpcz_store.cc:276] 0709 13:16:23.448610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.454577 (+  5967us) service_pool.cc:224] Handling call
0709 13:16:26.189258 (+2734681us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001bdfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4dfa3d 00007f3c744afcd0 00007f3c6da34254 00007f3c6da341e2 00007f3c6da34111 00007f3c6da3408c 00007f3c6da33342 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:26.360016 (+170758us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":11754,"spinlock_wait_cycles":423029504}
I20260709 13:16:26.442066 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.443105 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.435639 10039 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.444289 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.409189 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.445266 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.436162 11638 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:26.432296 11496 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.449584 11638 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:26.450505 10036 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:26.450619 11638 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.452870 11496 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.455164 11496 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:26.445385 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:26.445969 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.456926 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.446951 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.458719 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:26.460588 10189 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:26.462466 11646 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:26.462881 11646 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:26.463224 11646 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:26.473737 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 123190us
I20260709 13:16:26.476889 11492 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:16:26.443696 11641 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.449646 11506 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.474226 11592 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:26.494664 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.487058 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:26.486680 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 75307.6us
I20260709 13:16:26.632949 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:26.634419 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:26.635407 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.637198 10039 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:26.639238 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.640151 10039 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:26.643605 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.644292 10114 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:26.646641 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:26.638660 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:26.648562 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 161585us
I20260709 13:16:26.649238 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:26.655954 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:26.657745 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:26.659657 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.660861 11518 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:26.661366 11601 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:26.662039 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.662483 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.662674 10108 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:26.663938 11559 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:26.664099 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.664434 11584 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:26.664810 11584 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:26.665148 11584 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.665581 11497 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.440524 11639 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.479178 10031 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:26.624257 11506 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:26.684825 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.486054 11503 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.645887 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.697916 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:26.667479 11477 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.660889 11652 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.669565 11581 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.670105 11588 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.670959 11645 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.667781 11637 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.668949 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:26.682515 11568 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.668190 11358 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:26.693480 11503 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:26.702191 11659 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.707033 10184 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:26.678910 11392 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:26.704852 11652 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:26.732075 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47325.9us
I20260709 13:16:26.705101 10180 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:26.702651 11477 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.739553 11358 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:26.715720 11614 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.736375 11637 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.738302 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:26.738682 11651 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:26.712378 11657 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.696107 11643 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:26.747277 11482 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:26.697669 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.741024 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:26.790100 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49160us
I20260709 13:16:26.791162 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.747622 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.792032 10108 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:26.732653 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.751194 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.747735 11513 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:26.733978 11568 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.800806 10714 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:26.744076 11527 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:26.710448 11588 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:26.700525 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:26.726528 11547 raft_consensus.cc:3055] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:26.704119 11585 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.748001 11641 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:26.793331 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 60749.3us
I20260709 13:16:26.754688 11652 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.761116 11477 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:26.796080 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44962.8us
I20260709 13:16:26.796489 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.833166 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 209) took 1054 ms. Trace:
I20260709 13:16:26.763058 11358 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:26.821251 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.834578 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.837924 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.839649 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:26.794600 11519 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.833830 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.841127 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:26.833617 10185 rpcz_store.cc:276] 0709 13:16:25.778601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.781222 (+  2621us) service_pool.cc:224] Handling call
0709 13:16:25.781536 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.188044 (+406508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.188074 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.188549 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.346938 (+158389us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:26.346976 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.347037 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.832960 (+485923us) raft_consensus.cc:1685] finished
0709 13:16:26.832982 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.833107 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":219304,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":563987,"threads_started":2,"wal-append.queue_time_us":297782}
I20260709 13:16:26.801539 11592 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.804421 11568 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.797441 11552 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.844734 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.789137 10110 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:26.846947 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.804809 11657 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.807696 11588 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.751235 11506 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:26.853159 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 193558us
I20260709 13:16:26.748327 11503 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.805764 11547 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:26.853850 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.854128 10713 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEARNER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:26.854398 11547 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:26.855127 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.823392 11641 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.850927 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.863320 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:26.824715 10038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:26.863335 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:26.868723 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 203547us
I20260709 13:16:26.860575 11559 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:26.869954 11668 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.870625 11668 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:26.872155 11669 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.872875 11669 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.873420 11669 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:26.850556 11616 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.002s
I20260709 13:16:26.882018 10037 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:26.883244 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.884668 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.885190 11672 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.894414 11641 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.894618 11559 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.860699 11547 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.896687 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:26.898612 11656 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.822544 11456 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:26.846994 11645 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.842344 11482 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.846259 11479 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.804152 11513 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:26.913358 11661 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:26.914753 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 153) took 1203 ms. Trace:
I20260709 13:16:26.915511 11614 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:26.915102 10113 rpcz_store.cc:276] 0709 13:16:25.714594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.714737 (+   143us) service_pool.cc:224] Handling call
0709 13:16:25.744556 (+ 29819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.744997 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:25.768796 (+ 23799us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.464224 (+695428us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b180044c140. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:16:26.700529 (+236305us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.701360 (+   831us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.701479 (+   119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:26.701510 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.701573 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.914464 (+212891us) raft_consensus.cc:1685] finished
0709 13:16:26.914569 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.914695 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4719,"prepare.queue_time_us":28225,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":35711,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":13209,"spinlock_wait_cycles":21955584,"thread_start_us":236117,"threads_started":1,"wal-append.queue_time_us":1002369}
I20260709 13:16:26.917088 11641 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:26.850778 11392 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.919281 11392 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:26.919690 11392 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.841821 11491 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.851227 11659 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.923416 11639 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:26.887671 11552 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.900960 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:26.861443 11519 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.902813 11672 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:26.889243 10033 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:27.049921 11664 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.050347 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 114145us
I20260709 13:16:26.903056 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:26.901409 10038 raft_consensus.cc:606] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:26.901767 11616 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.909405 11645 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:27.117429 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 262335us
W20260709 13:16:27.096812 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 245919us
I20260709 13:16:26.907281 11666 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.914992 11513 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.151988 10709 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:27.117051 10038 raft_consensus.cc:614] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:27.157779 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 256884us
W20260709 13:16:27.160059 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.134696 11645 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.166236 11663 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.191974 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 213) took 1372 ms. Trace:
I20260709 13:16:27.193360 11456 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.195997 11585 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:27.198414 11646 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.000s
W20260709 13:16:27.207959 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 355208us
I20260709 13:16:26.911254 11358 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:27.209234 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 89123.5us
W20260709 13:16:27.209770 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 77753.2us
W20260709 13:16:27.223542 11584 consensus_meta.cc:287] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:16:27.202598 11663 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:27.232226 11663 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.231664 11358 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.229636 11583 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.000s
W20260709 13:16:27.241024 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82272.6us
I20260709 13:16:27.252947 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.254101 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.261245 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:27.217602 11392 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.261437 10714 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:27.270282 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:27.132645 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:27.280681 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 148111us
W20260709 13:16:27.285771 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.289891 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 420956us
I20260709 13:16:27.291049 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:27.284047 11456 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.292856 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:27.294301 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:27.295146 10115 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:27.213188 11646 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.299435 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:27.301496 11675 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.302034 11675 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.289611 11550 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:27.303520 11550 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.304329 11675 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.306038 11550 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:27.233177 11588 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.302673 10707 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:27.234448 11584 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.314270 11675 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:27.206802 10181 rpcz_store.cc:276] 0709 13:16:25.819886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.113952 (+294066us) service_pool.cc:224] Handling call
0709 13:16:26.660530 (+546578us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3e9c 00007f3c6c3c3a5b 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:26.980910 (+320380us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:27.096448 (+115538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.135252 (+ 38804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.141469 (+  6217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.191579 (+ 50110us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:27.191655 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.191757 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.191907 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37035008}
I20260709 13:16:27.185693 11664 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.289597 11677 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.310117 11559 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.291815 11583 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:16:27.323565 10180 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:27.320014 11581 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.328814 11584 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.320611 11675 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.334478 11581 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.336311 11675 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.336848 11581 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.331262 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:27.318620 11682 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:27.337114 11655 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.640s	user 0.004s	sys 0.012s
I20260709 13:16:27.332720 11641 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:27.322702 11559 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:27.331849 11637 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.561s	user 0.000s	sys 0.009s
I20260709 13:16:27.346426 11392 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.331209 11639 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.348652 11589 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:27.343128 11646 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.347036 11559 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.347273 11637 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.349715 11589 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:27.361459 11589 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:27.362350 11589 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.365643 11589 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.365836 11588 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:27.352361 11663 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.343195 11659 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.368335 11659 raft_consensus.cc:1064] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
W20260709 13:16:27.368738 11659 raft_consensus.cc:1068] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Unable to promote non-voter 2f672b54d4754c5aa62b5b919597a14e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:27.369683 11496 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:27.353502 11677 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:27.370090 11496 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:27.351639 11645 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.370414 11677 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:27.370497 11477 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.523s	user 0.003s	sys 0.003s
I20260709 13:16:27.372442 11477 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.373083 11677 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:27.372756 11645 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:27.373349 11663 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:27.369724 11652 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.000s
I20260709 13:16:27.375830 11652 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.376312 11496 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:27.377209 11568 consensus_meta.cc:287] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.002s
I20260709 13:16:27.377463 11496 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.377629 11568 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.378686 11664 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.342532 11682 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.379822 11482 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.379709 11568 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:27.377411 11652 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.384824 11682 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.343137 10110 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:27.409528 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.414839 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 66642.2us
I20260709 13:16:27.416652 10106 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:27.416697 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:27.419487 10185 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:27.421339 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 125732us
I20260709 13:16:27.426733 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:27.428222 10115 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:27.430935 10110 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:27.429378 10111 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:27.435669 10111 pending_rounds.cc:85] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 4
W20260709 13:16:27.436018 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 181850us
I20260709 13:16:27.437855 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.436124 10111 pending_rounds.cc:107] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:27.441569 10111 raft_consensus.cc:2889] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.374469 11477 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:27.447237 11477 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.442760 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:27.381217 11482 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:27.450495 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:27.450616 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:27.454378 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:27.454782 11652 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.455452 11652 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.456010 11652 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.458920 11503 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.459856 11564 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:27.460382 11564 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:27.460793 11564 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.479239 11687 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:16:27.480438 11687 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:27.480837 11687 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:27.482137 11687 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.452870 11482 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:27.486645 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46397.4us
I20260709 13:16:27.484033 11690 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:16:27.485746 11482 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.483713 11687 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.504101 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:27.496484 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.509611 10114 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.501276 11677 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:16:27.513867 11665 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.514899 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1151) took 1037 ms. Trace:
I20260709 13:16:27.514674 11665 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.518303 11645 raft_consensus.cc:1064] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
W20260709 13:16:27.519021 11645 raft_consensus.cc:1068] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Unable to promote non-voter 2f672b54d4754c5aa62b5b919597a14e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:27.506698 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 219) took 1381 ms. Trace:
I20260709 13:16:27.519901 10184 rpcz_store.cc:276] 0709 13:16:26.125506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.461330 (+335824us) service_pool.cc:224] Handling call
0709 13:16:26.461673 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.755808 (+294135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.506229 (+750421us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54000b4fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:27.506492 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553081216}
I20260709 13:16:27.505779 10109 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:27.515829 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.515362 10033 rpcz_store.cc:276] 0709 13:16:26.477218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.479825 (+  2607us) service_pool.cc:224] Handling call
0709 13:16:26.480199 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.117683 (+637484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.514264 (+396581us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400275bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:27.514653 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848698112}
I20260709 13:16:27.519263 11665 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.496572 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:27.531445 10114 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:27.529685 11506 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.534039 10186 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:27.534403 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:27.537236 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:27.520025 11496 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.548111 11495 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:27.550495 11495 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.550968 11495 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:27.552337 11495 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.554401 11495 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.555902 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.007s	sys 0.009s
W20260709 13:16:27.556432 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.007s	sys 0.009s
W20260709 13:16:27.556855 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 657819us
I20260709 13:16:27.552824 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2036) took 1192 ms. Trace:
I20260709 13:16:27.557492 10037 rpcz_store.cc:276] 0709 13:16:26.360371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.360470 (+    99us) service_pool.cc:224] Handling call
0709 13:16:27.552401 (+1191931us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400165b54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:27.552590 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182052736}
W20260709 13:16:27.557159 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.576608 10184 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:27.581135 10183 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:27.583066 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:27.586423 11559 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.599056 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:27.599313 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83759.6us
I20260709 13:16:27.600412 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.600821 11544 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.601783 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.602613 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.605334 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:27.605568 11369 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.608906 11369 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.609256 11369 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.610137  9936 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 181) took 1881 ms. Trace:
I20260709 13:16:27.612233 11682 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:27.612811 11682 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:27.614042 11682 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.616510 10040 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.617821 11559 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.619297 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.619913 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.632725 11506 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:27.633508 11506 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.626080 11559 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.609360 11588 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.636621 11588 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:27.637764 11588 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.625229 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:27.626545 10189 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:27.610917 11656 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.644388 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:27.644975 11503 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:27.645924 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:27.648250 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:27.617892 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:27.645759 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:27.665931 10186 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.655542 11506 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:27.713937 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.715386 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.670054 10033 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:27.671404 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.672456 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.610539  9936 rpcz_store.cc:276] 0709 13:16:25.728145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.733239 (+  5094us) service_pool.cc:224] Handling call
0709 13:16:27.609910 (+1876671us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:26.754439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:26.903184 (+148745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:26.903229 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:16:26.903247 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:26.903667 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:26.903723 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:26.903770 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:26.908421 (+  4651us) tablet.cc:701] Row locks acquired
0709 13:16:26.908442 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:26.908615 (+   173us) write_op.cc:270] Start()
0709 13:16:26.982411 (+ 73796us) write_op.cc:276] Timestamp: P: 1783602986908572 usec, L: 0
0709 13:16:27.042560 (+ 60149us) op_driver.cc:348] REPLICATION: starting
0709 13:16:27.202045 (+159485us) log.cc:844] Serialized 919 byte log entry
0709 13:16:27.386386 (+184341us) op_driver.cc:464] REPLICATION: finished
0709 13:16:27.465409 (+ 79023us) write_op.cc:301] APPLY: starting
0709 13:16:27.465572 (+   163us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:27.465815 (+   243us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:27.491468 (+ 25653us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:27.519884 (+ 28416us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:27.520173 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:27.520240 (+    67us) write_op.cc:312] APPLY: finished
0709 13:16:27.520682 (+   442us) log.cc:844] Serialized 29 byte log entry
0709 13:16:27.523069 (+  2387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:27.523259 (+   190us) write_op.cc:454] Released schema lock
0709 13:16:27.523318 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:27.523860 (+   542us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:27.523892 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":114919,"reported_tablets":3,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":819,"apply.run_cpu_time_us":3731,"apply.run_wall_time_us":58509,"num_ops":2,"prepare.queue_time_us":286701,"prepare.run_cpu_time_us":20895,"prepare.run_wall_time_us":581729,"raft.queue_time_us":57076,"raft.run_cpu_time_us":1243,"raft.run_wall_time_us":78868,"replication_time_us":343701,"thread_start_us":479901,"threads_started":4,"wal-append.queue_time_us":121458}]]}
W20260709 13:16:27.676223 11697 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:16:27.676789 11514 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.677024 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:27.677409 11664 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.679008 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:27.679960 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:27.681226 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.683450 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:27.684322 11358 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.685967 11693 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.689635 11564 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.690789 10183 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:27.652668 11656 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.692114 11677 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:27.737295 11677 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.738494 11564 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.667860 11645 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.693994 11690 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:27.740957 11515 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:27.741355 11515 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:27.741530 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:27.742321 11515 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.692611 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:27.698005 11670 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:16:27.698271 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:27.701725 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:27.708055 11556 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:27.653753 11652 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.738667 10032 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:27.733667 10186 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:27.739234 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:27.741312 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64404us
I20260709 13:16:27.696424 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.746495 10039 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:27.747394 11495 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.739573 11677 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:27.747418 11506 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:27.771955 11515 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.778479 11544 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.778892 11544 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:27.779238 11544 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:27.763557 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.763149 11556 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.782632 11556 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:27.768464 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:27.785871 11656 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:27.786784 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 103609us
I20260709 13:16:27.789974 11514 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.790423 10110 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:27.791153 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.747419 11645 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.792519 10188 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.793792 11645 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:27.794445 11495 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:27.795538 11495 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.772149 11665 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:27.811200 11665 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:27.812233 11665 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.812940 10188 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:27.762216 11369 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.799971 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:27.815573 10106 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
W20260709 13:16:27.816257 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 60134.9us
I20260709 13:16:27.816905 11369 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.817062 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:27.801893 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.802820 11376 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.803663 11541 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.804126 11392 raft_consensus.cc:993] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:27.777629 11506 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:27.805261 11518 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:27.805599 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 147896us
I20260709 13:16:27.806514 11358 raft_consensus.cc:993] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:27.834457 11358 raft_consensus.cc:1081] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:27.834874 11506 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.807520 10709 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:27.808198 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:27.810263 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:27.810732 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.813961 11514 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:27.814606 11456 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.773821 11652 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.817898 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:27.822547 11588 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.848228 10711 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:27.847874 11588 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:27.849699 11588 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.850143 11492 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.823305 11376 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.830572 11693 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.831244 10707 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:27.830600 11592 raft_consensus.cc:2764] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:27.832706 11583 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.835855 11496 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.838742 11541 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.851055 11588 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.845875 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69602.9us
I20260709 13:16:27.850735 11369 raft_consensus.cc:1081] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:27.825191 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.852363 11376 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:27.842100 11514 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:27.841856 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:27.860522 11541 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:27.851136 11492 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.851652 11656 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.852562 11693 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:27.857201 11559 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.870280 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.870160 11376 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.872340 11492 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.875782 11592 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.884645 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:27.887681 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62623.5us
I20260709 13:16:27.885668 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:27.886884 11656 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.883864 11369 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:16:27.884279 11592 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:27.897498 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.892272 11664 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.899406 11541 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.895537 11556 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.887902 11559 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.904222 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:27.897455 11592 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.905172 11556 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:27.903432 11664 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.894901 11693 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.913702 11693 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.915218 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.915941 11358 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.917538 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:27.908529 11589 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:27.910425 11556 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.901404 11514 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.948343 11514 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.930266 11583 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:27.931171 11559 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.932236 11518 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.937319 11376 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:27.916534 11664 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.920112 11544 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.955859 11376 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.956156 11544 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:27.956784 11544 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:27.941730 11589 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:27.942281 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:27.943089 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:27.945629 11652 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.946321 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:27.924093 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:27.943104 10182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:27.953186 11583 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:27.942315 11541 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.980058 11358 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:27.918115 11495 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.954416 11518 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:27.986173 10182 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.961066 11544 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:27.987653 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:27.982822 11583 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.991164 11695 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.961476 11589 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:27.986585 11652 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:27.984989 11492 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.008112 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.072233 10037 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:27.997064 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.072991 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:27.998390 11665 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.073963 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.008526 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.072752 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:28.011190 11711 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:28.021193 11664 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:28.007880 11712 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:16:28.077207 11432 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:28.081317 11432 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:28.082504 11432 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.021193 11592 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.085012 11592 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.010070 11544 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.085836 11588 raft_consensus.cc:1064] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:16:28.076964 11614 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.079524 11664 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:28.003818 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60906.2us
I20260709 13:16:28.086825 11614 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.088088 11492 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:27.996214 11518 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.089183 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.089545 11614 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.089824 10110 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.996467 10182 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.091706 11588 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.093750 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.094547 10180 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:28.076572 11495 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:28.008791 10181 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.017432 11506 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.096787 10181 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.072728 10032 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:28.015923 11376 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:28.100018 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:28.018652 11708 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.196s	user 0.000s	sys 0.003s
I20260709 13:16:28.100157 11376 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.101727 11376 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.112773 11376 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.103669 11495 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.038139 11358 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.130946 10708 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:28.103991 11614 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:28.133210 11674 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:28.134577 11518 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.136696 10039 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:28.104512 11583 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.138463 11592 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.139016 11592 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.105476 11664 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.140658 11664 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.106386 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.141222 11592 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.141821 10032 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:28.142902 11559 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.144104 11456 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:28.106664 11506 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:28.107908 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.109613 11589 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.146006 11589 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:28.103183 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 107167us
I20260709 13:16:28.149937 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:28.150247 10109 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:28.151312 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:28.152576 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.152715 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.152043 11674 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:28.072702 11652 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.153075 11432 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.154024 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.154542 11559 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.096074 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.155087 11559 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:28.155565 11614 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.156013 11614 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.155218 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59245.3us
I20260709 13:16:28.157259 11614 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.152663 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.152069 10039 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 1.
I20260709 13:16:28.162159 11674 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:28.172262 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:28.173485 11652 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.173905 11652 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.174252 11652 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.174919 10035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:28.175673 10035 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.176090 10035 raft_consensus.cc:614] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.156183 11559 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.181478 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.183647 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.184587 10180 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:28.193102 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 302309us
I20260709 13:16:28.172626 11495 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.195469 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.197266 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:28.197589 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.197878 11583 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.198195 10188 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.198654 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.200362 11495 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.201933 10185 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:28.204243 11376 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.205921 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:28.204861 11376 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.144640 11456 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:28.081256 11556 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.153795 11432 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.220551 10180 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:28.221680 10188 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:28.222278 11432 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:28.114627 11695 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:28.163924 11492 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:28.164832 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.121898 10110 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:28.166729 11656 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:28.165143 10109 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:28.167279 11614 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.144136 11664 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:28.209167 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.213018 10182 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.213795 11665 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:28.230597 10039 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:28.230791 11665 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.212582 10181 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.216691 11456 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.217170 10032 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:28.217489 11559 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.218552 11518 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.219651 11376 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.235647 11559 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.219426  9936 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.233002 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.236802 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:28.239194 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 174805us
I20260709 13:16:28.239394 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:28.231689 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.226155 10707 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:28.247651 10039 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.211269 11652 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.248615 10035 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:28.240265 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.231401 10708 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:28.256975 11456 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.257298 10108 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:28.259487 11665 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:28.259946 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.261550 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.253832 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.266882 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:28.244378 11559 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.276031 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.249867 10181 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.250344 11492 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:28.282984 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:28.269901  9936 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:28.293427 10115 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:28.296470 10035 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:28.273139 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.292992 11690 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.301393 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.301672 10714 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:28.302624 11715 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:28.303051 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.303678 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:28.307557 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.328367 10115 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:28.319533 10107 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:28.322584  9936 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 4 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.332037 11715 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.333140 10182 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.329797 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.333797 10110 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:28.309324 11614 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.335402 10036 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.336470 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.302640 11556 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.337172 10709 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.338104 10038 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.321072 11690 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.345383 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.346194 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.347353 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.383978 10040 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:28.349335 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.351845 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:28.352403 10113 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:28.364172 11715 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.353027 11495 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.353662 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.392690 10188 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.353914 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:28.354049 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46585.2us
I20260709 13:16:28.354574 11518 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.337073 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.367851 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.396368 10107 raft_consensus.cc:2368] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3.
I20260709 13:16:28.367733  9936 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.393543 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.394479 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.348694 11652 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.352582 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.385520 11690 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.393501 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.395123 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.425315 10036 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.365084 11695 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:28.398427  9936 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.391033 10034 raft_consensus.cc:2410] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:28.398949 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.407219 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.407460 10112 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:28.408090 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.408903 11589 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:28.412806 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.412482 11715 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.459694 11715 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.414541 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.462389 11559 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.463126 10033 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:28.416399 10189 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.464406 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.441828 11645 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:28.419970 11670 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.417050 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:28.420511 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.463240 10034 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:28.422469 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 52876.7us
I20260709 13:16:28.430153 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.392612 10708 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:28.442987 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49564.7us
I20260709 13:16:28.429598 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.386830 10711 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:28.392120 11674 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:28.481501 10189 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:28.452114 10181 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:28.454068 10182 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:28.392916 10106 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:28.422873 11518 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.485261 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.486464 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.487689 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.488988 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.457155 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.458773 10110 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:28.504345 10034 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.466616 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.446552 11392 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.507234 11392 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.508229 11392 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.509687 10184 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.506860 10034 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:28.506881 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:28.480722 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.437491 10714 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:28.463485 10033 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.454674 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.438210 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.499330 10109 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:28.500313 10040 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.500716 10187 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:28.500880 11358 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.501317 11592 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.467202 11645 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.517442 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.510833 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.530927 10111 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:28.534761 10037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:28.535459 10037 raft_consensus.cc:606] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.535851 10037 raft_consensus.cc:614] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.467299 11670 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.547436 10189 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:28.436389 10188 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:28.485430 11674 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.533636 11506 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:28.544293  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:28.621050 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:28.622637 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 77278.9us
I20260709 13:16:28.623569 10186 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:28.516570 11589 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.627727 10038 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:28.628455 10188 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:28.641705 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.642257 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:28.636129 11492 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:16:28.638200 11714 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:28.629421 10031 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
W20260709 13:16:28.653102 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 154032us
I20260709 13:16:28.638724 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.649171 11728 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:28.646068 11687 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:28.664994 10111 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:28.669399 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.675812 10188 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:28.677994 11645 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.670295 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.686893 10036 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:28.638226 10033 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.692203 10035 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:28.652720 11518 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.702847 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.713766 10187 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:16:28.710638 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.708696 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.686990 11515 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.681514 11645 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:16:28.717408 11559 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.701009 10183 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:28.763213 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.747864 11739 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.697451 11358 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:16:28.753804 11544 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.730984 11556 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:16:28.774210 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 108893us
I20260709 13:16:28.796566 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.770210 11744 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:16:28.798117 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:28.798350 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.764717 10709 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:28.759344 11515 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.772982 11670 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:28.810488  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:28.812445 11665 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:28.813321 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.781139 11392 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.814872 11735 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:28.816833 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.817214 10710 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:28.817703 11730 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:16:28.818756 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.822988 10188 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:28.822732 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.754021 11492 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.841017 10188 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:28.842141 10188 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.825325 10183 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:28.826066 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.827244 10708 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:28.828987 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.793233 11674 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:28.813696 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:28.833853 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:28.846711 10185 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.792824 11589 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:28.805119 11544 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.835611 11432 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:28.836746 10189 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:28.836849 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.795578 11728 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:28.796542 10032 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:28.839252 10187 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:28.778856 11739 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.831653 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:28.847230 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 84091.1us
I20260709 13:16:28.846592 11583 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:16:28.865231 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51608.2us
I20260709 13:16:28.837330 11735 consensus_queue.cc:1243] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:28.865804 11559 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:28.866096 11748 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:16:28.865712 11734 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:28.860175 11432 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:16:28.889734 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60837.4us
I20260709 13:16:28.837874 11690 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.868523 11682 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.890130 11515 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.890250 11652 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:28.890456 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.938313 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.936084 10037 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:28.888705 11544 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.936532 10715 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:28.895957 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.939512 11589 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.885375 11739 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:28.898634 10153 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.901870 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.903093 10185 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:28.937774 11690 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:28.906587 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.935711 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.907440 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:28.911339 10188 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:28.911942 11751 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.923533 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55361.1us
I20260709 13:16:28.878494 11728 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.930035 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:28.931900 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:28.933035 11376 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:28.938478 11652 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:28.949187 11652 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.892107 10004 leader_election.cc:400] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3.
I20260709 13:16:28.939729 10110 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:28.938978 10034 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.947860 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.945214 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:28.951332 10188 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:28.946112 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:28.940681 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:28.950578 10004 leader_election.cc:403] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:16:28.948117 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 49546.4us
I20260709 13:16:28.954349 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.955406 10108 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:28.950240 11652 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.956463 11544 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.956862 11544 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:28.957222 11544 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.950708 11515 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.958514 11740 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.958416 11515 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.953756 10713 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:28.960072 10180 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:28.961304 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 70938.5us
I20260709 13:16:28.962836 11506 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.963593 11588 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:28.964274 11592 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.964645 11592 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.965691 11544 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.966981 10033 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.967851 11544 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:28.969280 11432 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.970676 11432 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.971926 11674 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.972316 11674 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:28.973138 11674 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.974344 11674 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.966878 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:28.956357 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64445.4us
I20260709 13:16:28.962852 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.976572 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.979444 10034 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:28.980971 11376 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.981580 11376 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:28.981662 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:28.982899 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:28.934108 11559 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:28.988574 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:28.954406 11589 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:28.993613 11589 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:28.993597 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.994714 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.994714 11559 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:28.995026 11589 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:28.996160 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.997301 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:28.993173 11664 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:28.975253 11756 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.998214 11756 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:28.994065 11392 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.999146 11392 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.999475 11392 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.992908 11670 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.000802 11739 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:29.001497 11739 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.007733 11376 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.008201 11376 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:29.012132 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 57867.5us
W20260709 13:16:29.017284 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54494.8us
I20260709 13:16:29.019690 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:29.025851 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:28.992533 11690 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.964489 11588 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:29.015416 11456 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:29.061638 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56193.2us
I20260709 13:16:29.062959 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.011521 11744 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:29.069067 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50963.7us
I20260709 13:16:29.069818 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.070670 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.071359 11568 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.071906 11588 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:29.072299 11588 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:29.073112 11588 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.074307 11588 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.965601 11592 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.080765 11592 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.082479 11759 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:28.950511 11751 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:29.075388 11645 consensus_queue.cc:1175] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 13:16:29.028847 11670 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.048408 11690 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.068384 11496 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:29.094684 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.094839 11496 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.095592 11496 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.093487 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:29.097546 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.068534 11664 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:29.100721 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51708us
I20260709 13:16:29.101861 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:29.060413 11556 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:16:29.104084 10038 pending_rounds.cc:85] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 2
I20260709 13:16:29.106690 10038 pending_rounds.cc:107] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:29.106871 10038 raft_consensus.cc:2889] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.105782 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:29.107347 10182 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.096716 11690 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:29.108908 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46031us
I20260709 13:16:29.110160 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.100894 11568 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.100620 11664 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:29.105579 11496 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.124475 10182 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:29.116909 11592 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.117193 11751 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.108853 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:29.125978 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:29.124235 11664 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.118105 11742 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:29.143016 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67710.1us
I20260709 13:16:29.136148 11456 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:29.149580 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:29.150393 10181 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:29.152083 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:29.134500 11751 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.142189 11506 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3.
I20260709 13:16:29.138195 11670 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:29.165676 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55609.2us
I20260709 13:16:29.152048 11763 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:29.159081 11456 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:29.160887 11556 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:29.171509 11456 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.164630 11751 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:29.180449 11376 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.192245 10115 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.175904 11763 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.192360 11751 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.192366 11376 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.184020 10031 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:29.186013 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:29.173676 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:29.189136 10182 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:29.190963 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:29.181639 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:29.194674 11763 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.196033 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:29.197126 11768 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:16:29.198392 10110 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:29.199066 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:29.202456 10714 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.202616 11762 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.183862 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:29.219883 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:29.207340 11742 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.220508 10115 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:29.220602 11742 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.217850 10032 raft_consensus.cc:2376] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4. Re-sending same reply.
I20260709 13:16:29.219923 11515 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.222432 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:29.222858 11742 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:29.224548 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122774us
I20260709 13:16:29.204998 11690 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.208575 11392 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.208917 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:29.175033 11556 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:29.210762 11664 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.211449 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:29.211777 10031 pending_rounds.cc:85] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 1
I20260709 13:16:29.238971 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:29.214568 11559 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:29.240059 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:29.241883 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:29.242885 11376 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.248415 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.240847 11556 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.249735 10031 pending_rounds.cc:107] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:29.251117 10708 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 3: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:29.252064 11751 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:29.248308 11506 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:16:29.266477 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.271149 11715 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:29.271627 11715 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:29.260358 11588 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.272429 11588 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:29.272609 11715 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.273356 11588 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.247997 11742 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:16:29.250998 11674 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:29.282923 11674 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:29.283290 11674 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:29.283385 11715 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.252799 11559 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.284221 11674 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.257043 10031 raft_consensus.cc:2889] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.286229 11559 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.286216 11674 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.267128 11690 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.262202 11751 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:29.241562 11670 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.289199 11751 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.281802 10033 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:29.259302 11589 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:29.298767 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.318096 11392 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.319291 11766 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:29.319707 11766 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:29.320593 11766 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.321787 11739 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.322085 11766 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.324345 11742 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:29.324898 11742 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:29.325760 11742 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.329473 11506 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.329993 11506 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:29.335582 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.336261 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:29.336885 10714 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:29.335824 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:29.340695 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:29.341123 10708 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.343779 10107 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:29.345990 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:29.346575 10115 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:29.348943 11761 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 13:16:29.349195 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.350335 11719 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.353458 11518 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:29.354746 10079 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:29.356761 11737 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:29.362448 10107 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.366103 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.357129 11737 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.384845 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:29.385558 10034 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
W20260709 13:16:29.387102 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 118301us
I20260709 13:16:29.387838 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:29.389263 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:29.389740 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.389870 10107 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.390767 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:29.395414 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.409035 10031 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.412237 11751 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.414390 11751 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.380827 11645 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.415910 11645 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.416066 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:29.416733 10709 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:29.417438 11515 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.417990 11515 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:29.395125 11495 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.386454 11737 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.420924 11544 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:29.421876 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:29.422516 10180 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.422370 11544 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.423434 11751 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:29.423833 11751 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:29.424393 11645 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.428424 10036 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:29.432548 10107 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:29.438657 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:29.402220 10682 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:29.448197 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.449461 10113 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:29.392647 11767 raft_consensus.cc:2764] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:29.421337 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:29.453567 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:29.429257 11772 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:29.459510 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.460405 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:29.463765 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:29.467319 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.477505 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.453374 11670 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.461639 11674 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:29.500994  9934 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.500502 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:29.463627 11588 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.418903 11515 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.480429 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:29.461408 10184 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:29.479238 11746 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.485445 11687 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:29.479921 11740 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:29.536175 10110 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:29.479086 11766 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:16:29.483242 11456 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:16:29.482522 11735 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:16:29.452737 11756 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.511497 11664 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.512696 11665 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.539616 10186 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:29.500248 11670 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.555191 11740 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:29.555563 10709 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 3: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:29.552377 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:29.556726 11506 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.559026 11737 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.461822 11751 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.550418 11687 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.562288 11652 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.563189 11743 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:29.568056 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 87482.9us
I20260709 13:16:29.577021 10034 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:29.399487 11556 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.604182 11719 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.632234 10708 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:29.605300 11665 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:16:29.643959 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 185391us
I20260709 13:16:29.645890 10111 raft_consensus.cc:2368] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4.
I20260709 13:16:29.644438 11785 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:29.648969 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 111862us
I20260709 13:16:29.592595 11358 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:16:29.638818 11687 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.655666 10115 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
W20260709 13:16:29.656934 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 179502us
I20260709 13:16:29.657687 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.657114 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:29.661190 10037 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:29.628957 11740 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.641480 10180 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:29.646950 11589 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:29.676872 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:29.677732 10031 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:29.664535 11518 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:29.647418 11719 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:29.685902 11556 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.688386 11740 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.655400 11652 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:16:29.689172 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 286978us
I20260709 13:16:29.692332 10186 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:29.707442 10037 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:29.711759 11656 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:29.716427 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:29.713320 11518 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:29.720558 10710 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:29.722221 11670 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.721181 11518 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.723126 11784 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:29.726020 10036 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:29.719997 11740 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:29.718315 11652 consensus_queue.cc:1243] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:16:29.769145 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 54067.1us
I20260709 13:16:29.727917 11645 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.781441 11645 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.783406 11719 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.770365 11737 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.784848 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:29.786084 11682 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:29.786453 11682 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:29.786808 11682 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.787063 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:29.787634 10709 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:29.799074 11786 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:29.806699 10709 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
W20260709 13:16:29.809013 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 127695us
I20260709 13:16:29.727618 11664 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:29.811103 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 153490us
I20260709 13:16:29.814549 10079 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:29.818037 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:29.824007 11737 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:29.734131 11665 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.825639 11740 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.846110 11645 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.854737 11645 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.856956 11645 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.859923 11799 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:16:29.861773 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:29.862491 10709 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:29.852252 11687 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.877408 10709 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:29.878372 11687 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:29.848325 11682 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:29.881318 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:29.882462 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:29.884348 10710 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:29.886232 11682 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:29.906566 11495 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:16:31.023674 10039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.010s	sys 0.007s
W20260709 13:16:31.024418 10039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.010s	sys 0.007s
W20260709 13:16:31.108295 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 1.28617e+06us
I20260709 13:16:31.152522 11809 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.153229 11809 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.167528 11809 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.172417 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:31.469681 10033 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:31.187191 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 156) took 1461 ms. Trace:
I20260709 13:16:31.471971 10039 rpcz_store.cc:276] 0709 13:16:29.725690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.725838 (+   148us) service_pool.cc:224] Handling call
0709 13:16:29.726122 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.728564 (+  2442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.728597 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.747312 (+ 18715us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.024889 (+1277577us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.025246 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.186828 (+161582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.186909 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.186946 (+    37us) raft_consensus.cc:1685] finished
0709 13:16:31.186956 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.187097 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":352622,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":117953,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":1400409,"threads_started":2,"wal-append.queue_time_us":261594,"wal-append.run_cpu_time_us":1587,"wal-append.run_wall_time_us":1001605}
W20260709 13:16:31.154350 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.910s (SENT) [suppressed 7 similar messages]
I20260709 13:16:31.222922 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1212) took 1090 ms. Trace:
I20260709 13:16:31.475450 10036 rpcz_store.cc:276] 0709 13:16:30.132068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.832179 (+700111us) service_pool.cc:224] Handling call
0709 13:16:30.832516 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:30.832863 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.832891 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:30.833488 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:16:31.201992 (+368504us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:31.202037 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.202111 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.222623 (+ 20512us) raft_consensus.cc:1685] finished
0709 13:16:31.222649 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.222846 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":471131,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":141,"thread_start_us":368069,"threads_started":1,"wal-append.queue_time_us":367090}
W20260709 13:16:31.256410 10111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1019) took 1824 ms (client timeout 2012 ms). Trace:
W20260709 13:16:31.477222 10111 rpcz_store.cc:269] 0709 13:16:29.432022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.438424 (+  6402us) service_pool.cc:224] Handling call
0709 13:16:31.256130 (+1817706us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400210f54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:31.256311 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467722112}
I20260709 13:16:31.296504 11743 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.355394 11745 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.478765 11743 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.478873 11745 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.480350 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1213) took 1348 ms. Trace:
I20260709 13:16:31.481436 11743 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.482039 11743 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.482180 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.482976 10036 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:31.492134 11809 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.393175 11811 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.492703 11809 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.493274 11811 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.495805 11811 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.497355 11811 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.481243 10039 rpcz_store.cc:276] 0709 13:16:30.132306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.474234 (+1341928us) service_pool.cc:224] Handling call
0709 13:16:31.474597 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.474789 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.474818 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.474862 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:31.474892 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.474950 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.480276 (+  5326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.532454 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2079) took 2049 ms. Trace:
I20260709 13:16:31.725667 11811 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.725951 10038 rpcz_store.cc:276] 0709 13:16:29.482657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.482814 (+   157us) service_pool.cc:224] Handling call
0709 13:16:29.507214 (+ 24400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.509401 (+  2187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.509431 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.514611 (+  5180us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.727828 (+213217us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:29.760811 (+ 32983us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.762063 (+  1252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.762141 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.532144 (+1770003us) raft_consensus.cc:1685] finished
0709 13:16:31.532172 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.532374 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8775,"prepare.queue_time_us":32806,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":13542,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":42861,"thread_start_us":152651,"threads_started":1,"wal-append.queue_time_us":265240}
I20260709 13:16:31.540828 11743 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.729561 11743 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.729660 11816 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.730232 11816 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.551666 11518 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.731254 11518 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.571414 11728 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.732291 11728 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.733342 11518 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.734336 11728 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.581975 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:31.734562 11811 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.735116 10032 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.868220 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:31.590250 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 90166.7us
I20260709 13:16:31.607628 11812 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.608265 11809 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:31.611779 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08001b14c0 after lost signal to thread 8942
I20260709 13:16:31.632054 11745 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:31.657610 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 503247us
I20260709 13:16:31.674584 11674 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.680966 11815 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.683099 10186 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:31.684577 10180 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.685588 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:31.691522 11746 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.730192 11743 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.705137 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:31.706238 11783 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.717650 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:31.542824 10033 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:31.742141 11811 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:31.718521 11645 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.742215 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 1.87414e+06us
I20260709 13:16:31.731693 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1175) took 2348 ms. Trace:
I20260709 13:16:31.754652 11811 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:31.754179 10033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 160) took 1622 ms (client timeout 1576 ms). Trace:
I20260709 13:16:31.755625 11811 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.742594 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.756085 11715 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.756398 11719 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.742909 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:31.743040 11728 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.757561 11719 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.758227 11728 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.757087 11715 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.744625 11815 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.760771 11715 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.762532 11815 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.741742 11812 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.764174 11556 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.755105 11645 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.764812 11556 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.765954 11812 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.766470 11812 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.766779 11556 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.746536 10187 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:31.767445 11645 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.768716 11719 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.770090 11556 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:31.770944 11556 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.771871 11819 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.772375 11819 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.773005 11556 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.773248 11728 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.773870 11556 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.755162 11784 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.750353 11743 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.775127 11784 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.776813 11743 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.749804 11809 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.773684 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.774497 10038 raft_consensus.cc:2376] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4. Re-sending same reply.
I20260709 13:16:31.750697 11817 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.746763 11674 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.778193 11809 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.779693  9936 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 283) took 3668 ms. Trace:
I20260709 13:16:31.749872 11589 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.780982 11674 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.747007 11746 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.753952 10184 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:31.781577 11544 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:31.782147 11674 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.782547 11544 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.782814 11674 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.784379  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:31.784946 11719 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.781590 11817 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.785581 11719 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.781174 11589 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.787827 11376 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.788772 11376 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:31.789806 11589 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.790341 11589 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.790737 11589 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.790947 11376 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.766959 11812 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.763613 11811 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.792536 11687 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.792888 11645 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.782920  9934 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.793735 11811 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.795353 11544 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.787531 11719 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.749687 10032 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:31.797185 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1211) took 1665 ms. Trace:
I20260709 13:16:31.797580 10032 rpcz_store.cc:276] 0709 13:16:30.131808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.563647 (+1431839us) service_pool.cc:224] Handling call
0709 13:16:31.797111 (+233464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.798125 10187 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:31.806258 11815 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.806725 11815 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:16:31.736169 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.870s	user 0.009s	sys 0.014s
W20260709 13:16:31.808015 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.942s	user 0.009s	sys 0.014s
I20260709 13:16:31.808827 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 213) took 2094 ms. Trace:
I20260709 13:16:31.784994 11674 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.809613 11750 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:31.755683 10033 rpcz_store.cc:269] 0709 13:16:30.131522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.172098 (+1040576us) service_pool.cc:224] Handling call
0709 13:16:31.754117 (+582019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.781327 11809 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.780064  9936 rpcz_store.cc:276] 0709 13:16:28.110955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.111159 (+   204us) service_pool.cc:224] Handling call
0709 13:16:31.779613 (+3668454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:28.662033 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:28.764027 (+101994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:28.769060 (+  5033us) write_op.cc:435] Acquired schema lock
0709 13:16:28.771677 (+  2617us) tablet.cc:662] Decoding operations
0709 13:16:28.811327 (+ 39650us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:28.811422 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:28.811453 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:28.812114 (+   661us) tablet.cc:701] Row locks acquired
0709 13:16:28.812163 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:16:28.812325 (+   162us) write_op.cc:270] Start()
0709 13:16:28.812541 (+   216us) write_op.cc:276] Timestamp: P: 1783602988812257 usec, L: 0
0709 13:16:28.812562 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:28.813326 (+   764us) log.cc:844] Serialized 2152 byte log entry
0709 13:16:29.197123 (+383797us) op_driver.cc:464] REPLICATION: finished
0709 13:16:29.264790 (+ 67667us) write_op.cc:301] APPLY: starting
0709 13:16:29.267617 (+  2827us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:29.267848 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:29.269207 (+  1359us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:29.269948 (+   741us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:29.270134 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:16:29.270179 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:29.270413 (+   234us) log.cc:844] Serialized 47 byte log entry
0709 13:16:29.270586 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:29.270691 (+   105us) write_op.cc:454] Released schema lock
0709 13:16:29.270738 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:29.278576 (+  7838us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:29.278609 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":430758,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":60450,"apply.run_cpu_time_us":2809,"apply.run_wall_time_us":13774,"num_ops":5,"prepare.queue_time_us":173770,"prepare.run_cpu_time_us":105173,"prepare.run_wall_time_us":354097,"raft.queue_time_us":83751,"raft.run_cpu_time_us":5522,"raft.run_wall_time_us":69911,"replication_time_us":364614,"thread_start_us":276628,"threads_started":4,"wal-append.queue_time_us":261125}]]}
I20260709 13:16:31.753934 11783 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.783560 11746 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.763703 10181 rpcz_store.cc:276] 0709 13:16:29.382922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.386665 (+  3743us) service_pool.cc:224] Handling call
0709 13:16:29.461768 (+ 75103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.548440 (+ 86672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.550138 (+  1698us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.555280 (+  5142us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:29.555329 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.731432 (+2176103us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b5400096d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:31.731481 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.731609 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176994560}
I20260709 13:16:31.819862 11729 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.820538 11729 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.821039 11665 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:31.821614 11665 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.822778 11729 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.803632 11376 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.824028 11376 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.787529 11817 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.774487 11556 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.825922 11376 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.826408 11376 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.826510 11556 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.826814 11376 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.827265 11556 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.804284 11518 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.774513 11819 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.793035 11687 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.827714 11556 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.828145 11518 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.829667 11687 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.805720 11589 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.793424 11812 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.830166 11518 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.735720 11816 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.730674 11785 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.831756 11785 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.752004 11745 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.833069 11745 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.834034 11785 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.835091 11745 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.836722 11589 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.837249 11589 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:31.839391 11824 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.839433 11589 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
W20260709 13:16:31.839882 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49079us
I20260709 13:16:31.848228 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:31.830014 11556 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.793401 11645 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.840847 11819 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.855000 11746 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:31.858955 11746 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.859647 11739 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.860074 11739 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:31.821334 11783 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.844821 11742 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.845578 11588 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.864673 11588 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.866318 11815 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.846240 11809 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:31.846629 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.847105 11674 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:31.847550 11544 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.840212 11812 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.778918 11743 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:31.849856 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:31.867591 11589 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:31.877764 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 72122.1us
I20260709 13:16:31.877076 10682 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:31.882457 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.861685 11376 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.858255 11645 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.863816 11819 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.866818 11588 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:31.844522 11817 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.927862 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.929926 10039 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:31.932833 11376 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.933487 11376 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.777480 11784 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:31.943897 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65472.1us
I20260709 13:16:31.944682 11830 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.945241 11830 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.947665 11828 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:31.948235 11828 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.950502 11828 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.952502 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.953143 10039 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:31.953341 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:31.954655 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:31.964576 11376 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.867010 11742 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.951359 11518 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.044914 11665 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:31.962235 11828 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:31.929520 11783 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:31.877599 11589 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:32.047466 11822 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:31.873443 11544 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.066255 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:31.869186 11809 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:31.991626 11830 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.051033 11819 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:31.861080 11824 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:31.960520 11817 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.051630 10032 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:31.874922 11392 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.053414 11506 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.877467 11556 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:31.929288 11816 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:32.056681 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 111976us
I20260709 13:16:31.875162 11719 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.874958 11812 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.083459 11746 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.084622 11809 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.085110 11812 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.085731 11392 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.083485 11719 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.088341 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.088999 10180 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.089424 11544 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.089874 11816 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:32.090025 11719 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.068341 11783 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.090869 11816 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.067355 11828 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.092077 11828 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.091552 11783 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.069109 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.095475 10185 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:32.048765 11818 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.193s
I20260709 13:16:31.959200 11743 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.094437 11432 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.101284 11743 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.101102 11432 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.098500 10039 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:32.104915 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.072880 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.051396 11756 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.068869 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08001083e0 after lost signal to thread 9972
I20260709 13:16:32.091851 11556 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.066653 11518 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.070624 11645 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:32.069309 11568 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.082379 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1172) took 2813 ms. Trace:
I20260709 13:16:31.809173 10106 rpcz_store.cc:276] 0709 13:16:29.714832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.716064 (+  1232us) service_pool.cc:224] Handling call
0709 13:16:29.716398 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.790956 (+ 74558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.791725 (+   769us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.842767 (+ 51042us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.808403 (+1965636us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:31.808449 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.808538 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.808585 (+    47us) raft_consensus.cc:1685] finished
0709 13:16:31.808601 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.808750 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1609,"raft.queue_time_us":43748,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":174,"thread_start_us":1995645,"threads_started":2,"wal-append.queue_time_us":45363,"wal-append.run_cpu_time_us":1909,"wal-append.run_wall_time_us":1005182}
I20260709 13:16:32.076550 11588 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.066032 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.067859 11674 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:32.094342 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.069705 11589 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.098026 11392 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.106271 10188 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.091388 11506 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.105542 10039 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:32.128708 10182 rpcz_store.cc:276] 0709 13:16:29.269202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.269474 (+   272us) service_pool.cc:224] Handling call
0709 13:16:29.269898 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.273607 (+  3709us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:29.400493 (+126886us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.755607 (+2355114us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b1800337900. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:16:31.755828 (+   221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.756309 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.854842 (+ 98533us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:31.854883 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.855161 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.082104 (+226943us) raft_consensus.cc:1685] finished
0709 13:16:32.082201 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.082323 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238500,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":14359,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":7950592,"thread_start_us":313222,"threads_started":3,"wal-append.queue_time_us":249214,"wal-append.run_cpu_time_us":9988,"wal-append.run_wall_time_us":1285417}
I20260709 13:16:32.150069 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.150458 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:32.111192 11817 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.151278 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:32.162616 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.256069 11518 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.152109 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:16:32.211308 11832 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 13:16:32.261893 10040 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:32.268887 10710 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.184556 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 121427us
I20260709 13:16:32.154214 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.154623 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.292194 10187 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.294072 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.268775 11432 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:32.152465 11829 log.cc:927] Time spent T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:16:32.296844 11751 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.291657 10707 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.296941 11392 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:32.301513 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.302030 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.266544 11783 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.306910 10184 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:32.258777 11742 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.309283 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.309785 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:32.153836 11824 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.267648 11556 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.269834 11674 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.322155 10188 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:32.323062 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.323619 10188 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:32.148268 11645 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.308157 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.324379 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.291118 11588 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.310472 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.303014 11828 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.335142 10187 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:32.352311 10188 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:32.328236 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.157657 11568 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.356454 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.314131 11392 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.325536 10712 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:32.365880 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.367846 10186 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:32.369783 10182 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:32.357101 10188 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.372071 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.373483 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:32.333237 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9580 after lost signal to thread 10064
I20260709 13:16:32.375571 10188 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:32.378798 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.379522 10188 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:32.380985 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.384213 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.386876 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 159) took 2255 ms. Trace:
I20260709 13:16:32.388105 10034 rpcz_store.cc:276] 0709 13:16:30.131251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.621234 (+1489983us) service_pool.cc:224] Handling call
0709 13:16:31.621619 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.733986 (+112367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.734020 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.734061 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:31.734092 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.386614 (+652522us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54000654d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:32.386671 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.386812 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257876864}
W20260709 13:16:32.388635 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9840 after lost signal to thread 10065
W20260709 13:16:32.394670 10210 debug-util.cc:398] Leaking SignalData structure 0x7b0800366020 after lost signal to thread 10139
W20260709 13:16:32.394974 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8260 after lost signal to thread 10140
W20260709 13:16:32.396170 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0060 after lost signal to thread 10213
W20260709 13:16:32.397482 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08000dba20 after lost signal to thread 10740
W20260709 13:16:32.397769 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff1a0 after lost signal to thread 10741
W20260709 13:16:32.398089 10210 debug-util.cc:398] Leaking SignalData structure 0x7b080031b520 after lost signal to thread 11495
W20260709 13:16:32.398578 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08003bad80 after lost signal to thread 11682
W20260709 13:16:32.398964 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08003bafa0 after lost signal to thread 11735
W20260709 13:16:32.399217 10210 debug-util.cc:398] Leaking SignalData structure 0x7b0800389360 after lost signal to thread 11737
W20260709 13:16:32.399459 10210 debug-util.cc:398] Leaking SignalData structure 0x7b080039dc20 after lost signal to thread 11738
I20260709 13:16:32.401479 11737 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:32.402513 11737 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.404367 11674 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.404933 11831 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:16:32.408052 11798 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:32.408632 11798 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.408949 11796 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:32.409587 11796 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.410837 11798 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.411396 11798 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.411909 11652 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:32.412475 11652 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.414520 11652 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.415033 11652 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.392088 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:32.417424 11376 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.417893 11376 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.418174 11796 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.418637 11728 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.415481 11652 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.420683 11652 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.422123 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.422747 10185 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.425335 11783 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.431013 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.391237 11588 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.431730 10111 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:32.433451 10110 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:32.434599 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.436478 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.437187 10106 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:32.437887 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.438073 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:32.439057 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.439162 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.438206 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.440454 11756 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:32.440858 11756 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.441311 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.441895 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.441327 11756 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.442559 10033 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:32.442967 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.443924 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.444082 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.442045 11392 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.442481 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.445556 11392 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.445953 11392 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.439328 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.443562 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.448553 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.448851 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.449843 11556 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.449759 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.451092 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.393178 10188 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:32.451560 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.440793 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.452778 10038 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:32.453454 10036 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:32.454380 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.455636 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.452303 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.456681 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.457280 10188 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.458281 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.458864 10188 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:32.460212 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.423437 10707 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:32.461479 10108 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:32.461328 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.464351 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.464891 10185 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.465612 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.466028 10185 raft_consensus.cc:2376] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5. Re-sending same reply.
I20260709 13:16:32.466667 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.468276 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.470090 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.471067 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.472265 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.476536 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.476451 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.477515 10188 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:32.477880 10185 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:32.450811 11556 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.478971 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.451344 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.480942 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.459851 11765 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:32.461577 11674 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.460287 11824 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.484611 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.464231 11751 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.485643 10185 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:32.459656 11798 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.483075 11556 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.483762 11506 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.487911 11823 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.487963 11544 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:32.490293 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.492700 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.493608 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.482092 11831 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.431325 11589 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.479017 11762 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.495060 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.495695 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.490195 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.479027 11719 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:32.478853 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.483418 11834 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.504462 11358 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.475627 11817 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:32.486346 11765 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:32.494266 11751 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.530009 10108 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 1.
I20260709 13:16:32.537818 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.538890 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.575876 10110 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:32.502065 11432 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:32.504405 11823 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.530082 11762 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:32.502751 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.527719 11544 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.529908 11831 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.509822 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.581326 10182 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:32.569379 11358 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.570786 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.597327 10716 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:32.597676 10715 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:32.501221 11824 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.574877 11765 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.589628 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 86935.2us
I20260709 13:16:32.544996 11670 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.604225 11670 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.544910 11834 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.537196 11719 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:32.604715 11794 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 2.908s	user 0.015s	sys 0.016s
I20260709 13:16:32.605036 11719 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.606009 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2080) took 3030 ms. Trace:
I20260709 13:16:32.607251 11798 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.606379 10035 rpcz_store.cc:276] 0709 13:16:29.575872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.576838 (+   966us) service_pool.cc:224] Handling call
0709 13:16:29.591346 (+ 14508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.591691 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.591717 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.604460 (+ 12743us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.642528 (+ 38068us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:29.642619 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.642692 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.582917 (+2940225us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:32.605655 (+ 22738us) raft_consensus.cc:1685] finished
0709 13:16:32.605679 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.605920 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":13065984,"thread_start_us":9324,"threads_started":1,"wal-append.queue_time_us":50749}
I20260709 13:16:32.494938 11674 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.608460 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.608759 11589 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.609110 10035 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:32.596462 11518 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:32.609740 11518 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.610024 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.592315 11544 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.600891 10707 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:32.582638 11820 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.592522 11831 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.611609 11820 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:32.612076 11820 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.579808 11751 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.610147 11518 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.611127 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.614594 10035 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:32.614866 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.615587 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.616602 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:32.570878 10106 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:32.616241 10035 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:32.590008 11762 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.588361 11823 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.599611 11358 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.629750 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.636950 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.644937 11568 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.604157 11645 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.609751 11674 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.627892 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:32.604739 11670 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.617604 11834 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.618953 11809 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.659180 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:32.660537 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:32.651958 11824 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.657004 11783 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.657213 11568 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:32.660823 11809 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.677359 11506 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.688275 11783 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.695858 11854 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.735495 11518 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.666332 11826 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:32.691095 11809 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.689303 11568 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:32.700440 11432 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:32.748023 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 131478us
I20260709 13:16:32.700376 10710 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:32.756196 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:32.743481 11852 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:16:32.690382 11756 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:32.764604 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 104145us
I20260709 13:16:32.743764 11783 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.768277 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:32.768826 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55927.5us
I20260709 13:16:32.753153 11568 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.773836 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:32.755302 11432 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.779911 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:32.741425 11506 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.825600 10036 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:32.768596 11824 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:32.825105 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.825667 10040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2071) took 3599 ms (client timeout 1910 ms). Trace:
I20260709 13:16:32.769418 11835 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:32.850703 10040 rpcz_store.cc:269] 0709 13:16:29.176918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.177030 (+   112us) service_pool.cc:224] Handling call
0709 13:16:32.776190 (+3599160us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b54001572d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:32.776331 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6975550336}
W20260709 13:16:32.835588 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82662.5us
I20260709 13:16:32.825059 11432 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:32.871207 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 91387.7us
I20260709 13:16:32.871959 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:32.775703 11728 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.825736 11830 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.845012 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.843304 11816 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:32.850050 11824 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.836076 11665 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:16:32.879244 11432 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.848565 11820 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.901974 11861 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.921748 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:32.915356 11824 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.886734 11835 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.910907 11826 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.936034 11869 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:32.936549 11869 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:32.936915 11869 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.933610 11861 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:32.942926 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71041.7us
I20260709 13:16:32.944213 10680 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:32.910459 11830 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.949471 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.950481 11820 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:32.951930 11855 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:16:32.952134 11719 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.941527 11506 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.953922 11506 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:32.954527 11518 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.954453 11506 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.956135 11719 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.956596 11506 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:32.957986 11851 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:16:32.958518 11848 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:16:32.953855 11556 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.933369 11831 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.960376 11556 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.953418 11762 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.961515 11831 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:32.962281 11818 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.962649 11870 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:16:32.962939 11762 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:32.962792 11818 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.953437 10032 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:32.964824 11818 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.933177 11826 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:32.953395 11858 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:32.971267 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:32.974781 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.975430 10189 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.977059 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:32.977615 10188 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:32.978215 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.969734 10031 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:32.981424 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.983675 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.984544 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:32.985373 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:32.953478 11392 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.002s
I20260709 13:16:32.992024 10033 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.012931 11765 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:32.965448 11816 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.987125 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.959353 11809 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.009413 11432 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:32.991071 11739 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.970911 11826 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.984771 11568 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.010809 11358 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:32.941823 11670 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.014675 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:33.021396 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.021440 10111 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.017115 10189 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:32.993830 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.018867 10185 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.020085 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.025547 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.015952 10180 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.029114 11544 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.031494 11670 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:33.031698 11859 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.958149 11783 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:33.027390 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.034094 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.034775 10034 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.025538 10037 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:33.034641 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:33.032195 11859 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:33.054745 10188 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:33.054819 10115 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.036329 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.056133 10035 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.056058 10189 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.018647 11816 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:33.021754 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.056125 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.058305 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.058763 10036 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:33.061072 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.061688 10034 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:33.062418 10181 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.029181 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:32.995270 11751 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.065214 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.034246 11762 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.027870 11739 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.018085 11392 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.079559 10036 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.078819 10115 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:33.056572 11859 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.081341 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.082041 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:33.085907 10111 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:33.059948 11816 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.088438 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.091038 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:33.031524 11544 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.088958 11358 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.096426 10038 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:33.096572 10189 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.112705 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.097110 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.105921 10039 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.125825 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.125461 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.125952 10185 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:33.081001 11783 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.130328 11862 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:33.137557 11756 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.138701 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:33.162643 11376 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.128835 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.158082 10034 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:33.093127 11432 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:33.100448 11762 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:33.166272 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2085) took 1069 ms. Trace:
I20260709 13:16:33.129797 11715 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.170557 10034 rpcz_store.cc:276] 0709 13:16:32.096531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.125867 (+1029336us) service_pool.cc:224] Handling call
0709 13:16:33.157736 (+ 31869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.166007 (+  8271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.166216 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.173560 11376 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:33.174093 11376 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:33.160015 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.173591 11756 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:33.177515 11756 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:33.179502 11756 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:33.180480 11392 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.171315 10180 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.182044 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.167093 10709 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:33.175464 11376 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:33.189497 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 2.08015e+06us
I20260709 13:16:33.184540 11715 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:33.192664 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.209669 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.162235 11834 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.210634 10034 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.208818 11358 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.182063 11809 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:33.250154 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.195173 11835 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:33.222374 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.223652 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:33.225811 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.227031 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2100) took 1124 ms. Trace:
I20260709 13:16:33.257200 10039 rpcz_store.cc:276] 0709 13:16:32.103247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.921433 (+818186us) service_pool.cc:224] Handling call
0709 13:16:33.226702 (+305269us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540031bfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:33.226952 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421449472}
I20260709 13:16:33.228816 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:33.258917 10036 raft_consensus.cc:2410] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:33.208916 11544 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.242086 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:33.205017 11830 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.233747 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:33.185482 11568 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:33.246075 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2087) took 1147 ms. Trace:
I20260709 13:16:33.265713 10038 rpcz_store.cc:276] 0709 13:16:32.098789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.479580 (+380791us) service_pool.cc:224] Handling call
0709 13:16:33.237305 (+757725us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54000663d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:33.245995 (+  8690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308144384}
I20260709 13:16:33.202174 10183 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.247175 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.252776 10185 raft_consensus.cc:1217] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:16:33.269250 10185 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:33.260118 10188 raft_consensus.cc:2368] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:33.270538 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.220243 11652 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:33.217515 11859 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.263236 10189 raft_consensus.cc:2368] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3.
I20260709 13:16:33.263152 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:33.279785 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.259869 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.264606 10039 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.220494 11738 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.285662 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2092) took 1185 ms. Trace:
I20260709 13:16:33.286352 10039 rpcz_store.cc:276] 0709 13:16:32.100071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.263989 (+1163918us) service_pool.cc:224] Handling call
0709 13:16:33.264292 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.285414 (+ 21122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.285607 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.271293 10188 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.282208 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 174) took 1140 ms. Trace:
I20260709 13:16:33.287506 10040 rpcz_store.cc:276] 0709 13:16:32.142053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.268324 (+1126271us) service_pool.cc:224] Handling call
0709 13:16:33.281720 (+ 13396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.281909 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.281934 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.281975 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:33.282002 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.282054 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.282152 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.288617 11883 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:33.288982 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.290697 10040 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:33.263765 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 76115.1us
W20260709 13:16:33.291956 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122770us
I20260709 13:16:33.292737 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:33.273834 11652 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.295261 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:33.268556 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:33.296552 10034 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:33.296131 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.309532 10039 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.310521 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.296178 10037 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.307993 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:33.311936 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:33.312129 10186 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:33.313920 10186 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:33.314482 10039 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.315855 10187 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:33.316149 10039 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.316300 11862 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:33.317245 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 175) took 1047 ms. Trace:
I20260709 13:16:33.273546 11544 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:33.251984 11358 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:33.320158 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.317883 10039 rpcz_store.cc:276] 0709 13:16:32.269672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.315647 (+1045975us) service_pool.cc:224] Handling call
0709 13:16:33.315990 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.316938 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.317191 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.320909 10187 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [1.3-4.4]
I20260709 13:16:33.322516 10186 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:16:33.285627 11854 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.533s	user 0.000s	sys 0.015s
I20260709 13:16:33.325675 10187 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:33.327597 10155 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:33.327939 10155 leader_election.cc:403] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.278156 11751 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.329475 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:33.330204 10186 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:33.330540 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.331434 10186 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.289094 11883 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:33.335569 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.285772 11568 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.344709 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:33.357753 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:16:33.375597 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 82944.8us
W20260709 13:16:33.371824 11823 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.005s
I20260709 13:16:33.376039 11862 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:33.338336 11854 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.376924 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:33.269757 11762 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.290078 11588 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:16:33.353592 11820 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.363927 11856 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.283079 11715 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.394968 10040 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:33.403198 10034 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:33.289767 11869 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:33.410301 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 102818us
I20260709 13:16:33.327322 11888 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:33.410964 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.413609 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:33.422963 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:33.370275 11589 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:33.339092 11883 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.428304 10188 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:33.364215 11815 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.413754 10155 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:33.426640 11376 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.295508 11738 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.353279 11670 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:33.353809 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:33.374423 11568 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:33.429703 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:33.433781 11871 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.453099 10715 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:33.453490 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:33.434309 11874 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:33.436861 11889 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.440202 10183 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:33.432875 10155 leader_election.cc:403] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.441275 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.441777 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.430423 11886 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.417128 11856 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.439899 11583 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:33.454553 11376 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.455062 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.453038 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:33.376873 11823 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.413363 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:33.460922 10113 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
W20260709 13:16:33.460196 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46578.2us
I20260709 13:16:33.395807 11812 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:16:33.425470 11888 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:33.430970 11809 raft_consensus.cc:2764] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:33.468487 10107 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:33.364863 11816 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:33.430060 11589 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:33.478843 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.480619 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.444722 11682 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.486688 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.454741 11871 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:33.453581 11496 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:33.495671 10184 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.495987 11682 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.496695 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.497383 11823 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:33.497747 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2099) took 1395 ms. Trace:
I20260709 13:16:33.497889 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.498220 11682 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.498507 10114 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.498819 11665 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:33.483489 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.500906 10113 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:33.483875 11888 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.501662 11816 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:33.458753 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2088) took 1354 ms (client timeout 1747 ms). Trace:
I20260709 13:16:33.502488 11815 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.461637 11830 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:33.431880 11751 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:33.491490 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:33.510169 10713 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 1.
I20260709 13:16:33.493052 11738 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.480110 11583 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.493923 10181 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:33.469475 11588 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.495025 10707 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:33.504164 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.441483 11544 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.490268 10107 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:33.470037 11856 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.506667 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.463272 11874 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:33.503124 11884 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:33.515540 10182 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:33.488831 11670 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:33.528275 10180 raft_consensus.cc:2368] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5.
I20260709 13:16:33.489048 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:33.522398 10040 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:33.504391 11589 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.490164 11834 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.490155 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:33.526300 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.495507 11871 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.505878 11830 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:33.516185 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:33.503472 11824 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.001s
W20260709 13:16:33.502254 10032 rpcz_store.cc:269] 0709 13:16:32.099023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.384682 (+285659us) service_pool.cc:224] Handling call
0709 13:16:33.431603 (+1046921us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540031d3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:33.453270 (+ 21667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072755584}
I20260709 13:16:33.477291 11886 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.504580 11889 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:16:33.510886 11496 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.525231 11568 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:33.711495 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 253743us
I20260709 13:16:33.533428 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.532732 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:33.734486 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 244401us
I20260709 13:16:33.498172 10033 rpcz_store.cc:276] 0709 13:16:32.101868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.490009 (+388141us) service_pool.cc:224] Handling call
0709 13:16:33.476539 (+986530us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400350cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:33.488762 (+ 12223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003254016}
W20260709 13:16:33.732594 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 254941us
I20260709 13:16:33.698704 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.753479 10115 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:33.737176 10113 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.588330 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:33.756050 10040 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:33.757094 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.782950 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.553220 11859 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.784364 10115 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:33.695994 11891 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:33.739691 11830 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.785352 10107 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.531466 11432 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:33.787159 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.753050 11812 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:33.790819 11886 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.757593 11815 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:33.589210 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:33.785107 11878 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.790851 11496 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.800338 11869 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.798954 10113 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.823060 10114 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
W20260709 13:16:33.806973 11739 consensus_meta.cc:287] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.003s
I20260709 13:16:33.750439 11824 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:33.792361 11583 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:33.795302 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:33.909003 11824 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:33.931730 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:33.928633 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:33.943946 10113 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.945013 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:33.954015 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:33.954890 10114 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.989620 10112 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.889144 11812 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:33.796137 11891 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:33.924564 10032 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:34.032660 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.056181 10110 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:34.082091 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.082727 10113 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:34.077477 11826 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 1.050s	user 0.008s	sys 0.004s
I20260709 13:16:34.114944 10114 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.901903 11878 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:34.118979 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 364428us
I20260709 13:16:34.120227 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.124140 10114 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:33.800873 11874 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:34.131621 11888 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.003s
I20260709 13:16:34.141604 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.142910 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.144107 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.134656 11812 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:34.187811 10114 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.117914 11826 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.201545 11826 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:34.202447 10714 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:34.203423 10181 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.144879 11888 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.191825 11765 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.199136 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:34.235181 11883 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.782s	user 0.000s	sys 0.009s
I20260709 13:16:34.237358 11652 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:34.192684 11903 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.174s	user 0.002s	sys 0.003s
I20260709 13:16:34.241995 11883 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.243324 10711 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.244174 11358 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.103643 11815 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:34.078826 11432 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.206135 11861 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.208091 11742 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.211352 10114 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:34.292860 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.292091  9938 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 5, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:34.214536 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:34.293524 10114 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:34.216683 11828 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:34.294353 10188 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:34.294531 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.218462 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2120) took 1463 ms. Trace:
I20260709 13:16:34.295156 10114 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
W20260709 13:16:34.220046 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.221179 11795 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:34.203476 11891 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:34.224752 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.225860 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 235) took 1279 ms. Trace:
I20260709 13:16:34.295368 10034 rpcz_store.cc:276] 0709 13:16:32.754930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.414367 (+659437us) service_pool.cc:224] Handling call
0709 13:16:33.414689 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.415062 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.415089 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.415543 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.886148 (+470605us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:33.886190 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.886262 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.218217 (+331955us) raft_consensus.cc:1685] finished
0709 13:16:34.218243 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.218393 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10013,"thread_start_us":427518,"threads_started":1,"wal-append.queue_time_us":783610}
W20260709 13:16:34.260212 11820 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.005s
I20260709 13:16:34.260588 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:34.260989 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:34.252327 10031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 166) took 2371 ms (client timeout 1897 ms). Trace:
I20260709 13:16:34.276377 10113 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:34.293565 11878 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.216075 11818 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:34.296502 10682 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.046s	sys 0.048s
I20260709 13:16:34.298122 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.259723 11883 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:34.296578 11894 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.412s	user 0.002s	sys 0.006s
I20260709 13:16:34.292155 11742 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:34.304909 10114 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:16:34.296708 10081 connection.cc:256] RPC call timeout handler was delayed by -1.0236044299999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:16:34.304334 10682 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.046s	sys 0.048s
W20260709 13:16:34.312992 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 530113us
W20260709 13:16:34.297574 11906 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.190s	user 0.000s	sys 0.008s
I20260709 13:16:34.304615 10716 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:34.319283 10035 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.320992 10035 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:34.302452 11820 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:34.305673 11896 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.518s	user 0.008s	sys 0.000s
I20260709 13:16:34.306229 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.339960 10113 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:34.329627 10035 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.343889 10035 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.335693 10114 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:34.312134 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:34.345476 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 576) took 1103 ms. Trace:
I20260709 13:16:34.345616 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.346014 10712 rpcz_store.cc:276] 0709 13:16:33.242254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.243705 (+  1451us) service_pool.cc:224] Handling call
0709 13:16:34.304252 (+1060547us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:34.345389 (+ 41137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13482240}
I20260709 13:16:34.349258 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.350494 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.351632 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.355583 10183 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.357578 11818 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:34.365029 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.366319 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.352267 10114 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:34.370004 10039 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:34.370112 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.302112 11795 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.372848 10040 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.371326 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.373062 10035 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:34.374046 10035 pending_rounds.cc:85] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 5
I20260709 13:16:34.374545 10035 pending_rounds.cc:107] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:34.374775 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.375115 10035 raft_consensus.cc:2889] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.376246 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.326691 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:34.379726 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.382447 10039 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:34.387365 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.388051 10113 raft_consensus.cc:2376] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3. Re-sending same reply.
I20260709 13:16:34.388836 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 289) took 1139 ms. Trace:
I20260709 13:16:34.389200 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:34.378969 11588 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.002s
I20260709 13:16:34.388408 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.391532 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.390166 10187 rpcz_store.cc:276] 0709 13:16:33.246235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.326427 (+ 80192us) service_pool.cc:224] Handling call
0709 13:16:33.326668 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.326945 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.326964 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.337571 (+ 10607us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.511085 (+173514us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:33.511129 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.511199 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.384967 (+873768us) raft_consensus.cc:1685] finished
0709 13:16:34.384987 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.385108 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3661,"raft.queue_time_us":98,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":38429,"thread_start_us":114572,"threads_started":1,"wal-append.queue_time_us":331168}
W20260709 13:16:34.300699 10031 rpcz_store.cc:269] 0709 13:16:31.881359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.889281 (+  7922us) service_pool.cc:224] Handling call
0709 13:16:32.844825 (+955544us) spinlock_profiling.cc:243] Waited 884 us on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:34.252052 (+1407227us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400042254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.252238 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88548864}
I20260709 13:16:34.331476 11735 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:16:34.389114 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.381057 11742 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.397459 10035 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:34.419227 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 577) took 1063 ms. Trace:
W20260709 13:16:34.410931 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.060s	sys 0.166s
I20260709 13:16:34.425032 10040 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:34.661831 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.173s	sys 0.299s
I20260709 13:16:34.662006 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:34.662248 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 838862us
I20260709 13:16:34.663722 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.664319 10114 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:34.665113 11742 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:34.666699 11830 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.839s	user 0.004s	sys 0.004s
I20260709 13:16:34.667140 11830 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.668346 11795 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:34.668609 10180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 896) took 1473 ms (client timeout 1534 ms). Trace:
I20260709 13:16:34.669728 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1048) took 1145 ms. Trace:
I20260709 13:16:34.670485 10716 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:34.671257 11871 consensus_meta.cc:287] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.914s	user 0.008s	sys 0.002s
I20260709 13:16:34.676914 10115 rpcz_store.cc:276] 0709 13:16:33.524022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.756802 (+232780us) service_pool.cc:224] Handling call
0709 13:16:34.669537 (+912735us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b54002837d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.669669 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60401536}
W20260709 13:16:34.609616 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.522799 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 173) took 2422 ms. Trace:
I20260709 13:16:34.410790 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.622416 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1030) took 1184 ms. Trace:
I20260709 13:16:34.673055 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.680639 10112 rpcz_store.cc:276] 0709 13:16:33.438399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.442188 (+  3789us) service_pool.cc:224] Handling call
0709 13:16:33.442464 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.990136 (+547672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.622116 (+631980us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b540002c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:34.622340 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152367360}
I20260709 13:16:34.681288 10111 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:16:34.631026 11544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.014s	sys 0.012s
I20260709 13:16:34.410616 11828 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.682071 10035 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.686928 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.670388 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 898) took 1474 ms. Trace:
I20260709 13:16:34.684795 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.682086 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:34.418087 11856 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.001s
I20260709 13:16:34.689957 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:34.679580 10153 leader_election.cc:336] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.569s (SENT)
I20260709 13:16:34.688309 10185 rpcz_store.cc:276] 0709 13:16:33.195619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.195785 (+   166us) service_pool.cc:224] Handling call
0709 13:16:33.252648 (+ 56863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.269636 (+ 16988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.670201 (+1400565us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54002da0d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.670332 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129950592}
I20260709 13:16:34.691437 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.694067 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.409364 11588 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:34.691437 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:34.695679 10112 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:34.680022 10038 rpcz_store.cc:276] 0709 13:16:32.100289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.266636 (+1166347us) service_pool.cc:224] Handling call
0709 13:16:33.283813 (+ 17177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.284158 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.284187 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.284618 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.521392 (+236774us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:33.521444 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.521517 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.522571 (+1001054us) raft_consensus.cc:1685] finished
0709 13:16:34.522594 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.522731 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30294,"raft.queue_time_us":917,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":23877,"thread_start_us":183765,"threads_started":1,"wal-append.queue_time_us":344545}
I20260709 13:16:34.698213 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.698904 10038 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:34.699627 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.700206 10038 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:34.700788 11854 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.682448 11871 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:34.704054 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.705271 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.706398 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.707093 10113 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:34.695542 11888 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:34.298100 10106 rpcz_store.cc:276] 0709 13:16:32.946278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.946784 (+   506us) service_pool.cc:224] Handling call
0709 13:16:32.980892 (+ 34108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.275505 (+294613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.278422 (+  2917us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.371049 (+ 92627us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.534150 (+163101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:33.552120 (+ 17970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.609787 (+ 57667us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.225604 (+615817us) raft_consensus.cc:1685] finished
0709 13:16:34.225626 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.225775 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290148,"raft.queue_time_us":294664,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":42141,"thread_start_us":89819,"threads_started":1,"wal-append.queue_time_us":814821}
I20260709 13:16:34.708534 11798 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:34.709146 11798 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.710100 11830 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.711369 11798 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.713933 11823 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.714821 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1036) took 1275 ms. Trace:
I20260709 13:16:34.736812 10110 rpcz_store.cc:276] 0709 13:16:33.443715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.468167 (+ 24452us) service_pool.cc:224] Handling call
0709 13:16:33.515993 (+ 47826us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:34.714638 (+1198645us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540017e154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.714759 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744322816}
I20260709 13:16:34.738138 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.738440 10187 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.738691 10110 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.739475 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:34.715579 10037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2095) took 2614 ms (client timeout 3342 ms). Trace:
W20260709 13:16:34.716023 11589 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.961s	user 0.008s	sys 0.003s
I20260709 13:16:34.740473 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.717329 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:34.741426 10183 raft_consensus.cc:2410] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:34.742396 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.698518 10716 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:34.740132 10037 rpcz_store.cc:269] 0709 13:16:32.100861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.080564 (+979703us) service_pool.cc:224] Handling call
0709 13:16:34.715378 (+1634814us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400042c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.715515 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460960000}
I20260709 13:16:34.745263 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.745848 10037 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:34.746709 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.743582 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.703547 11871 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:34.740738 11589 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:34.685536 11544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.016s	sys 0.013s
I20260709 13:16:34.721910 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.760360 10185 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:34.769933 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.701053 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.701189 11854 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:34.726277 10712 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:34.728008 11652 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.774394 11652 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.775048 10038 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:34.776587 11652 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.728189 11559 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:34.729542 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.777254 11559 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.778023 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.779124 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.779268 11559 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.727945 11495 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.683365 10109 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:34.678896 10715 rpcz_store.cc:276] 0709 13:16:33.356216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.356381 (+   165us) service_pool.cc:224] Handling call
0709 13:16:33.380538 (+ 24157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.453630 (+ 73092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.418886 (+965256us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b5400640354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:34.419105 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166382976}
I20260709 13:16:34.747713 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:34.753806 10188 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:34.757311 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.697227 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.767454 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.760885 10111 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:34.786473 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.787070 10111 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:34.787830 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.788316 10111 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:34.789101 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.757962 10110 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:34.759047 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:34.790068 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.790906 10111 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:34.791419 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:34.791805 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.792403 10111 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.770573 10113 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:34.770526 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.694782 10035 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
W20260709 13:16:34.680068 10180 rpcz_store.cc:269] 0709 13:16:33.195006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.206567 (+ 11561us) service_pool.cc:224] Handling call
0709 13:16:34.668349 (+1461782us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400002dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.668505 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501759360}
I20260709 13:16:34.740166 10187 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:34.780001 10112 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:34.734252 10078 leader_election.cc:400] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:34.781594 10038 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.797183 10078 leader_election.cc:403] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:34.798487 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.799105 10113 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.756258 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:34.761122 10031 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:34.753633 11589 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:34.747984 11823 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.750567 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2122) took 1470 ms. Trace:
W20260709 13:16:34.804989 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71029.6us
I20260709 13:16:34.820983 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:34.820605 10033 rpcz_store.cc:276] 0709 13:16:33.279794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.784517 (+504723us) service_pool.cc:224] Handling call
0709 13:16:34.749867 (+965350us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:34.750062 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.750237 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.750265 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.750311 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:34.750341 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.750399 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.750500 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10275072}
I20260709 13:16:34.801505 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.821852 11737 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:34.748996 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.822283 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.805506 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:34.823004 10189 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:34.806294 10185 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:34.809333 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1042) took 1307 ms. Trace:
I20260709 13:16:34.825439 10113 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:34.822311 10112 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5.
I20260709 13:16:34.824414 10107 rpcz_store.cc:276] 0709 13:16:33.501608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.526038 (+ 24430us) service_pool.cc:224] Handling call
0709 13:16:34.809182 (+1283144us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54000b5754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.809278 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109206912}
I20260709 13:16:34.822332 10078 leader_election.cc:400] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3.
I20260709 13:16:34.827350 10078 leader_election.cc:403] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:34.817492 10709 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:34.831089 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.832340 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.829825 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:34.833825 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.834476 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:34.834980 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.835127 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.810482 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 294) took 1560 ms. Trace:
I20260709 13:16:34.836270 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:34.814482 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.783913 11496 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:34.784150 11495 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:34.808569 11559 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.817144 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.817412 11652 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:34.697021 11828 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.848268 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.848955 10112 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.818954 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:34.819664 11854 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.828387 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:34.841172 10111 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:34.836558 10186 rpcz_store.cc:276] 0709 13:16:33.247499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.332247 (+ 84748us) service_pool.cc:224] Handling call
0709 13:16:34.807617 (+1475370us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:34.807842 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.808007 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.808032 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.808071 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:34.808100 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.808155 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.808257 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98170624}
I20260709 13:16:34.845266 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:34.823920 11798 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:34.847873 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:34.818850 11826 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.850878 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.696580 11856 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.852160 10113 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:34.854071 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.829952 11739 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 2. Current term is 3.
I20260709 13:16:34.858491 10186 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:34.859331 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:34.860240 11878 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:34.833853 11735 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:16:34.863778 10709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 572) took 1621 ms (client timeout 1876 ms). Trace:
I20260709 13:16:34.847493 11796 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:34.864248 10709 rpcz_store.cc:269] 0709 13:16:33.240959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.243250 (+  2291us) service_pool.cc:224] Handling call
0709 13:16:34.756127 (+1512877us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:34.857141 (+101014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6454016}
I20260709 13:16:34.864938 11796 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:34.828755 11737 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:16:34.865331 11796 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.865545 11737 consensus_queue.cc:1243] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:16:34.866801 10153 leader_election.cc:336] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 2.036s (SENT)
I20260709 13:16:34.866868 11783 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:16:34.867879 11883 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:34.846019 11795 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:34.868752 11795 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:34.868870 11883 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:34.869170 11795 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.870323 11495 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:34.870841 11495 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:34.852424 11496 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.871678 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:34.852687 11798 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.854822 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.855645 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:34.873507 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.873720 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.874768 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.842626 11715 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:34.857033 11432 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.881223 10184 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5.
I20260709 13:16:34.881657 11715 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:34.882122 11876 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:34.878347 11888 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:34.834113 11589 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:34.884749 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:34.883453 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:34.885883 10040 raft_consensus.cc:2368] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:34.877801 10113 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:34.885531 10111 raft_consensus.cc:2410] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:34.857483 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.872463 11798 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.890327 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:34.878212 11826 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:34.898763 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:34.896597 10186 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:34.887502 11589 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.912009 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.912679 10186 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:34.899323 10111 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.876441 11883 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:34.903939 10188 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.916239 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:34.900918 10711 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:34.931857 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 897) took 1736 ms. Trace:
I20260709 13:16:34.932663 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:34.952157 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:34.944414 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.951215 10182 rpcz_store.cc:276] 0709 13:16:33.195329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.196288 (+   959us) service_pool.cc:224] Handling call
0709 13:16:33.515331 (+319043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.531952 (+ 16621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.931631 (+1399679us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001004d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:34.931785 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694225664}
I20260709 13:16:34.953130 10039 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.986227 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:34.988351 10186 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:34.988539 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:34.989895 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:34.990217 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:34.910935 11589 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:34.915246 11559 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:34.991683 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:34.992844 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 241455us
I20260709 13:16:34.992950 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:34.901430 11881 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:35.006011 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.006786 10112 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
W20260709 13:16:35.007824 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 165252us
I20260709 13:16:34.994649 10186 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.003836 10188 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
W20260709 13:16:35.006003 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150440us
I20260709 13:16:35.014004 11652 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:35.017640 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:35.017217 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 188820us
I20260709 13:16:35.015509 11878 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:35.017947 11652 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.025789 10107 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:34.995930 10709 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:34.988885 11823 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:34.992456 11830 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.991056 11568 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.990975 11874 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:34.991017 11876 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:34.993479 11670 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:34.991360 11912 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.022715 11742 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.021700 11878 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.053960 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:35.054596 10114 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.056360 11737 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:35.056775 11737 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.057621 11737 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.058272 11798 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.058804 11737 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.028402 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 573) took 1786 ms. Trace:
I20260709 13:16:35.059005 11931 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:35.060132 11931 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:35.058429 11934 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.061079 11798 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.061141 11934 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.061749 11934 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.061846 11798 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:35.062291 11798 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.063231 11798 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.038689 11820 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.064374 11798 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.064849 11495 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:35.065223 11495 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.066028 11495 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.067166 11495 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.005246 11871 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.053201 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.022490 11652 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.051397 10186 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:35.072525 11715 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.076956 11928 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:16:35.077584 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 236) took 2111 ms. Trace:
I20260709 13:16:35.078364 11589 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.090183 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:35.090380 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52007us
W20260709 13:16:35.090224 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 218607us
I20260709 13:16:35.095781 10113 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:35.096921 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:35.097920 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:35.099336 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.039358 11824 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:16:35.070039 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:35.100821 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:35.086089 10108 rpcz_store.cc:276] 0709 13:16:32.966009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.966160 (+   151us) service_pool.cc:224] Handling call
0709 13:16:32.966460 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.268347 (+301887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.268379 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.053321 (+784942us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b48001224d8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:16:34.620582 (+567261us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b2c000bbbd8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:16:34.643481 (+ 22899us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.919132 (+275651us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:34.919165 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.919325 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.077262 (+157937us) raft_consensus.cc:1685] finished
0709 13:16:35.077290 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.077490 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296742,"raft.queue_time_us":308685,"raft.run_cpu_time_us":2979,"raft.run_wall_time_us":775343,"spinlock_wait_cycles":101452800,"thread_start_us":258604,"threads_started":1,"wal-append.queue_time_us":415603}
I20260709 13:16:35.105207 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:35.112851 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.084391 11670 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:35.108419 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:35.116778 10040 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:35.081580 11830 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:35.116921 10034 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:35.106613 10114 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:16:35.117028 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 105590us
I20260709 13:16:35.080966 11874 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:35.121980 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.113530 11828 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.028141 11883 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.081224 11876 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.110769 11715 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.086375 10106 raft_consensus.cc:2376] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3. Re-sending same reply.
I20260709 13:16:35.112561 11652 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.109862 11856 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.115407 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:35.118599 11936 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.114658 11938 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:35.136586 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 114036us
I20260709 13:16:35.094620 11934 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.138397 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:35.126502 11589 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.140590 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.139348 10081 leader_election.cc:400] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:35.151695 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:35.152117 10081 leader_election.cc:403] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:35.161751 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.164841 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:35.130630 11935 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:35.170003 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.173569 10714 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 2: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:35.170455 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:35.139791 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:35.171700 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.174256 10716 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:35.136853 11936 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.175287 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:35.171998 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50987.1us
I20260709 13:16:35.133262 11432 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:35.182864 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:35.174891 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.127933 11933 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:16:35.183409 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:35.184597 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.184938 10187 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:35.138875 11938 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:35.129616 11735 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:35.182786 10108 raft_consensus.cc:2376] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3. Re-sending same reply.
I20260709 13:16:35.204510 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.205157 10108 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:35.197680 10114 raft_consensus.cc:2376] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5. Re-sending same reply.
I20260709 13:16:35.171834 11856 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.161131 11942 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:16:35.206881 11938 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.212818 11795 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.213841 10111 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.214882 11795 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.215083 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2238) took 1018 ms. Trace:
I20260709 13:16:35.215415 10111 rpcz_store.cc:276] 0709 13:16:34.196884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.931721 (+734837us) service_pool.cc:224] Handling call
0709 13:16:34.940022 (+  8301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.214184 (+274162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.214868 (+   684us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540017e154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:35.215030 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629360512}
I20260709 13:16:35.160511 11944 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:35.176110 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:35.205827 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:35.175585 11824 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.224470 10714 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:35.148489 11941 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:16:35.185807 11559 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:35.226104 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.222766 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:35.253687 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 503767us
I20260709 13:16:34.520771  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:35.226233 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 106896us
I20260709 13:16:35.255198  9938 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.173146 11928 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:35.218829 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:35.257882  9938 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.172446 11670 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.221951 11742 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.236301 11739 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:35.059533 10708 rpcz_store.cc:276] 0709 13:16:33.241405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.243335 (+  1930us) service_pool.cc:224] Handling call
0709 13:16:34.257165 (+1013830us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:34.257441 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.257720 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:34.768184 (+510464us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.004622 (+236438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.004683 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:35.004736 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.004812 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.022769 (+ 17957us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":559381,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":150,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":17590144,"thread_start_us":660851,"threads_started":2,"wal-append.queue_time_us":345716}
I20260709 13:16:35.222167 11715 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.285408 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:35.279415 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 96077.2us
I20260709 13:16:35.235579 11944 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:35.224750 11933 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:35.223268 11823 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:35.296279 10108 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:35.283859 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:35.225549 11942 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:35.186369 11830 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:35.314124 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 175793us
I20260709 13:16:35.323698 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:35.327555 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.328145 10114 raft_consensus.cc:2376] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5. Re-sending same reply.
I20260709 13:16:35.329003 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.329581 10114 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:35.283013 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:35.251754 11559 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.309612 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.358398 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.353576 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:35.312762 11715 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:35.319969 11950 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.360411 10707 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.378811 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:35.371419 11930 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:16:35.386745 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:35.315886 11933 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.395491 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:35.376312 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.266141 11936 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.397708 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.400722 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:35.401311 10034 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.401163 11937 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:35.377224 11935 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:35.365181 11942 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:35.364636 11739 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:16:35.392707 11943 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:16:35.331278 11432 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.424312 10114 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:35.393922 11874 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:35.409951 11796 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 13:16:35.445459 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:35.446172 10040 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:35.405596 11939 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:35.449874 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 132540us
I20260709 13:16:35.411674 11876 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.477023 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.477593 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:35.398911 11495 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:16:35.486191 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.424286 11934 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.482555 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:35.487840 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:35.489236 10039 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:35.489500 11652 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.363073 11944 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.489951 11652 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:35.490363 11652 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.492492 11793 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.402289 11950 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:16:35.494158 11950 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.494514 11950 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.495155 11823 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:35.482502 10034 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
W20260709 13:16:35.496832 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 207980us
I20260709 13:16:35.497450 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:35.499007 10078 leader_election.cc:400] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5.
I20260709 13:16:35.499413 10078 leader_election.cc:403] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:35.501688 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:35.505196 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.506806 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.449827 11935 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:35.507478 10187 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:35.513571 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:35.520656 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98223.5us
I20260709 13:16:35.484841 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.486101 11928 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.547225 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.548547 11737 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:35.552618 10004 connection.cc:256] RPC call timeout handler was delayed by -1.2581888539998545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:16:35.553166 10004 connection.cc:256] RPC call timeout handler was delayed by -1.2401888539998254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:16:35.553472 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1942888539999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:16:35.553752 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1708888539999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:16:35.554025 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1276888539998708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 13:16:35.554318 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1123888539998461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:16:35.554589 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1114888539998447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:16:35.451097 11796 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.451185 11946 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:16:35.521234 11793 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:35.443080 11715 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:35.580745 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93890.1us
I20260709 13:16:35.521938 11934 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5.
I20260709 13:16:35.565428 11737 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.521839 11952 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.446296 11942 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.588618 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:35.490079 11958 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:16:35.495283 11950 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.572964 11496 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.591332 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:35.638628 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47376.1us
I20260709 13:16:35.640228 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.583566 11793 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:35.642323 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.591876 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.572189 10106 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
W20260709 13:16:35.594197 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 206375us
I20260709 13:16:35.595050 10113 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.511235 11735 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:16:35.588156 11737 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:35.600442 11960 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:35.614548 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:35.647346 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.638643 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:35.591056 11559 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.595124 11952 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:35.647207 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:35.647606 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55810.6us
I20260709 13:16:35.673116 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:35.644485 11957 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.680194 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.645560 11793 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.648567 11568 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.681440 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.648984 11815 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.670008 11912 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.669886 11954 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.696470 10714 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:35.649186 11742 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:35.672405 11856 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.684067 11823 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.712618 11735 consensus_queue.cc:1243] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:35.677280 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.645442 11652 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.715404 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:35.706072 10189 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:35.684314 11911 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.683964 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:35.678110 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:35.680379 11957 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:35.724150 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:35.706873 11933 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.756796 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.757514 10189 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:35.724603 11952 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.726579 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 301) took 1513 ms. Trace:
I20260709 13:16:35.705072 11961 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:35.732414 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.708915 11939 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:35.706648 11815 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:35.746788 11971 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.746421 11911 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:35.739094 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 61890.2us
I20260709 13:16:35.710855 11559 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.669059 11935 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.723372 11965 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:35.734614 11958 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:35.770967 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.771974 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.758834 11957 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.782306 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.783631 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:35.774214 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44289.8us
I20260709 13:16:35.751734 10106 raft_consensus.cc:2376] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5. Re-sending same reply.
I20260709 13:16:35.763161 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:35.765558 11815 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.774073 11911 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.764724 11971 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:35.793385 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.760731 11961 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.781250 11955 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.796739 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.785243 11796 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.776983 11559 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:35.800865 11969 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:35.791348 11985 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:16:35.802441 11824 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.001s
W20260709 13:16:35.803561 11938 consensus_meta.cc:287] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.005s
I20260709 13:16:35.803614 11971 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:35.812722 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52063.1us
W20260709 13:16:35.794420 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.785593 11830 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.840350 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:35.840803 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44130.6us
I20260709 13:16:35.858883 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.861624 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.842778 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.793385 11973 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.851660 11938 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.864763 11992 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:35.759553 10181 rpcz_store.cc:276] 0709 13:16:34.213668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.218950 (+  5282us) service_pool.cc:224] Handling call
0709 13:16:34.219332 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.219676 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.219711 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.100169 (+880458us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b2c000bbb28. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:16:35.122852 (+ 22683us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.637724 (+514872us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:35.647120 (+  9396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.671277 (+ 24157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.726263 (+ 54986us) raft_consensus.cc:1685] finished
0709 13:16:35.726300 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.726511 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2453,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":28940032,"thread_start_us":472228,"threads_started":1,"wal-append.queue_time_us":590339}
I20260709 13:16:35.781493 11965 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.853578 10707 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:35.867051 11652 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.785076 11958 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.842624 11944 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.869084 11961 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.852553 11824 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:35.852160 11939 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.875655 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.882645 11559 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.873036 11981 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:35.871806 11589 consensus_meta.cc:287] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.001s
I20260709 13:16:35.884230 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:35.858505 11796 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:35.860198 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:35.889448 10038 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:35.876333 11737 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.890795 11652 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:35.901014 10189 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:35.885018 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.884122 11993 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:35.894712 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:35.904546 11993 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:35.905253 11737 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.884258 11944 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:35.905550 10181 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:35.877172 11955 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:35.879007 11967 raft_consensus.cc:2764] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:35.900772 10187 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:35.905417 11993 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.909200 11965 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.909498 11938 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.905850 11944 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.901664 11796 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.910287 10106 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.917404 11944 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.919449 11944 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.920161 11796 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.903652 10189 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:35.920692 11958 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:35.883980 11992 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.936470 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.937685 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:35.937567 11992 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.940085 10189 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:35.933213 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 48272.6us
I20260709 13:16:35.907538 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:35.941452 10181 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:35.942098 10189 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:35.944476 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.945811 11954 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.946419 11954 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:35.946681 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:35.947760 11954 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.896448 11981 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.903285 11793 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.948853 11938 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.949296 11815 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:35.971454 11815 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:35.956377 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:16:35.957825 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.958379 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:35.969241 11911 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:35.962234 10155 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.747s (SENT)
I20260709 13:16:35.978856 11981 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.941484 10106 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:35.955024 11954 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:35.984422 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:35.984809 11954 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.985735 11815 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:35.986212 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 253) took 1236 ms. Trace:
I20260709 13:16:35.969254 11793 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:35.977416 10184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 297) took 2468 ms (client timeout 1691 ms). Trace:
I20260709 13:16:35.981146 10034 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.896792 11957 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.993068 11957 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:35.984190 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:35.986938 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:35.986603 10113 rpcz_store.cc:276] 0709 13:16:34.749647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.106210 (+356563us) service_pool.cc:224] Handling call
0709 13:16:35.106487 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.646570 (+540083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.985980 (+339410us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54002b7d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:35.986154 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111175424}
I20260709 13:16:35.988870 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:35.990444 11854 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.999334 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.000360 10035 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.986393 11911 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:36.010011 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.010763 10113 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:36.011905 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:36.013280 10109 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:36.013669 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1237) took 1189 ms. Trace:
I20260709 13:16:36.013943 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2236) took 1817 ms. Trace:
I20260709 13:16:36.014335 10109 rpcz_store.cc:276] 0709 13:16:34.196357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.012580 (+1816223us) service_pool.cc:224] Handling call
0709 13:16:36.012929 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.013665 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.013886 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.988368 11815 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:36.007401 10106 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:36.021536 10708 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:35.990818 10184 rpcz_store.cc:269] 0709 13:16:33.508806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.512459 (+  3653us) service_pool.cc:224] Handling call
0709 13:16:35.977178 (+2464719us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400096854. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:35.977329 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281485696}
I20260709 13:16:35.998317 11961 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.027537 11936 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.026959 11815 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:35.989316 11935 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.035084 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:36.034211 11935 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:36.036258 11935 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.040109 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.040937 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 251) took 1322 ms. Trace:
I20260709 13:16:36.041236 10110 rpcz_store.cc:276] 0709 13:16:34.718880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.789826 (+ 70946us) service_pool.cc:224] Handling call
0709 13:16:36.039993 (+1250167us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:36.040874 (+   881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943616}
I20260709 13:16:36.042387 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.043023 10110 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 1.
W20260709 13:16:36.043376 11994 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:36.046111 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.048393 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:36.049139 11956 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:16:36.043802 11935 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.055401 11956 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.055817 11956 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:36.057581 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.058547 11874 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.058586 11956 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.059962 11956 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.016868 10180 rpcz_store.cc:276] 0709 13:16:34.824705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.026253 (+201548us) service_pool.cc:224] Handling call
0709 13:16:36.013461 (+987208us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400002dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:36.013604 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569478400}
I20260709 13:16:36.068542 11977 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.068926 11977 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:36.069041 11971 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.069721 11977 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:36.070924 11977 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.072983 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.073839 11793 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:36.074206 11793 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.074584 11793 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.053179 11589 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:36.076073 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:36.062031 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.082531 10113 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:36.083561 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.052477 11911 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.085930 10035 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:36.074153 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.090184 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:36.091132 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.066426 11874 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:16:36.091320 11739 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.092046 11799 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.092443 11799 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:36.092829 11799 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.094254 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.094962 10112 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:36.095465 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.096226 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.096935 10112 raft_consensus.cc:2376] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5. Re-sending same reply.
I20260709 13:16:36.098040 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.099296 10112 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:36.092082 11962 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.102432 11823 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.089115 11911 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:36.105007 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.089226 11938 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.137795 10032 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.139305 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.147449 10115 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:36.121250 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.148814 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.128530 10111 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:36.111696 11823 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:36.131609 11739 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.132054 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.159845 10112 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:36.160867 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.159667 11795 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.150048 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.155925 11936 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.150048 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.147614 11962 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:36.119168 11911 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.172214 11795 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:36.180100 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:36.181286 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:36.170684 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1240) took 1317 ms. Trace:
I20260709 13:16:36.184518 10188 rpcz_store.cc:276] 0709 13:16:34.853054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.022062 (+169008us) service_pool.cc:224] Handling call
0709 13:16:35.022309 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.100275 (+ 77966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.100318 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.100355 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:35.100381 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.170446 (+1070065us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54002db9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:36.170494 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.170624 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178876160}
I20260709 13:16:36.186961 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.179046 11962 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.189355 11496 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.190160 11936 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.190305 10709 raft_consensus.cc:1217] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:16:36.190557 11936 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:36.190874 10709 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:36.173242 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:36.191344 11936 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.192060 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.190183 11496 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.176584 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:36.192674 10112 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:36.193255 11936 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.193671 11818 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.194089 11818 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.179054 11823 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.192718 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:36.195542 11823 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.196151 11854 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:36.194437 11818 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.197120 11854 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.177429 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:36.177958 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:36.188807 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:36.187969 11891 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.193609 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.172453 11946 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:36.202782 11946 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.203156 11946 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:36.204304 10035 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:36.207821 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:36.208377 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.209024 11496 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:36.209867 10113 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:36.210335 10035 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.210686 11793 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.202088 11939 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.211761 11939 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:36.211982 10035 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:36.214854 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2277) took 1040 ms. Trace:
I20260709 13:16:36.209043 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.216248 10112 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.217384 11799 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.215240 10108 rpcz_store.cc:276] 0709 13:16:35.174434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.222531 (+ 48097us) service_pool.cc:224] Handling call
0709 13:16:36.214667 (+992136us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54000b3bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:36.214798 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129825024}
I20260709 13:16:36.219955 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.221132 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.221993 10108 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:36.223697 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.204015 11946 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.224035 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.172570 10115 raft_consensus.cc:2376] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5. Re-sending same reply.
I20260709 13:16:36.232941 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.233556 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.228799 11936 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:36.235868 11812 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:36.239238 11939 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.246124 11939 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.248076 11793 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:36.249238 10180 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:36.250839 11946 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.253813 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:36.254055 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:36.254593 10188 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.232313 10108 raft_consensus.cc:2376] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4. Re-sending same reply.
I20260709 13:16:36.255899 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.256628 10108 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.214736 11954 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.260581 10115 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 6.
I20260709 13:16:36.261514 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.236454 11812 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.226641 11957 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:36.268312 11799 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:36.288353 10112 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:36.270000 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.271241 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:36.271891 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.272868 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:36.273875 11942 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:36.274489 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:36.274255 11818 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.259657 11820 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.266861 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:36.283411 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:36.269088 11812 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:36.289666 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.292201 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.300297 10185 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.302049 10188 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:36.303408 10035 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:36.239832 11795 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.310828 10180 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:36.304857 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.313978 11972 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:36.316777 11935 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:36.376233 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 192) took 1261 ms. Trace:
I20260709 13:16:36.317934 11954 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:36.260035 11854 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.326459 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.329077 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.440424 10110 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:36.330255 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2279) took 1104 ms. Trace:
I20260709 13:16:36.330760 10108 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:36.332561 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.336642 11888 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.338551 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.344275 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2285) took 1022 ms. Trace:
W20260709 13:16:36.361505 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.376189 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.369349 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1247) took 1351 ms. Trace:
W20260709 13:16:36.362429 10107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2228) took 2181 ms (client timeout 2815 ms). Trace:
I20260709 13:16:36.366446 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.396659 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.353052 10036 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.351435 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:36.411150 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.373373 10038 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.408262 10115 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:36.436749 10037 rpcz_store.cc:276] 0709 13:16:35.114821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.115260 (+   439us) service_pool.cc:224] Handling call
0709 13:16:36.375547 (+1260287us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:36.375765 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.375939 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.375966 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.376002 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:36.376030 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.376084 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.376181 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987264}
W20260709 13:16:36.433983 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 129215us
I20260709 13:16:36.441329 10111 rpcz_store.cc:276] 0709 13:16:35.225429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.225880 (+   451us) service_pool.cc:224] Handling call
0709 13:16:36.329984 (+1104104us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540026cfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:36.330180 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045193088}
I20260709 13:16:36.461894 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:36.535374 10111 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:36.498313 10108 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:36.515187 10112 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 2.
I20260709 13:16:36.536468 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:36.584553 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.585789 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.536548 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2294) took 1116 ms. Trace:
W20260709 13:16:36.491693 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 159215us
I20260709 13:16:36.587224 10111 rpcz_store.cc:276] 0709 13:16:35.420400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.534758 (+1114358us) service_pool.cc:224] Handling call
0709 13:16:36.535078 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.536290 (+  1212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.536491 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.586925 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:36.496536 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 254) took 1115 ms. Trace:
I20260709 13:16:36.492008  9938 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.535604 11888 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:36.535331 10115 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.592410 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2295) took 1141 ms. Trace:
I20260709 13:16:36.592747 10115 rpcz_store.cc:276] 0709 13:16:35.450913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.534877 (+1083964us) service_pool.cc:224] Handling call
0709 13:16:36.535158 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.592158 (+ 57000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.592351 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.370286 10033 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:36.543473 10181 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:36.364032 11971 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:36.361930 11798 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:36.538244 10112 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:36.540580 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:36.600324 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 224225us
I20260709 13:16:36.601092 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:36.599179 11912 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.600004 11798 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:36.549636 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.602980 11798 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.572539 11911 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.574967 10185 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.604097 11812 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.575932 10189 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.546898 11938 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:36.577386 10183 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:36.611478 11938 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:36.612507 11938 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.578665 10187 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:36.540271 10186 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.578670 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:36.433290 11820 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.489399 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 341) took 1355 ms. Trace:
I20260709 13:16:36.619937 10709 rpcz_store.cc:276] 0709 13:16:35.134503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.148466 (+ 13963us) service_pool.cc:224] Handling call
0709 13:16:36.074133 (+925667us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:36.074358 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.191220 (+116862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.453076 (+261856us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54005195d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:36.489331 (+ 36255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288824448}
I20260709 13:16:36.488659 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2290) took 1165 ms. Trace:
I20260709 13:16:36.621331 10113 rpcz_store.cc:276] 0709 13:16:35.323212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.083300 (+760088us) service_pool.cc:224] Handling call
0709 13:16:36.453730 (+370430us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400404054. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:36.488593 (+ 34863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282393856}
I20260709 13:16:36.581000 11818 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:36.581391 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.581542 10714 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:36.582122 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.539230 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 256) took 1156 ms. Trace:
I20260709 13:16:36.633889 10108 rpcz_store.cc:276] 0709 13:16:35.383239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.447846 (+1064607us) service_pool.cc:224] Handling call
0709 13:16:36.498118 (+ 50272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.538962 (+ 40844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.539168 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.583487 10106 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.536542 10114 rpcz_store.cc:276] 0709 13:16:35.322060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.358117 (+ 36057us) service_pool.cc:224] Handling call
0709 13:16:36.344063 (+985946us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b540026bbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:36.344200 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149165952}
I20260709 13:16:36.635921 10114 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:36.585536 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.589610 10110 rpcz_store.cc:276] 0709 13:16:35.381284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.495625 (+1114341us) service_pool.cc:224] Handling call
0709 13:16:36.496010 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.496200 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.496228 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.496268 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:36.496297 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.496349 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.496472 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.590624  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 286) took 8270 ms. Trace:
I20260709 13:16:36.590404  9938 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 4, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.535590 10182 rpcz_store.cc:276] 0709 13:16:35.017485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.173154 (+155669us) service_pool.cc:224] Handling call
0709 13:16:35.196679 (+ 23525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.163436 (+966757us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:36.171308 (+  7872us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.236855 (+ 65547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.236910 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:36.236953 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.369075 (+132122us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54002da0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:36.369123 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.369265 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4021,"prepare.queue_time_us":2207,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":5461,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3985,"spinlock_wait_cycles":2222789888,"thread_start_us":61094,"threads_started":1,"wal-append.queue_time_us":63185}
W20260709 13:16:36.586504 10107 rpcz_store.cc:269] 0709 13:16:34.181135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.832103 (+650968us) service_pool.cc:224] Handling call
0709 13:16:36.362203 (+1530100us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540022bad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:36.362355 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443635968}
I20260709 13:16:36.362651 11950 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.367781 11878 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.542307 10180 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:36.595480 10115 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:36.356594 10712 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:36.629281 11544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.039s	sys 0.070s
W20260709 13:16:36.596374 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60361.3us
I20260709 13:16:36.660148 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.348505 10109 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:36.597669 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.597592 10037 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:36.349829 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.594702 11888 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.598694 11871 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.603461 10031 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.445739 11982 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.576671 11795 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.648006 11878 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:36.677116 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 396) took 1034 ms. Trace:
I20260709 13:16:36.677518 10712 rpcz_store.cc:276] 0709 13:16:35.642611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.645814 (+  3203us) service_pool.cc:224] Handling call
0709 13:16:36.356104 (+710290us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:36.356363 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.670140 (+313777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.677046 (+  6906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4557568}
I20260709 13:16:36.665927 11823 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:36.680145 11823 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.680514 11823 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:36.680931 10710 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:36.681370 11823 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.673776 11568 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:36.682536 11823 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.682710 11888 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.684145 11989 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:36.655023 11931 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.608110 11798 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.608165 11911 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:36.666077 11824 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.643040 10107 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:36.643505 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58075.8us
I20260709 13:16:36.693080 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.693662 10107 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.693879 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.695384 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.644629 10035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:36.696341 10035 raft_consensus.cc:606] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.696696 10035 raft_consensus.cc:614] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:36.645861 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:36.647292 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 250737us
I20260709 13:16:36.649830 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.701373 10108 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.701467 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.702692 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.656387 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1076) took 1031 ms. Trace:
I20260709 13:16:36.447170 11854 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.343619 11883 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.662142 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.667371 10188 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [1.3-4.4]
I20260709 13:16:36.630650 11735 raft_consensus.cc:2764] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:36.640473 11977 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:36.671500 11783 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.688766 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:36.604545 11812 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:36.606418 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2304) took 1025 ms. Trace:
I20260709 13:16:36.719213 10112 rpcz_store.cc:276] 0709 13:16:35.581312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.537670 (+956358us) service_pool.cc:224] Handling call
0709 13:16:36.537995 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.606141 (+ 68146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.606365 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.668737 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:36.720633 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51977.4us
I20260709 13:16:36.722811 10107 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:36.686650 11815 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:36.671238 11544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.040s	sys 0.070s
I20260709 13:16:36.682566 11568 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.704203 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.703893 10115 rpcz_store.cc:276] 0709 13:16:35.625115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.593466 (+968351us) service_pool.cc:224] Handling call
0709 13:16:36.593753 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.656098 (+ 62345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.656321 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.639411  9934 rpcz_store.cc:276] 0709 13:16:28.234911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.240120 (+  5209us) service_pool.cc:224] Handling call
0709 13:16:36.500574 (+8260454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:31.940834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:31.941463 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:31.941498 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:31.941520 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:31.941945 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:31.942034 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:31.942063 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:31.942421 (+   358us) tablet.cc:701] Row locks acquired
0709 13:16:31.942440 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:31.942596 (+   156us) write_op.cc:270] Start()
0709 13:16:31.942711 (+   115us) write_op.cc:276] Timestamp: P: 1783602991942549 usec, L: 0
0709 13:16:31.942733 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:31.943465 (+   732us) log.cc:844] Serialized 925 byte log entry
0709 13:16:32.313669 (+370204us) op_driver.cc:464] REPLICATION: finished
0709 13:16:32.491301 (+177632us) write_op.cc:301] APPLY: starting
0709 13:16:32.491411 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:32.491525 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:32.500564 (+  9039us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:32.572786 (+ 72222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:32.593360 (+ 20574us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:32.599270 (+  5910us) write_op.cc:312] APPLY: finished
0709 13:16:32.647916 (+ 48646us) log.cc:844] Serialized 29 byte log entry
0709 13:16:32.656650 (+  8734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:32.656750 (+   100us) write_op.cc:454] Released schema lock
0709 13:16:32.656794 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:32.665355 (+  8561us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:32.665390 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2440258,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":177367,"apply.run_cpu_time_us":3121,"apply.run_wall_time_us":170908,"num_ops":2,"prepare.queue_time_us":136132,"prepare.run_cpu_time_us":9694,"prepare.run_wall_time_us":124606,"raft.queue_time_us":11474,"raft.run_cpu_time_us":32671,"raft.run_wall_time_us":151089,"replication_time_us":370777,"thread_start_us":334727,"threads_started":4,"wal-append.queue_time_us":122347,"wal-append.run_cpu_time_us":22966,"wal-append.run_wall_time_us":1641156}]]}
I20260709 13:16:36.698832 11933 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.705941 11989 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.706753 11820 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:36.690382 11742 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:16:36.706877 11588 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.708820 10153 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
W20260709 13:16:36.709638 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63891.7us
I20260709 13:16:36.675468 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1072) took 1051 ms. Trace:
I20260709 13:16:36.713555 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.707276 11824 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.748164 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.691694 11874 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:36.689976 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2292) took 1317 ms. Trace:
I20260709 13:16:36.710448 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:36.684744 11871 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.727721 10186 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:36.730212 10185 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:16:36.732800 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70734.8us
I20260709 13:16:36.765841 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:36.766638 11946 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.002s
I20260709 13:16:36.711414 11942 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.768695 11931 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.707449 11934 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.677642 11878 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.769795 11878 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.732064 11812 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.737346 11568 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:36.738233 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47099.6us
I20260709 13:16:36.787561 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:36.715797 11911 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.712283 11935 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.716789 10710 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.744038 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.742825 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:36.793066 10112 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:36.737630 11815 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.770974 10184 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:36.759752 11793 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.668460 11495 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:36.735073 11783 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.717499 11977 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:36.682701 11982 consensus_queue.cc:1175] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:36.761255 11961 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.764597 11874 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.736654 11936 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:36.735087 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.792232 11544 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:36.781046 10108 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:36.814054 10108 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.743848 11985 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.742977 11588 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:36.746361 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:36.791705 11911 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:36.758257 10109 rpcz_store.cc:276] 0709 13:16:35.372411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.347669 (+975258us) service_pool.cc:224] Handling call
0709 13:16:36.348067 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.664886 (+316819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.688457 (+ 23571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.742457 11933 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.792207 11983 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.803895 11568 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.809456 11815 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:36.745433 10106 rpcz_store.cc:276] 0709 13:16:35.624191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.583032 (+958841us) service_pool.cc:224] Handling call
0709 13:16:36.583315 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.653773 (+ 70458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.673548 (+ 19775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.800109 11783 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.811123 11874 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:36.851047 10108 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:36.794265 11968 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
W20260709 13:16:36.843016 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 96740.4us
I20260709 13:16:36.837155 11588 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.841599 11911 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.843562 11942 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:36.883497 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.837303 11936 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:36.893283 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44144.4us
I20260709 13:16:36.804224 11495 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.894116 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:36.850797 11783 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.911337 10109 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:36.913331 11989 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:36.852572 11815 raft_consensus.cc:2764] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:36.914070 11793 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.916023 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.916254 11957 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.918462 11933 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:36.920104 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:36.844018 11871 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:36.929857 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:36.930274 11798 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.849143 11962 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.927103 11568 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.804118 11945 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 13:16:36.930397 11946 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.853536 11874 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.942592 11934 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.957762 11826 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.945438 11961 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:16:36.974613 11944 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.966918 10180 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
W20260709 13:16:37.023555 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 100544us
I20260709 13:16:36.951650 11957 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:36.837105 11985 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.026154 11933 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.850159 11983 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.026417 11798 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.995536 11934 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:36.969554 11962 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.012477 11826 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.031682 11824 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.049491 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.038038 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.091003 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.038046 11933 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.047385 11977 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.082172 11826 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.107041 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.041980 11798 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.089690 11985 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.100042 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.088047 10185 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:16:37.102730 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53327.2us
I20260709 13:16:37.105451 10186 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:37.024122 11936 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.110769 10185 pending_rounds.cc:85] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 2
I20260709 13:16:37.111966 10185 pending_rounds.cc:107] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:37.112254 10185 raft_consensus.cc:2889] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.106196 10180 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:37.113574 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 365465us
W20260709 13:16:37.109604 12006 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:16:37.129477 10715 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:37.135129 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.130122 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.135923 10186 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:37.101939 11911 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.129354 10180 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:37.133143 11495 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.132987 11828 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.149046 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 358201us
I20260709 13:16:37.129361 11826 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:37.147401 10113 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.026s
W20260709 13:16:37.160985 10113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.006s	sys 0.026s
W20260709 13:16:37.152410 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 408423us
I20260709 13:16:37.163136 10153 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:37.178342 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.178830 11911 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.184196 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.186983 11588 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.188221 10189 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.189275 11588 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.150997 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.190340 10109 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:37.191975 10109 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:37.200275 11957 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.201632 11935 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:37.202225 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.202946 10181 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:37.174091 11934 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.211023 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:37.175784 11983 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.180886 11826 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:37.199052 11812 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.153038 11828 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.211524 11961 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.215936 11883 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.212944 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.246415 11588 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:37.266680 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53817.5us
I20260709 13:16:37.215983 11824 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.266506 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.270104 10181 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:37.267729 10153 leader_election.cc:400] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:37.246800 11544 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:37.272128 10153 leader_election.cc:403] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:37.276883 12016 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:16:37.277314 11812 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.274533 11983 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.278290 11983 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.278504 11783 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.280707 11983 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.282541 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.267119 11588 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:37.284132 11588 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.284348 11961 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:37.261885 10109 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:37.287698 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.292963 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:37.268215 11883 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:37.299582 10107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.019s	sys 0.011s
W20260709 13:16:37.300009 10107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.020s	sys 0.011s
I20260709 13:16:37.249547 11874 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.291986 11812 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 2. Current term is 3.
I20260709 13:16:37.202639 11935 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.216212 11911 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.295967 11945 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.297060 11826 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.297851 11957 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:37.267614 11962 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.298161 10109 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:37.297024 11961 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:37.293612 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.266652 11568 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:37.271458 11950 consensus_meta.cc:287] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.004s
I20260709 13:16:37.217144 10180 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.302871 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:37.329968 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.303222 11878 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:16:37.301473 11883 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.342051 11783 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:37.343014 10715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 342) took 2204 ms (client timeout 2186 ms). Trace:
I20260709 13:16:37.275179 11824 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.344061 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 208) took 1020 ms. Trace:
I20260709 13:16:37.344472 10036 rpcz_store.cc:276] 0709 13:16:36.324168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.591477 (+267309us) service_pool.cc:224] Handling call
0709 13:16:36.591812 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.593617 (+  1805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.593647 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.604453 (+ 10806us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.972280 (+367827us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.972321 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.972663 (+   342us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.343838 (+371175us) raft_consensus.cc:1685] finished
0709 13:16:37.343861 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.344002 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2658,"spinlock_wait_cycles":6400,"thread_start_us":367475,"threads_started":1,"wal-append.queue_time_us":657836}
W20260709 13:16:37.343410 10715 rpcz_store.cc:269] 0709 13:16:35.138683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.149165 (+ 10482us) service_pool.cc:224] Handling call
0709 13:16:37.342778 (+2193613us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54005f0354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:37.342896 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4466530048}
I20260709 13:16:37.348337 10181 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:37.301664 11933 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:37.350523 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56976.5us
I20260709 13:16:37.354868 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 6.
I20260709 13:16:37.355907 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.349097 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1084) took 1343 ms. Trace:
I20260709 13:16:37.324119 11957 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.359112 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1083) took 1353 ms. Trace:
I20260709 13:16:37.359730 10114 rpcz_store.cc:276] 0709 13:16:36.005447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.637487 (+632040us) service_pool.cc:224] Handling call
0709 13:16:36.637727 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.637910 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:37.033434 (+395524us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.358765 (+325331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.358824 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:37.358865 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.358932 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.359054 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21300,"prepare.queue_time_us":442004,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":16981,"thread_start_us":673763,"threads_started":2}
W20260709 13:16:37.340060 10707 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.001s
I20260709 13:16:37.365000 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.368676 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.339643 11934 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.344090 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:37.406371 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.359047 11945 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.351027 11798 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.356936 10110 rpcz_store.cc:276] 0709 13:16:36.005715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.638677 (+632962us) service_pool.cc:224] Handling call
0709 13:16:36.639031 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.643709 (+  4678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.644021 (+   312us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.644551 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.969670 (+325119us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:37.348576 (+378906us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.348803 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.348876 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.348912 (+    36us) raft_consensus.cc:1685] finished
0709 13:16:37.348923 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.349040 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4272,"prepare.queue_time_us":141442,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":6600,"raft.queue_time_us":5122,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11741,"thread_start_us":703321,"threads_started":2,"wal-append.queue_time_us":499063}
I20260709 13:16:37.404452 11815 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.362634 11495 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.362381 11812 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.334009 11911 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.396215 11568 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.394790 11823 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.363309 11957 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.337667 12019 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:16:37.366521 12022 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.430614 12016 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:37.406296 10180 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.428622 10184 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.368630 10707 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
W20260709 13:16:37.436810 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 286425us
I20260709 13:16:37.461841 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.404537 11820 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:37.412262 10114 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.459029 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 258) took 1741 ms. Trace:
W20260709 13:16:37.439841 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 300691us
I20260709 13:16:37.427954 10712 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:37.432555 12012 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.341s	user 0.000s	sys 0.003s
I20260709 13:16:37.466392 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.466430 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:37.483613 10114 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.439706 11945 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:37.438989 11971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.021s	sys 0.030s
I20260709 13:16:37.410048 11934 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.459133 11568 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:37.484443 10031 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.000s
I20260709 13:16:37.435824 11937 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:37.436631 11812 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:37.558754 11934 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.565927 11812 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:37.393817 11544 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.569051 10115 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:16:37.532733 11971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.021s	sys 0.030s
I20260709 13:16:37.538872 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.543251 11783 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.558702 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 265) took 1446 ms. Trace:
I20260709 13:16:37.534905 11945 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:37.560356 11568 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.433821 11495 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.484340 10109 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:37.577163 10114 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:37.582127 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 261) took 1505 ms. Trace:
I20260709 13:16:37.595952 10112 rpcz_store.cc:276] 0709 13:16:36.076894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.793780 (+716886us) service_pool.cc:224] Handling call
0709 13:16:36.794098 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.826726 (+ 32628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.826759 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.826801 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:36.826830 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.581846 (+755016us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5400403654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:37.581901 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.582055 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74584960}
I20260709 13:16:37.460114 12022 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:37.551286 11588 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:37.595342 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 189023us
I20260709 13:16:37.570962 10031 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:37.610270 10110 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:37.613121 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:37.616705 10110 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:37.619364 10715 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:37.581741 11874 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.589121 11945 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.625908 10715 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:37.627044 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.628594 10110 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:37.630963 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:37.631844 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:16:37.631821 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54695.6us
I20260709 13:16:37.619782 11820 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:16:37.637162 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.567s (SENT) [suppressed 41 similar messages]
I20260709 13:16:37.638450 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.587513 11783 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.615957 11823 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:37.640148 11936 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.644622 12034 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:37.618072 11812 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:37.632862 12039 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.653888 12039 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.658792 11912 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:37.666704 12009 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.042s	user 0.003s	sys 0.003s
I20260709 13:16:37.659202 11911 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.651768 11936 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:37.673591 12029 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:37.665840 12039 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.681200 12022 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:37.681869 12042 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.130s	user 0.000s	sys 0.003s
W20260709 13:16:37.622241 10031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2139) took 1525 ms (client timeout 1567 ms). Trace:
W20260709 13:16:37.726177 10031 rpcz_store.cc:269] 0709 13:16:36.096718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.104103 (+  7385us) service_pool.cc:224] Handling call
0709 13:16:36.448945 (+344842us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:37.620365 (+1171420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11908480}
I20260709 13:16:37.641644 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:37.728857 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2142) took 1630 ms. Trace:
I20260709 13:16:37.730548 10110 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:37.582974 10106 rpcz_store.cc:276] 0709 13:16:36.112044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.892796 (+780752us) service_pool.cc:224] Handling call
0709 13:16:36.912108 (+ 19312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.916652 (+  4544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.916693 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.917266 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.274099 (+356833us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.291846 (+ 17747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.301347 (+  9501us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.558484 (+257137us) raft_consensus.cc:1685] finished
0709 13:16:37.558505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.558640 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4129,"raft.queue_time_us":5424,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":347336,"threads_started":1,"wal-append.queue_time_us":514933}
I20260709 13:16:37.732774 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:37.734793 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.733254 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.735877 10110 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:37.734688 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1088) took 1645 ms. Trace:
W20260709 13:16:37.740029 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 102761us
I20260709 13:16:37.741092 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1074) took 2116 ms. Trace:
I20260709 13:16:37.737001 10109 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:37.744683 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.745126 10180 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:37.741605 10111 rpcz_store.cc:276] 0709 13:16:35.624653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.588310 (+963657us) service_pool.cc:224] Handling call
0709 13:16:36.588615 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.037278 (+448663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.037323 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.037366 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:37.037394 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.740513 (+703119us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540026c5d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:37.740580 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.740851 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1836,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6260,"spinlock_wait_cycles":1031046400}
I20260709 13:16:37.765569 11812 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:37.763094 10707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 404) took 1590 ms (client timeout 1987 ms). Trace:
W20260709 13:16:37.766542 10707 rpcz_store.cc:269] 0709 13:16:36.172352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.177631 (+  5279us) service_pool.cc:224] Handling call
0709 13:16:37.762618 (+1584987us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54006ad6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:37.762883 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305801600}
I20260709 13:16:37.761765 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:37.762470 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 353) took 1071 ms. Trace:
I20260709 13:16:37.769647 10712 rpcz_store.cc:276] 0709 13:16:36.690805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.692484 (+  1679us) service_pool.cc:224] Handling call
0709 13:16:37.351468 (+658984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.514392 (+162924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.762017 (+247625us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54005f0350. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:37.762247 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475624320}
I20260709 13:16:37.770833 11823 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:37.774758 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 308309us
I20260709 13:16:37.763450 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:37.777760 11874 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.778970 11874 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:37.779919 11871 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:16:37.779506 11883 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.781396 11878 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.779497 11854 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.667537 11912 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:37.782841 11883 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.784173 11912 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.788825 11936 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.747366 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.755870 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:37.756824 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 266) took 1159 ms. Trace:
I20260709 13:16:37.745034 10153 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.737900 10110 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:37.761699 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 332) took 1036 ms. Trace:
I20260709 13:16:37.762470 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:37.763388 11588 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.764824 11735 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.736974 10108 rpcz_store.cc:276] 0709 13:16:36.088828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.815703 (+726875us) service_pool.cc:224] Handling call
0709 13:16:36.816178 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.851447 (+ 35269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.734034 (+882587us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b540026d4d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:37.734429 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79371008}
I20260709 13:16:37.729539 10040 rpcz_store.cc:276] 0709 13:16:36.098054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.098220 (+   166us) service_pool.cc:224] Handling call
0709 13:16:36.370691 (+272471us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:36.370920 (+   229us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:36.371328 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.371356 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.372017 (+   661us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.851154 (+479137us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:37.369759 (+518605us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.405349 (+ 35590us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b2400190fe8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c2819c4 00007f3c6c27facb 00007f3c6c43adc9 00007f3c6c43aa55 00007f3c6c43a09d 00007f3c6f06c10e 00007f3c6f08388c 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221
0709 13:16:37.409379 (+  4030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.409459 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.728086 (+318627us) raft_consensus.cc:1685] finished
0709 13:16:37.728136 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.728602 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39330,"prepare.queue_time_us":326528,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":121,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":35966720,"thread_start_us":911118,"threads_started":2,"wal-append.queue_time_us":656933}
I20260709 13:16:37.766599 11812 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.784643 11911 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.802373 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 331) took 1077 ms. Trace:
I20260709 13:16:37.779518 11874 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:37.803467 10112 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:37.803977 11874 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.793881 10189 rpcz_store.cc:276] 0709 13:16:36.725413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.729148 (+  3735us) service_pool.cc:224] Handling call
0709 13:16:36.729413 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.188655 (+459242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.761174 (+572519us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54002d9bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:37.761513 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054716160}
I20260709 13:16:37.748533 10109 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:37.779513 11828 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.770674 11742 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.748142 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 259) took 1671 ms. Trace:
W20260709 13:16:37.807171 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.777760 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:37.793475 10115 rpcz_store.cc:276] 0709 13:16:36.597660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.097584 (+499924us) service_pool.cc:224] Handling call
0709 13:16:37.097951 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.570827 (+472876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.756157 (+185330us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000b5c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:37.756592 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082632448}
I20260709 13:16:37.801676 11912 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:37.833976 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 188301us
I20260709 13:16:37.782212 11878 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.838141 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.806341 11812 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.802423 11911 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.839622 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:37.840492 10710 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:37.843116 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.843341 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.844172 10185 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
W20260709 13:16:37.845225 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 383289us
I20260709 13:16:37.846393 11798 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:37.846987 11798 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.847445 11798 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.848996 12039 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.836282 10181 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:37.802877 10183 rpcz_store.cc:276] 0709 13:16:36.725156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.733764 (+  8608us) service_pool.cc:224] Handling call
0709 13:16:37.755318 (+1021554us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:37.802268 (+ 46950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9032576}
I20260709 13:16:37.851399 12039 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.852218 11934 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.852998 11871 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:37.853653 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 109083us
I20260709 13:16:37.851420 11911 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:37.838353 11878 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.883385 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.883723 11911 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:37.845678 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.860404 11944 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:37.464776 10113 rpcz_store.cc:276] 0709 13:16:35.718072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.622158 (+904086us) service_pool.cc:224] Handling call
0709 13:16:36.622486 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.622677 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:37.161415 (+538738us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.458606 (+297191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.458663 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.458709 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.458806 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.458962 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415905,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2123,"raft.queue_time_us":21377,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2133,"thread_start_us":813849,"threads_started":2}
I20260709 13:16:37.862874 11742 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.767225 11495 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.878844 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1263) took 1488 ms. Trace:
I20260709 13:16:37.802729 11735 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.819352 10107 rpcz_store.cc:276] 0709 13:16:36.076364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.724447 (+648083us) service_pool.cc:224] Handling call
0709 13:16:36.724701 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.771449 (+ 46748us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:37.300394 (+528945us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.540172 (+239778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.540231 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.540276 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.747576 (+207300us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b54000b27d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:37.747659 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.747954 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":335151,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":83,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":3772,"spinlock_wait_cycles":106964352,"thread_start_us":749621,"threads_started":2,"wal-append.queue_time_us":345469}
I20260709 13:16:37.881103 11812 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:37.888556 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.892043 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.892977 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:37.894439 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 116934us
I20260709 13:16:37.895277 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:37.896109 11799 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.896476 11961 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:37.897372 11878 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:37.898069 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:37.898442 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52920.3us
I20260709 13:16:37.900357 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:37.901065 11934 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:37.901532 12040 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.899264 12037 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:16:37.870913 11798 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.901767 11933 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.900991 11544 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:37.918423 10183 raft_consensus.cc:2410] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:37.919900 11798 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.921993 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:37.909409 11944 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.925662 11798 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.894629 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.928138 10181 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.929219 10033 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:37.924789 10184 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:37.931167 10113 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:37.932500 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.933137 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.934008 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:37.934152 11798 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:37.934609 11798 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.934952 11798 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.935563 11961 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.935828 11933 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.936301 11933 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.916337 10040 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
W20260709 13:16:37.928138 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.946192 12037 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:37.946439 10712 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:37.946805 11735 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:37.946959 10712 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:37.948174 11934 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.949360 11742 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.902494 10038 rpcz_store.cc:276] 0709 13:16:36.389974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.631141 (+241167us) service_pool.cc:224] Handling call
0709 13:16:36.631479 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.631680 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:37.034752 (+403072us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.366463 (+331711us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.772618 (+406155us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b1800087760. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:16:37.871598 (+ 98980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.878115 (+  6517us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:37.878271 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.878399 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.878611 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410410,"prepare.queue_time_us":545850,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":2675,"raft.queue_time_us":462950,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":25355,"spinlock_wait_cycles":44307712,"thread_start_us":687804,"threads_started":2,"wal-append.queue_time_us":430996}
I20260709 13:16:37.896121 11971 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:16:37.948177 10712 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.947598 11799 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:37.954145 10712 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.954725 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.956229 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:37.956845 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:37.957635 10716 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:37.940157 11961 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:37.959254 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.957170 11911 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:37.959827 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.957516 11871 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:16:37.961759 11911 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.962230 11911 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.962594 11911 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.964915 10081 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:37.972249 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.972738 11783 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:37.974223 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.974388 11798 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:37.975768 11957 consensus_meta.cc:287] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.009s
I20260709 13:16:37.960500 10039 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:37.959385 11961 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:37.946736 12037 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:37.950898 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:37.978003 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:37.980420 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49985.2us
I20260709 13:16:37.985577 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:37.980000 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59356.7us
I20260709 13:16:37.977900 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:37.980294 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:37.995543 10181 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:37.979209 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:37.979413 11735 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.001950 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.002244 10039 raft_consensus.cc:2410] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:37.982488 12037 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.002902 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.980806 11961 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.002816 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.984223 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.012259 11818 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:37.981163 11544 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:38.004205 11735 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.022703 12066 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.018651 10716 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:38.018491 11798 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.023428 11799 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.016089 11936 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.022475 10037 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
W20260709 13:16:38.025010 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47560.5us
I20260709 13:16:38.021370 11544 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:38.023027 11735 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.029601 12037 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.029753 10033 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:38.031709 11544 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.033437 11544 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.034972 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.036975 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.038028 12039 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:38.038671 10712 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:16:38.039126 10712 pending_rounds.cc:85] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 5
I20260709 13:16:38.039914 12039 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:38.024083 12066 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.041380 11798 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.042994 11798 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.043344 11798 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.044695 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.038682 11936 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:38.032133 12021 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.047027 12021 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:38.047401 11854 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:38.047938 10038 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:16:38.048062 11854 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:38.049566 11854 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.049924 11783 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:38.038080 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:38.053206 11939 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:38.053593 11939 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.053941 11939 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.054240 11823 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.054644 11823 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.055042 11823 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.980234 12040 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:16:38.057235 11818 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.043677 11798 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.058524 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:37.977116 11957 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.060221 10715 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:38.055651 12021 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.060948 11957 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.061671 12021 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.061044 12066 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.063513 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.064455 10033 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:38.065659 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.066309 10039 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.054569 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:38.051358 11783 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:38.039410 10712 pending_rounds.cc:107] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:16:38.059585 11818 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.085806 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.085381 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.086627 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.083155 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.103479 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.102816 10040 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.104068 10181 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
W20260709 13:16:38.104672 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 125649us
I20260709 13:16:38.092130 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:38.118489 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81613.7us
I20260709 13:16:38.087235 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:38.077811 12039 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.085243 11983 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:38.085068 11824 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:38.131120 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 150956us
I20260709 13:16:38.108312 10712 raft_consensus.cc:2889] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.082511 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.083822 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.140228 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.123934 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.083329 10184 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:38.145241 10186 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.125689 10111 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:38.149070 12027 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:38.127933 11588 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.146927 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.140779 10037 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:38.132807 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:38.079939 11878 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:16:38.154559 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.081913 11971 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:16:38.158752 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 88258.4us
I20260709 13:16:38.085961 11973 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:16:38.087664 12019 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:16:38.166244 11937 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:38.152217 11588 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:38.152474 12039 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:38.123692  9935 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:38.169530 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82400us
I20260709 13:16:38.161044 11938 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:38.205029 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:38.205364 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.170728 10185 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.155097 11934 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:38.164333 10183 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
W20260709 13:16:38.215987 11945 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.529s	user 0.015s	sys 0.000s
W20260709 13:16:38.216486 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 83772.2us
I20260709 13:16:38.225664 10153 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:38.216965 11946 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:38.217310 11812 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.217762 12072 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:38.218595 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:16:38.219458 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59939.2us
I20260709 13:16:38.198305 11942 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.170810 11936 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.157090 11944 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.226969 11945 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.227761 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.170789 12040 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:16:38.216843 10109 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.220147 10111 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:38.208817 11799 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.249974 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:38.256342 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 91148.1us
I20260709 13:16:38.258582 10707 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.261988 10185 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:38.231145 11812 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:38.264732 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 122579us
I20260709 13:16:38.249657 11912 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.272432 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.272552 10709 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:38.250638 11936 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.233145 11735 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.252938 11742 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.256863 11968 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:38.271880 10004 connection.cc:256] RPC call timeout handler was delayed by -1.0638735229999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:16:38.225718 11937 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.304507 11588 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.305577 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:38.306170 11588 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.306934 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.309300 12066 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.229907 11938 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.277633 12072 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.313200 12054 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:38.313768 11799 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:38.315424 11799 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.315826 11799 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.316143 11799 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.282672 11942 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.319095 11942 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.319562 11735 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.320269 11742 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.267506 11934 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:38.320781 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69809.2us
I20260709 13:16:38.322418 11934 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.278935 11912 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.323194 11912 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.269860 12032 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:38.287988 12059 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:38.291985 11972 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:16:38.294174 12073 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:38.294369 10710 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:38.294661 12039 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.269734 11812 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.280982 11936 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.292024 10035 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:38.311537 12066 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.323678 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:38.324545 10111 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:38.376361 10040 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:38.379226 10707 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.291942 10184 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.321033 11742 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:38.391324 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 67719.4us
I20260709 13:16:38.313661 12072 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.379881 10039 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:38.327809 11945 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.333102 11944 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.313679 11938 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.305518 11937 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:38.411091 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 143369us
I20260709 13:16:38.361950 11824 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.421221 11824 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:38.415930 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.281510 11911 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.424943 11495 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.425709 11495 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.426205 11911 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.286903 11968 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:38.426929 12077 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:38.393148 11961 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:38.427567 11968 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.323920 11957 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:16:38.428467 11961 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.427587 12077 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.430692 11961 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.431037 12077 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.416152 12032 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:38.432178 11824 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.323536 11933 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.423918 11818 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.432941 11818 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.433336 11818 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.436515 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.436851 11544 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:38.419219 11871 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.444962 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.409181 11742 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.302846 11798 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.449542 10186 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:38.452576 10181 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:38.437407 10109 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:38.327198 11939 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.459873 10113 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:38.460743 10108 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:38.460891 10037 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:38.456529 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.462307 10039 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:16:38.463915 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 191566us
I20260709 13:16:38.464718 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.433485 12032 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.474735 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.476317 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:38.477360 10715 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.443782 11735 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:38.462757 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:38.479579 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.481323 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.484045 11823 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:38.487890 11933 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.488338 11935 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:38.489014 11798 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.490697 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:38.428495 10033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:38.455689 11912 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.454398 11871 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.437495 11544 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:38.495267 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86000.3us
I20260709 13:16:38.495675 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.527483 10186 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.491518 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.451930 11742 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.530930 10108 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 2: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:38.492672 11939 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:38.509832 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47143.7us
I20260709 13:16:38.493525 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.516225 12079 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.516650 12071 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.518327 10109 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:38.518465 11823 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:38.519066 11982 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:38.516276 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.520793 10114 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:38.522240 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 215407us
I20260709 13:16:38.523911 12075 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.494108 11495 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.535950 10033 raft_consensus.cc:606] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.536363 12083 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.544965 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.551014 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:38.552656 10186 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:38.554517 10182 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:38.555568 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.557979 11871 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.558876 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.526463 12059 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:38.562142 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.556377 10184 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:38.539613 11798 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.510607 11735 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.570835 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:38.603081 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52145.9us
I20260709 13:16:38.571488 10181 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:38.603624 10185 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:38.580904 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.584223 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.588418 10715 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
W20260709 13:16:38.598399 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53544.6us
I20260709 13:16:38.595984 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:38.599442 11982 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:38.535866 11935 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.612557 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.613967 10180 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:16:38.614643 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.615415 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.634804 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.635305 10707 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:38.617022 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:38.616819 12059 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.617421 11798 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.618019 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.618417 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.605414 11871 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.605026 10031 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:38.638972 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.618974 12083 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.619453 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.660051 10712 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:38.619958 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.661772 12031 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:38.662035 11799 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.620359 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.596678 12075 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.639277 11983 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.664726 11854 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:38.665141 12081 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:38.665771 12075 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.603137 11495 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.666519 11495 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.666886 11495 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:38.668081 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51151.8us
I20260709 13:16:38.669943 11939 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.621433 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.622020 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.622323 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:38.624326 11735 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.627080 10180 pending_rounds.cc:85] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 4
I20260709 13:16:38.627024 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.673522 10181 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:38.600267 12071 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.585918 12079 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:38.643627 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.644285 10182 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.639060 11871 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.644886 11818 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.646448 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.644316 11982 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.648559 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.655221 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:38.655956 11588 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.656512 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:38.708613 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 52174.9us
I20260709 13:16:38.699723 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.710240 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.657058 11934 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:38.672705 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.710733 11999 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.713240 12075 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:38.662626 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:38.714321 10106 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:38.714613 11935 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.715197 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:38.715692 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.696820 10180 pending_rounds.cc:107] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:16:38.716657 10180 raft_consensus.cc:2889] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.662729 12031 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.716764 11588 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.717074 12031 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:38.718099 12031 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.718533 11495 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.718909 11588 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.719275 12031 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.707623 10113 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.713361 11818 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.715859 10106 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.703351 11871 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.716275 10036 raft_consensus.cc:2376] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5. Re-sending same reply.
I20260709 13:16:38.722698 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.710758 10033 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:38.722015 11934 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.711588 10185 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:38.724934 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.725589 10033 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:38.725958 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.726420 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.727041 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:38.728569 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55991.6us
I20260709 13:16:38.644538 10183 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:38.731473 12083 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.732074 11934 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.732589  9938 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 182) took 9479 ms. Trace:
I20260709 13:16:38.729596 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.723935 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.729382 12075 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:38.734089 12075 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:38.734710 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.735069 10109 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:38.734491 12075 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.664810 11983 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:38.670789 11957 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:38.737812 11983 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.727571 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.738250 12080 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.740046 11799 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.629225 10114 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:38.675025 10186 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.737882 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.732399 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.642025 11783 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.747438 10113 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:38.717052 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.748482 10039 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:38.725268 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.736306 12071 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.729610  9935 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 2, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.740100 10036 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:38.752938 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.754050 10033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:38.754659 10033 raft_consensus.cc:606] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:38.756342 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 101228us
I20260709 13:16:38.757337 10037 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:38.759407 10113 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.757848 10114 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:38.760743 10182 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:38.764542 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.748291 11735 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.765854 12080 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.765646 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.767927 11799 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:38.768322 11799 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.768667 11799 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.769893 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:38.772957 10113 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:38.766571 11742 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.774085 11783 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:38.766731 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.774214 10185 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:38.775030 11783 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.766516 12080 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.767695 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.760921 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:38.732076 12083 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:38.780804 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.720402 11544 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.788625 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:38.789367 10113 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:38.721753 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.792873 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.734553 11812 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.783515 12081 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:38.789161 12083 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.790835 10182 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:38.775197 11742 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:38.803234 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:38.787678 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.765974 11735 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.806039 11798 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.798554 11824 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:38.806912 11495 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:38.763085 12071 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:38.792241 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:38.784255 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.807705 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.814584 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.870384 10034 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.870577 10180 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:38.805039 10710 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:38.733762 12079 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:38.815683 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.884758 10185 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:38.810525 10037 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:38.800026  9935 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 4, now has a pending config: VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193), VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194), VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195), VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:38.879122 10106 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
W20260709 13:16:38.808158 12090 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:16:38.798404 10031 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
W20260709 13:16:38.927587 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.911558 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.802337 11823 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:16:38.920840 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:38.812542 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.952507 10106 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.808671 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.815971 12022 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.835054 12083 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.812852 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:38.927368 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:38.972934 10716 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.814072 11812 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:38.965355 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.966135 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:38.836647 12081 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:38.969996 10040 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:38.978158 10037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:38.983064 10186 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:38.912397 11874 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:38.994500 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.995065 10180 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.984313 10037 raft_consensus.cc:606] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:38.806357 11871 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:38.817071 11588 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:16:38.988672 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:38.989724 10036 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:38.997339 10182 raft_consensus.cc:2368] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:38.993939 10109 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:38.884662 11957 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:16:39.063417 10186 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:39.063163 10182 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:38.732946  9938 rpcz_store.cc:276] 0709 13:16:29.241468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.260242 (+ 18774us) service_pool.cc:224] Handling call
0709 13:16:38.721157 (+9460915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:37.274854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:37.409372 (+134518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:37.428244 (+ 18872us) write_op.cc:435] Acquired schema lock
0709 13:16:37.430390 (+  2146us) tablet.cc:662] Decoding operations
0709 13:16:37.540593 (+110203us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:37.540656 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:37.540684 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:37.541239 (+   555us) tablet.cc:701] Row locks acquired
0709 13:16:37.541260 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:37.541420 (+   160us) write_op.cc:270] Start()
0709 13:16:37.541543 (+   123us) write_op.cc:276] Timestamp: P: 1783602997541376 usec, L: 0
0709 13:16:37.541567 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:37.542261 (+   694us) log.cc:844] Serialized 2132 byte log entry
0709 13:16:37.985199 (+442938us) op_driver.cc:464] REPLICATION: finished
0709 13:16:38.006759 (+ 21560us) write_op.cc:301] APPLY: starting
0709 13:16:38.006934 (+   175us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:38.007246 (+   312us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:38.007449 (+   203us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:38.029827 (+ 22378us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:38.030115 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:16:38.030169 (+    54us) write_op.cc:312] APPLY: finished
0709 13:16:38.030568 (+   399us) log.cc:844] Serialized 47 byte log entry
0709 13:16:38.030778 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:38.030950 (+   172us) write_op.cc:454] Released schema lock
0709 13:16:38.031025 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:38.031565 (+   540us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:38.031598 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3596071,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":21132,"apply.run_cpu_time_us":3851,"apply.run_wall_time_us":24799,"num_ops":5,"prepare.queue_time_us":536116,"prepare.run_cpu_time_us":44811,"prepare.run_wall_time_us":386319,"raft.queue_time_us":299434,"raft.run_cpu_time_us":1934,"raft.run_wall_time_us":22761,"replication_time_us":443363,"thread_start_us":639575,"threads_started":4,"wal-append.queue_time_us":125579}]]}
I20260709 13:16:39.077354 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:39.078060 10037 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.994107 11742 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.993834 11568 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:39.042536 11812 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.153257 12104 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:16:39.154361 12099 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:39.032917 10184 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:39.033278 10183 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
W20260709 13:16:39.155252 12096 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:16:39.006987 12022 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:39.008379 12066 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.190217 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:38.952211 12071 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.143266 10106 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:39.087061 11934 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.212361 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:39.235463 10182 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:39.215384 10183 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:39.208154 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2330) took 1129 ms. Trace:
I20260709 13:16:39.225435 10036 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.041209 11874 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:39.214511 12105 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:16:39.104838 11933 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:16:39.194418 12080 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.155321 12081 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.225214 12091 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.249610 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:39.255293 10182 raft_consensus.cc:2368] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:39.240170 12066 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.237545 10112 rpcz_store.cc:276] 0709 13:16:38.078780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.084966 (+  6186us) service_pool.cc:224] Handling call
0709 13:16:38.085385 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.120579 (+ 35194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.120614 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.149508 (+ 28894us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.363838 (+214330us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b48001224d8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:16:38.509115 (+145277us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:38.509156 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.509219 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.200352 (+691133us) raft_consensus.cc:1685] finished
0709 13:16:39.200379 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.208080 (+  7701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51943,"raft.queue_time_us":43631,"raft.run_cpu_time_us":1747,"raft.run_wall_time_us":226953,"spinlock_wait_cycles":9862016,"thread_start_us":359195,"threads_started":1,"wal-append.queue_time_us":475231}
W20260709 13:16:39.245597 12031 consensus_meta.cc:287] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:16:39.265519 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:39.251966 12075 consensus_meta.cc:287] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.006s
I20260709 13:16:39.200912 11812 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:39.279139 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.280102 11812 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:39.276579 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1103) took 1016 ms. Trace:
I20260709 13:16:39.285151 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:39.230737 11742 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.283190 10107 rpcz_store.cc:276] 0709 13:16:38.259804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.259998 (+   194us) service_pool.cc:224] Handling call
0709 13:16:38.260330 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.562666 (+302336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.562695 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.602471 (+ 39776us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.784721 (+182250us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:38.784754 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.784821 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.276335 (+491514us) raft_consensus.cc:1685] finished
0709 13:16:39.276359 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.276498 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39082,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":443265,"threads_started":2,"wal-append.queue_time_us":305661}
I20260709 13:16:39.258056 11871 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:39.299890 10182 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:39.290447 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:39.301194 10182 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:39.272918 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:39.250944 11799 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.274986 11798 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.285600 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:39.310879 10182 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:39.314256 10182 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:39.276993 12075 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:39.312685 11936 consensus_meta.cc:287] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.899s	user 0.011s	sys 0.000s
I20260709 13:16:39.327909 10037 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:39.289813 11934 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.314471 10712 raft_consensus.cc:2410] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:39.324455 10182 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:39.330204 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:39.333909 10184 raft_consensus.cc:2368] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:39.314240 10031 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:39.312877 11798 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.341640 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:39.350440 10037 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.345023 10182 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:39.352937 10034 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:39.354492 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:39.355888 12106 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:16:39.357461 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:39.358090 10038 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.360526 11798 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.365366 11954 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:39.372611 10180 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:39.319911 12022 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.329241 11936 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:39.371783 12108 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:16:39.356012 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:39.404526 10115 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:39.405889 10184 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:16:39.431223 10037 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:39.414958 11999 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:39.454401 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 167877us
I20260709 13:16:39.425304 11874 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.461881 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:39.463698 10181 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:39.453243 11999 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:39.464639 11888 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.015s	sys 0.015s
W20260709 13:16:39.464990 11888 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.015s	sys 0.016s
I20260709 13:16:39.471624 10716 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:39.440685 12071 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:39.478024 10036 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:39.482410 10036 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.469228 12066 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.456664 11742 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:39.499553 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.504186 11934 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:39.505198 12122 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:16:39.512486 12118 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:16:39.531481 11934 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.481993 12075 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.532234 11934 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.562551 10031 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:39.585644 11742 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:39.586666 12083 consensus_meta.cc:287] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
I20260709 13:16:39.586409 11742 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.587110 12083 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.547099 11999 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.594468 10038 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:39.600584 10034 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:39.604007 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1280) took 1153 ms. Trace:
I20260709 13:16:39.620983 10038 rpcz_store.cc:276] 0709 13:16:38.450630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.450761 (+   131us) service_pool.cc:224] Handling call
0709 13:16:39.357308 (+906547us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:39.603879 (+246571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6739328}
I20260709 13:16:39.654088 11999 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:39.658622 12083 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:39.659586 11936 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.659914 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:39.660557 10716 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.665705 12129 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:39.666038 11874 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:39.667166 12095 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:39.667634 12095 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:39.667675 12129 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:39.654104 11742 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:39.669582 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2173) took 1014 ms. Trace:
I20260709 13:16:39.669006 12095 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.671166 10716 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:39.672402 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:39.670552 12095 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.670753 10037 rpcz_store.cc:276] 0709 13:16:38.655079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.453491 (+798412us) service_pool.cc:224] Handling call
0709 13:16:39.453842 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.454745 (+   903us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:39.658301 (+203556us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.669243 (+ 10942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.669291 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:39.669336 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.669393 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.669509 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197957,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":86,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":187247,"threads_started":2}
I20260709 13:16:39.682548 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 596) took 1074 ms. Trace:
I20260709 13:16:39.683032 10709 rpcz_store.cc:276] 0709 13:16:38.608194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.614337 (+  6143us) service_pool.cc:224] Handling call
0709 13:16:39.682301 (+1067964us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54005f0354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:39.682476 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978309376}
I20260709 13:16:39.685281 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:39.686681 11933 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.687352 12129 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.688001 12129 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.689304 11735 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.690280 12129 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.676478 12083 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:39.692906 12083 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:39.693027 11874 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:39.700126 11568 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:39.700809 11568 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.709442 12066 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:39.709957 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2157) took 1149 ms. Trace:
I20260709 13:16:39.710069 12066 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.710443 10033 rpcz_store.cc:276] 0709 13:16:38.560155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.160672 (+600517us) service_pool.cc:224] Handling call
0709 13:16:39.206823 (+ 46151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.297507 (+ 90684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.300509 (+  3002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.312558 (+ 12049us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:39.313982 (+  1424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.709686 (+395704us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b54003bd8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:39.709748 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.709892 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125124992}
I20260709 13:16:39.712458 12066 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:39.713276 12129 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:39.714545 11874 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:39.715034 11874 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:39.716022 11874 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.718005 11874 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.719461 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:39.729439 12052 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:39.730017 12052 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:39.733369 11945 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:39.733516 11888 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:39.733963 11945 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:39.734691 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:39.714506 12111 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
I20260709 13:16:39.731040 12052 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.742005 12039 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:39.742564 12039 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:39.743405 12039 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.750339 11968 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.753966 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1266) took 1149 ms. Trace:
I20260709 13:16:39.757732 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:39.761724 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:39.760600 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:39.765138 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:39.767011 10036 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:39.734982 11945 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.771929 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:39.768658 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:39.775460 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:39.758868 11798 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.754455 10188 rpcz_store.cc:276] 0709 13:16:38.607669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.649524 (+ 41855us) service_pool.cc:224] Handling call
0709 13:16:38.729830 (+ 80306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.765618 (+ 35788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.765653 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.766116 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.871120 (+105004us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:38.871157 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.871219 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.713916 (+842697us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:39.751811 (+ 37895us) raft_consensus.cc:1685] finished
0709 13:16:39.751837 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.753652 (+  1815us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b5400100250. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:39.753779 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31676,"raft.queue_time_us":43499,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":194096896,"thread_start_us":104663,"threads_started":1,"wal-append.queue_time_us":464867}
I20260709 13:16:39.773561 12066 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:39.796536 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:39.797287 10038 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:39.778359 12071 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:39.801649 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2172) took 1146 ms. Trace:
I20260709 13:16:39.802089 11568 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.802953 11938 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:39.780862 12081 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:39.787137 11983 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.776909 11742 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:39.785034 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:39.792862 11945 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:39.857065 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50616us
I20260709 13:16:39.781302 12117 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:16:39.794785 12031 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:39.872813 11938 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:16:39.873558 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.802994 11912 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:39.876885 10038 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:39.803875 12123 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:16:39.879505 11568 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:39.771387 12083 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:39.882089 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.800050 11933 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:39.914489 10038 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:39.804911 12071 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.823588 12066 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:39.881922 12081 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:39.926024 12071 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.917387 10031 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
W20260709 13:16:39.946174 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.948856 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 162269us
I20260709 13:16:39.949577 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:39.950232 10038 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.883105 11983 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.958606 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:39.937655 12059 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:39.960084 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2164) took 1307 ms. Trace:
I20260709 13:16:39.961283 10038 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.936754 11912 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:39.963091 10034 rpcz_store.cc:276] 0709 13:16:38.652656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.384672 (+732016us) service_pool.cc:224] Handling call
0709 13:16:39.600384 (+215712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.601014 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.959846 (+358832us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540039c950. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:39.960008 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495216896}
I20260709 13:16:39.921633 12031 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:39.964960 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:39.966003 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.936403 12086 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:39.946769 11568 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:39.962718 11588 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:39.963641 12059 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:39.964329 12022 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:39.998858 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.000356 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:40.012257 10040 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:40.003018 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:40.005084 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:40.046890 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.012843 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:40.063555 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.007337 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 291) took 1083 ms. Trace:
I20260709 13:16:40.000989 10038 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.065003 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2156) took 1536 ms. Trace:
I20260709 13:16:40.065371 10040 rpcz_store.cc:276] 0709 13:16:38.528645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.011408 (+1482763us) service_pool.cc:224] Handling call
0709 13:16:40.012062 (+   654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.064667 (+ 52605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.064932 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:40.001626 12140 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:16:40.068220 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 190500us
I20260709 13:16:40.064445 10114 rpcz_store.cc:276] 0709 13:16:38.924080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.924185 (+   105us) service_pool.cc:224] Handling call
0709 13:16:38.965007 (+ 40822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.250863 (+285856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.250891 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.250934 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:39.250967 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.007072 (+756105us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54000b27d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:40.007122 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.007271 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656957312}
W20260709 13:16:40.006815 12113 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.689s	user 0.000s	sys 0.001s
I20260709 13:16:39.983012 11911 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:40.075122 10040 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.075585 10040 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:40.076444 10040 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:40.071697 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58954.7us
I20260709 13:16:39.972905 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.032998 11934 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.011904 11933 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:40.036502 11798 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:40.070439 11742 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.080942 10038 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
W20260709 13:16:40.082073 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 79128.8us
I20260709 13:16:39.971550 11912 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.857455 10032 rpcz_store.cc:276] 0709 13:16:38.654820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.441811 (+786991us) service_pool.cc:224] Handling call
0709 13:16:39.517642 (+ 75831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.532095 (+ 14453us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:39.580297 (+ 48202us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.777376 (+197079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.779787 (+  2411us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:39.785929 (+  6142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.792741 (+  6812us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.801556 (+  8815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236,"prepare.queue_time_us":124693,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":26792,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":204811,"threads_started":2,"wal-append.queue_time_us":217839}
I20260709 13:16:40.004297 12095 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:39.973357 12086 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.085170 10040 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:40.089888 12144 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:16:40.074754 11968 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:39.996620 12081 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.974298 12066 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:39.996372 11568 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.100761 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:40.074604 12115 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:40.129635 11983 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:40.130057 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:40.105557 10031 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:40.135855 11568 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:40.130628 11911 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:40.148695 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:40.089123 11933 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.279599 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:40.090831 11798 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.280098 10188 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:40.259116 11588 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:40.104722 12095 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.268131 12022 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:40.302171 10040 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:16:40.304177 10040 pending_rounds.cc:85] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 5
I20260709 13:16:40.281206 11983 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:40.284610 11568 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.305313 10040 pending_rounds.cc:107] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:40.092098 12059 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.312325 10040 raft_consensus.cc:2889] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.320358 11933 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.322256 11912 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:40.294785 11911 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:40.322963 11798 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:40.328464 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1102) took 2098 ms (client timeout 2641 ms). Trace:
W20260709 13:16:40.328946 10115 rpcz_store.cc:269] 0709 13:16:38.229755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.229897 (+   142us) service_pool.cc:224] Handling call
0709 13:16:40.328194 (+2098297us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001c9654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:40.328352 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614991104}
I20260709 13:16:40.309255 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:40.331945 11911 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.333998 12031 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.334751 12086 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:40.335307 12086 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.338595 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.339263 10113 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
W20260709 13:16:40.330530 12103 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.116s	user 0.008s	sys 0.025s
W20260709 13:16:40.350773 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.352942 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 204322us
I20260709 13:16:40.353822 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:40.335764 12086 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.355018 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:40.310451 11568 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.356609 10036 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:40.357529 10115 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:40.368062 10180 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:40.358790 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:40.371115 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:40.308740 12022 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.317322 11983 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.336997 12123 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:16:40.378149 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.379016 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:40.381970 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.382652 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:16:40.384102 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.386394 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 116724us
I20260709 13:16:40.370070 11568 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.369797 11742 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:40.351970 12071 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.372349 11912 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.395603 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.388593 11968 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:40.434612 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.435514 10716 raft_consensus.cc:2368] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:40.437124 10003 leader_election.cc:400] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:40.437544 10003 leader_election.cc:403] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:16:40.440058 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69026us
I20260709 13:16:40.440893 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:40.442466 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:40.397759 12031 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:40.424923 12159 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:40.438246 11911 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.432121 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:40.454938 12022 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:40.462610 10709 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:40.463699 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:40.463838 12022 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:40.464491 12022 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:40.465130 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:40.465423 12022 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.463086 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.466926 10712 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:40.455106 12159 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:40.455117 11911 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.468824 12159 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.469451 12095 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:40.455192 12071 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.456642 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 966) took 1840 ms. Trace:
I20260709 13:16:40.472204 10187 rpcz_store.cc:276] 0709 13:16:38.549122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.549243 (+   121us) service_pool.cc:224] Handling call
0709 13:16:38.584362 (+ 35119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.584742 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.584776 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.602009 (+ 17233us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.843552 (+241543us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:38.843637 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.843698 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.329853 (+1486155us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:40.378789 (+ 48936us) raft_consensus.cc:1685] finished
0709 13:16:40.378810 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.389979 (+ 11169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":21118,"spinlock_wait_cycles":15387008,"thread_start_us":223462,"threads_started":1,"wal-append.queue_time_us":594254}
I20260709 13:16:40.457635 10710 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:40.456863 10003 leader_election.cc:400] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:40.474704 10003 leader_election.cc:403] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:40.461246 12123 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:40.452430 12162 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:16:40.478044 11954 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:40.478510 11954 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:40.438616 12160 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:40.459419 11874 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:40.464401 10711 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.440222 11588 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.482869 11588 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:40.483294 11588 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.484246 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.487617 10004 leader_election.cc:400] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:40.488029 10004 leader_election.cc:403] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:40.459256 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:40.468833 12158 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:40.459128 12086 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:40.458540 11983 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:40.532984 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 56457.9us
I20260709 13:16:40.538172 10711 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:40.541332 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.558130 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:40.486315 12160 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:40.488147 12095 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
W20260709 13:16:40.565052 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122620us
I20260709 13:16:40.479386 11954 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:40.567623 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 185039us
W20260709 13:16:40.571647 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.589555 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 199080us
I20260709 13:16:40.575933 11742 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:40.610035 10114 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:16:40.649143 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 72263.6us
I20260709 13:16:40.604880 12159 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:16:40.594591 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.607290 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:40.665210 10109 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:40.592360 11945 consensus_meta.cc:287] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.003s
I20260709 13:16:40.608316 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.605242 12071 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:40.668462 10111 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:40.668610 12071 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.607925 10106 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:40.670440 11568 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.606904 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.672936 11568 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:40.674612 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:40.676520 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.677410 10107 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:40.677768 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:40.679060 12101 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.720s	user 0.008s	sys 0.010s
I20260709 13:16:40.670958 12071 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.681008 10113 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:40.663682 11983 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:40.682785 11983 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.686131 10113 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:40.609333 10108 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:40.689276 10112 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:40.695389 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.696615 10106 raft_consensus.cc:2368] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:40.592979 12123 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:40.614554 11999 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.578199 12086 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 13:16:40.706817 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.597606 11588 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.708127 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:40.708935 10035 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:40.709554 11588 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:40.707593 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:40.683898 12159 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.594704 11954 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.703960 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:40.705044 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.608513 12083 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:40.608700 11798 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:40.723132 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.724363 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.728834 10113 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:40.724869 10037 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:40.604321 12095 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:16:40.698102 12162 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:40.727368 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 238783us
I20260709 13:16:40.731599 10003 leader_election.cc:400] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:40.707538 10033 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:40.736012 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:40.741474 10115 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:40.742885 12180 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:40.723825 12159 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.748077 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:40.750101 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 177921us
I20260709 13:16:40.751788 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:40.753458 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.727175 12123 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:40.604130 12160 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.756058 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:40.759061 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.707629 11999 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.749224 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:40.776676 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 218614us
I20260709 13:16:40.604466 11742 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:40.779251 12179 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:40.782861 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:40.766678 12183 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.777609 12123 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.777938 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.778854 12160 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.749698 12066 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:40.737764 12083 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.752799 12075 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:40.793810 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 61348.2us
I20260709 13:16:40.764734 10106 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:40.740278 11798 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.856122 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.768640 12174 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:40.870550 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.872772 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 121086us
I20260709 13:16:40.876361 12159 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:40.857092 12081 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.880777 12193 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:40.881136 12123 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.858269 11983 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.885396 12187 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:40.886040 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.882567 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:40.855300 12066 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:40.908031 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.856823 12075 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:40.929425 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46946.8us
I20260709 13:16:40.932148 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:40.932979 11983 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.933315 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:40.934067 11983 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.934600 11983 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.935029 11983 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.934435 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:40.936307 12191 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:40.936730 12191 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.937069 12191 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.943081 12190 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:40.934022 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44134us
I20260709 13:16:40.943270 11983 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.946617 11983 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:40.877801 12086 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:40.891376 10032 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:40.953861 10032 pending_rounds.cc:85] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 3
I20260709 13:16:40.954149 10032 pending_rounds.cc:107] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:40.954397 10032 raft_consensus.cc:2889] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.957427 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.890491 12162 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:40.956840 11946 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:40.960583 12162 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.891430 12183 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.962523 12183 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:40.962844 12183 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:40.967394 10037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f53253de3345159399b6816804e1e6"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:40.968024 10037 raft_consensus.cc:606] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:40.890688 12159 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:40.958398 10109 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:40.960595 11946 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:40.974712 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:40.985232 10111 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:16:40.953881 12196 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:40.977651 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:40.963661 12183 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.981458 12191 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.957773 12081 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:40.988837 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.967630 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:40.958613 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:40.862695 12174 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:40.992077 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.966322 12190 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.999722 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:41.003233 10111 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:41.004765 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:40.964596 12123 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:16:41.008808 10115 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:41.004931 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:41.033967 10108 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.996104 12168 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.968699 12086 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.038018 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:41.041592 10111 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:41.041400 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:41.032691  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:41.004174 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:40.988492 12159 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.008126 12081 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:41.071600 10035 pending_rounds.cc:85] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 1
I20260709 13:16:41.072048 10035 pending_rounds.cc:107] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:41.072304 10035 raft_consensus.cc:2889] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.042148 12183 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:41.110357 11799 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:41.112521 12083 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.116671 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:41.117467 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:41.143262 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.109153 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:41.151033 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.151247 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:41.151939 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:41.152175 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:41.154807 12192 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:41.008337 12190 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:41.156854 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:41.609483 10180 raft_consensus.cc:2410] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:41.315693 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.610671 10187 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
W20260709 13:16:41.301740 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.590751 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.004585 10710 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:41.615263 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:41.616223 10182 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:41.630074 10188 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:41.625947 10185 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:16:41.632897 10035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.023s	sys 0.019s
W20260709 13:16:41.633293 10035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.023s	sys 0.019s
I20260709 13:16:41.634088 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.313848 12186 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.644482 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.645455 10180 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:41.092008 11568 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.317207 12159 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.058161 12168 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.632552 12191 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:41.457643 12081 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.299247 11999 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:41.313282 12193 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:41.647154 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.616266 12075 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.443178 12198 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:41.455957 12189 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:41.093456 10032 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:41.785084 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:41.647935 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:41.760197 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:41.725054 12187 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:41.767706 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 380) took 1017 ms. Trace:
I20260709 13:16:41.712131 10180 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:41.711062 11874 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:41.654207 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.839071 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.776952 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:41.826248 10187 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:41.826475 10182 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:41.740262 11954 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.010s	user 0.006s	sys 0.005s
I20260709 13:16:41.652872 12174 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:41.844559 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:41.813694 12160 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.919s	user 0.000s	sys 0.009s
I20260709 13:16:41.846957 10031 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:41.834992 12075 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.848002 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.849643 10182 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:41.831156 10186 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:16:41.795610 10108 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.000s
I20260709 13:16:41.805472 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
W20260709 13:16:41.832713 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47720us
I20260709 13:16:41.845703 12189 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:41.652462 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.003s	sys 0.023s
I20260709 13:16:41.834658 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 360) took 1436 ms. Trace:
I20260709 13:16:41.730172 10185 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:41.847056 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:41.746416 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.709082 12190 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:41.854326 10111 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:41.855432 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.857671 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.854642 10715 rpcz_store.cc:276] 0709 13:16:40.397885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.413564 (+ 15679us) service_pool.cc:224] Handling call
0709 13:16:41.760012 (+1346448us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:41.834595 (+ 74583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14114560}
I20260709 13:16:41.854169 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:41.856204 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.007s	sys 0.024s
W20260709 13:16:41.866820 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 1.08399e+06us
I20260709 13:16:41.855176 12189 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.856830 11954 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.838696 11874 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:41.868834 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:41.852451 10108 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:41.836107 12187 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:41.843055 12204 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:41.843631 12203 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:41.845403 10115 raft_consensus.cc:2410] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:41.700616 12086 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:41.654697 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:41.720016 12184 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.506s	user 0.001s	sys 0.000s
W20260709 13:16:41.850356 12183 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 13:16:41.869379 11954 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.910773 11954 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.911760 10037 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:41.912145 10037 pending_rounds.cc:85] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 3
I20260709 13:16:41.912369 10037 pending_rounds.cc:107] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:41.912585 10037 raft_consensus.cc:2889] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.912789 12168 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:41.916651 12187 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.917780 12187 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.852183 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.652905 12186 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.934185 12186 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.863669 10185 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:41.837054 10184 rpcz_store.cc:276] 0709 13:16:40.750793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.756517 (+  5724us) service_pool.cc:224] Handling call
0709 13:16:40.823106 (+ 66589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.860663 (+ 37557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.860704 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.967149 (+106445us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.515449 (+548300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.515512 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.515592 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.767499 (+251907us) raft_consensus.cc:1685] finished
0709 13:16:41.767517 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.767646 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1875,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":473327,"threads_started":1,"wal-append.queue_time_us":680780}
I20260709 13:16:41.837587 10181 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:41.873665 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.851169 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.830142 11568 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.938617 11568 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.939394 10182 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 3: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:41.833976 12198 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.876642 12203 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.941500 12198 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.877691 12204 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.877827 11799 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:41.943429 12204 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.879967 11874 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.944548 11874 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:41.852975 12075 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.948004 12075 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.878474 10183 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 2: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:41.853816 11983 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.899482 11938 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.952745 11983 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.952958 11938 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:16:41.955150 11983 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:41.955710 11938 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:41.905195 12211 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.830623 12193 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.956557 12211 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.958587 12193 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.959084 12211 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:41.905321 10115 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:41.941666 12203 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:41.959502 12190 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.960157 12190 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:41.962385 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47964.9us
I20260709 13:16:41.970139 10108 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:16:41.971076 10155 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.536s (SENT)
I20260709 13:16:41.971602 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:41.959408 10181 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:41.976647 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:41.978510 12209 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.979089 10715 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:41.979514 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:41.986496 10106 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:41.987262 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2346) took 1032 ms. Trace:
I20260709 13:16:41.987568 10106 rpcz_store.cc:276] 0709 13:16:40.954495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.974393 (+1019898us) service_pool.cc:224] Handling call
0709 13:16:41.986254 (+ 11861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.986982 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.987199 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.991439 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:41.994426 12209 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.994349 12191 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:41.994994 12209 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:41.967543 12204 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:41.999074 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.994758 12189 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:42.003115 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.003777 10186 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:42.004626 11568 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.005368 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.005219 11568 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.006018 10183 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 2.
I20260709 13:16:42.008987 12159 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.009500 12159 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.010524 12168 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.010993 12168 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.011945 12086 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.012436 12086 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.013091 11798 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.013724 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.990085 11933 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.028759 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:42.030985 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.055644 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:41.981297 12083 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:41.980517 12107 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:16:42.056360 10186 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:42.111956 12203 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.112773 11938 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.112568 12203 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.113492 12086 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.015174 12204 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:41.998975 11983 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:16:42.113265 11938 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:42.177090 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.131438 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.116528 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2351) took 1160 ms. Trace:
I20260709 13:16:42.136508 10713 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:42.153646 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.156769 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.189320 10715 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:42.157593 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1120) took 1462 ms. Trace:
I20260709 13:16:42.135942 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.119897 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.136323 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.132969 10110 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:42.191570 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1114) took 1584 ms. Trace:
I20260709 13:16:42.188651 10108 rpcz_store.cc:276] 0709 13:16:40.956005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.872033 (+916028us) service_pool.cc:224] Handling call
0709 13:16:41.872344 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.970687 (+ 98343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.116290 (+145603us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b54000b31d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:42.116469 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224236800}
I20260709 13:16:42.190064 10112 rpcz_store.cc:276] 0709 13:16:40.694950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.695092 (+   142us) service_pool.cc:224] Handling call
0709 13:16:40.695501 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.697887 (+  2386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.697920 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.698453 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.827962 (+129509us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:40.828001 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.828065 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.157364 (+1329299us) raft_consensus.cc:1685] finished
0709 13:16:42.157384 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.157523 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840,"thread_start_us":118985,"threads_started":1,"wal-append.queue_time_us":307137}
W20260709 13:16:42.199537 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 58628.9us
I20260709 13:16:42.192028 10110 rpcz_store.cc:276] 0709 13:16:40.607593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.612989 (+  5396us) service_pool.cc:224] Handling call
0709 13:16:42.132406 (+1519417us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:42.132615 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.191279 (+ 58664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.191498 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47455104}
I20260709 13:16:42.147342 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:42.208236 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60980.1us
I20260709 13:16:42.142438 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 382) took 1372 ms. Trace:
I20260709 13:16:42.152916 12203 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.135474 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.133148 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.151501 12204 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.220214 12204 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.220702 12204 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.221043 11938 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.151798 12031 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:42.221906 12031 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.222648 12204 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.120674 12212 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.223513 12212 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.223905 12031 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.151988 12039 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.224997 12039 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.225575 12212 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.156896 12209 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.206506 12189 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:42.226987 12039 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.227238 12189 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.154145 11889 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.228757 11889 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.226888 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:42.117095 12188 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:42.234486 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:42.225327 12075 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.238905 12174 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:42.252296 12174 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:42.252920 12075 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.235030 10714 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:42.253657 12185 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:42.254046 12185 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:42.254444 12075 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:42.236150 12188 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:42.254845 12075 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.236657 11798 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:42.255278 12075 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.068894 12071 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:42.255925 12071 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.256294 12071 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:42.236578 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 338596us
I20260709 13:16:42.239435 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:42.256922 12187 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.257401 12187 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.257714 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.259575 11938 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.259868 11983 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.259496 12187 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.260006 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.261019 10036 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:42.261011 11798 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.262437 11798 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:42.261775 12218 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.262795 11798 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:42.264114 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.054766 10711 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:42.055336 11933 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.120959 12169 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:42.125142 12059 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.224400 11568 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:42.243712 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 220401us
I20260709 13:16:42.117478 12190 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.115366 12159 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.116720 12193 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.137972 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:42.149585 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.156356 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:42.247916 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.236826 12123 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:42.116847 12198 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.137523 11946 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.234376 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.210448 10189 rpcz_store.cc:276] 0709 13:16:40.770399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.770544 (+   145us) service_pool.cc:224] Handling call
0709 13:16:42.141745 (+1371201us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:42.141943 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.142124 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.142151 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.142193 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.142223 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.142274 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.142375 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16459520}
I20260709 13:16:42.253271 12174 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.263960 11798 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.260352 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.278751 12169 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:42.265293 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.265970 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:42.280580 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.284792 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1320) took 1166 ms. Trace:
I20260709 13:16:42.342895 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:42.356328 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.265453 11933 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.357410 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.260284 11983 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.371660 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.369554 10033 rpcz_store.cc:276] 0709 13:16:41.118778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.135165 (+1016387us) service_pool.cc:224] Handling call
0709 13:16:42.135517 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.135904 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.135941 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.136482 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.251350 (+114868us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.251669 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.251900 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.251975 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.284508 (+ 32533us) raft_consensus.cc:1685] finished
0709 13:16:42.284544 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.284711 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":594,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":12801,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"thread_start_us":110694,"threads_started":1,"wal-append.queue_time_us":145841}
I20260709 13:16:42.366389 10035 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:42.359225 12123 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.365664 12191 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.393600 12123 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:42.361083 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 126803us
I20260709 13:16:42.262681 12066 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.336122 10180 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:42.032986 12211 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.364979 10034 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:42.366784 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.281250 12187 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.365669 10709 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
W20260709 13:16:42.380095 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 114214us
I20260709 13:16:42.415162 10113 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:42.343827 12180 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:42.383883 11983 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.254820 12185 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.281374 11938 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.410532 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.330971 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:42.428929 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98053.5us
I20260709 13:16:42.429065 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.414484 11798 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.442523 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.437796  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:42.412081 10187 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:42.414110 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.426769 12191 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.388592 10031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1309) took 1666 ms (client timeout 2214 ms). Trace:
I20260709 13:16:42.365437 12198 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.483691 12083 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.483938 12198 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.396461 12159 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.484223 12083 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.484650 12159 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.484890 12071 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.486816 12159 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.486920 12071 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.488173 12083 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.481159 12185 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.440034 12079 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:42.417188 12211 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.416587 12117 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.430445 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:42.389501 10040 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:42.360136 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:42.501204 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70826.1us
W20260709 13:16:42.501781 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 141722us
I20260709 13:16:42.417245 12173 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.411469 12224 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.442943 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.503046 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.393565 12075 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:42.462265 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.120817 12129 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:42.476994 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:42.481804 10031 rpcz_store.cc:269] 0709 13:16:40.722656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.724136 (+  1480us) service_pool.cc:224] Handling call
0709 13:16:42.388406 (+1664270us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400275bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:42.388531 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441615744}
I20260709 13:16:42.484156 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.371176 12201 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.443671 11742 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.370348 12193 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.493682 10106 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:42.419162 12187 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.455209 12066 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.495553 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.496253 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.497151 10716 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:42.424456 12095 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:42.584136 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.600529 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.599582 12095 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:42.585072 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:42.602654 11588 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:42.602442 12095 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.603132 12207 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:42.603433 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.603757 12095 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:42.585680 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81125.8us
I20260709 13:16:42.480100 12218 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.586563 12224 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.608161 12224 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:42.608747 12225 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
W20260709 13:16:42.592636 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 115709us
I20260709 13:16:42.611275 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.494376 12159 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:42.475544 12221 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.145s
I20260709 13:16:42.594051 12203 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.479911 12052 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:16:42.615999 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:42.613426 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.612699 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 308) took 1642 ms. Trace:
I20260709 13:16:42.590902 12022 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.587771 12180 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.599395 11982 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.493194 12191 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:42.622042 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.642402 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.636772 10039 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.590096 12198 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:42.637408 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.616978 12071 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.636271 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.635528 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.637670 10107 rpcz_store.cc:276] 0709 13:16:40.970556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.910107 (+939551us) service_pool.cc:224] Handling call
0709 13:16:41.910440 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.964779 (+ 54339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.964811 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.967261 (+  2450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.287948 (+320687us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.287989 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.288056 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.606365 (+318309us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:42.612420 (+  6055us) raft_consensus.cc:1685] finished
0709 13:16:42.612441 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.612629 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5381,"raft.queue_time_us":56710,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2669,"spinlock_wait_cycles":6359424,"thread_start_us":288993,"threads_started":1,"wal-append.queue_time_us":457981}
I20260709 13:16:42.598436 12079 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:42.657579 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:42.635625 11938 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.603569 12207 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.597883 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:42.491699 12083 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.662922 11568 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:42.655350 12066 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.656985 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:42.681916 10081 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.614506 11742 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.664426 12039 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.734539 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52734.6us
I20260709 13:16:42.632203 12218 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:16:42.664072 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.662312 12022 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:42.669204 12079 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.638988 12203 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.721349 10039 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:42.728566 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.641242 12159 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:42.722460 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.012s (SENT) [suppressed 12 similar messages]
I20260709 13:16:42.703341 10183 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.695641 12207 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.735529 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:42.736349 10111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2355) took 1771 ms (client timeout 2045 ms). Trace:
I20260709 13:16:42.758656 12179 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:42.758941 10111 rpcz_store.cc:269] 0709 13:16:40.960065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.053676 (+ 93611us) service_pool.cc:224] Handling call
0709 13:16:42.730985 (+1677309us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000b5c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:42.731120 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517848320}
I20260709 13:16:42.760233 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.761448 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.762480 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.763028 10111 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:42.696420 11938 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.713516 11568 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.661877 11982 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.700222 12180 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.703868 12221 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:42.697021 12229 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:42.744241 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 241267us
I20260709 13:16:42.764379 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.753835 12079 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.754657 10031 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:42.743348 12189 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.806272 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.819247 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:42.799371 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 43969.6us
I20260709 13:16:42.591415 12173 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:42.846143 12227 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:16:42.846938 10004 leader_election.cc:400] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
W20260709 13:16:42.847244 12230 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:42.739549 12039 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.847841 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.847393 12173 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:42.849248 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.849705 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.851394 11889 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.594409 12201 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.843881 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:42.853718 12201 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.854408 12201 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.854761 12201 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.855119 12201 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.855260 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:42.822849 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 87402.2us
I20260709 13:16:42.583678 12117 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:42.821501 12223 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:16:42.759281 12179 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.711447 12083 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.815860 11938 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.805910 12209 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:42.814390 11568 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.840415 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:42.823143 12221 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.824157 12198 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:42.864666 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.736498 11742 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:42.877113 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.899330 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.847572 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:42.844686 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:42.844719 12226 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:16:42.767187 12208 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
W20260709 13:16:42.899964 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.638160 12188 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.901934 10112 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:42.849700 12039 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.829404 12180 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.868768 12075 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.918392 12083 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.918886 10035 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:42.899502 12221 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.902340 12190 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.921224 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:42.921598 12234 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:16:42.922446 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.922956 12208 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.923638 12208 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:42.908887 11874 consensus_meta.cc:287] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.000s
I20260709 13:16:42.924026 12208 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:42.856071 12189 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.841053 10183 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:42.924602 12189 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.924799 10036 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:42.925271 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:42.923475 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.926457 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.868305 12211 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.909574 12193 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.918290 12180 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.928766 12191 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.929015 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.930153 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.930843 10111 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:42.934617 12203 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.934106 12221 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.936156 10188 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:42.936267 12079 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.938267 12079 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.898432 12198 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:42.938398 12189 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.939441 12198 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.940769 12198 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.941820 12189 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.942631 12221 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.935480 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.947868 12240 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.948707 10040 raft_consensus.cc:2410] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:42.949303 12235 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.916460 12239 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:16:42.950371 12193 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.950914 12193 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:42.952451 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.952970 12193 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:42.949983 12211 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.953666 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.954088 12211 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:42.954854 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1318) took 1944 ms. Trace:
I20260709 13:16:42.955509 10038 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:42.956369 12211 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:42.957849 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.959271 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.960575 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.961813 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.962575 10109 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:42.965054 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:42.965349 10185 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:42.965718 10189 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.966753 10185 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:42.968114 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:42.955225 10037 rpcz_store.cc:276] 0709 13:16:41.010012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.010285 (+   273us) service_pool.cc:224] Handling call
0709 13:16:41.010562 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.913009 (+902447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.954634 (+1041625us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400042c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:42.954798 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071826688}
I20260709 13:16:42.950181 12245 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:42.963407 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.931697 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.949648 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:42.989737 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:42.990494 10037 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.927536 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:42.995489 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:42.996887 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.001361 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:42.924400 12208 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.997675 10707 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:43.007231 10037 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:43.009560 10111 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:16:43.009799 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 148776us
I20260709 13:16:42.949762 12235 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:42.978516 11783 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:43.021520 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 166310us
I20260709 13:16:43.023634 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.028446 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.008510 10183 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:43.034454 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.011363 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:43.012091 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 145421us
W20260709 13:16:43.015097 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 164017us
I20260709 13:16:43.036435 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:43.028896 11933 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.649s	user 0.005s	sys 0.005s
I20260709 13:16:43.018148 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.037254 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.034785 10032 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:43.052614 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.053254 10032 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:43.055675 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.045069 10183 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:43.056417 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:43.056604 12236 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:42.969599 12022 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.033824 12174 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:43.046281 11983 consensus_meta.cc:287] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.000s
W20260709 13:16:43.047075 11798 consensus_meta.cc:287] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.001s
W20260709 13:16:43.032423 12059 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.003s
I20260709 13:16:43.050896 12207 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.055729 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.076740 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.077019 10037 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:43.077173 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.020018 12235 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.004828 12224 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.057787 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.044521 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.066766 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.058265 12239 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.098232 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.080679 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.099356 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.099885 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 993) took 1584 ms. Trace:
I20260709 13:16:43.100064 10185 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:16:43.100407 12179 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.101795 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.102233 12207 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.054124 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.102487 10107 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:43.103296 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.105690 10114 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:43.062548 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.106508 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.078362 10115 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:43.054096 10031 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:43.079201 12209 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.104741 11799 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:43.082577 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 72115.8us
I20260709 13:16:43.115789 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.054834 11933 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.091889 12189 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.092772 12159 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.093786 11938 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.094812 12066 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:43.132515 12159 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.077807 11983 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.133553 12159 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:43.134536 11983 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.134871 12159 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.135242 12159 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:43.135277 10109 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:43.096616 12224 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.081351 12162 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.096967 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:43.100188 10037 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:43.064986 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:43.080057 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 112556us
I20260709 13:16:43.111507 10189 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:43.083653 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:43.083269 12185 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.001s
I20260709 13:16:43.110677 10107 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:43.100255 10181 rpcz_store.cc:276] 0709 13:16:41.515929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.614976 (+ 99047us) service_pool.cc:224] Handling call
0709 13:16:43.099681 (+1484705us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540019c3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:43.099823 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475794304}
I20260709 13:16:43.115368 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.115767 11742 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:43.117755 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.088382 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:43.118845 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.119202 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.120267 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.124593 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.121058 11799 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.091926 12246 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.128010 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.128218 12071 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.119311 12201 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.132076 10108 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:43.137579 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72676.7us
I20260709 13:16:43.138396 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:43.212893 10189 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:43.209805 11983 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:43.213639 11983 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:43.213774 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:43.214263 12201 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.214870 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:43.138702 10113 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:43.181205 12224 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.218683 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.135902 10110 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:43.108309 12174 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.175419 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.176860 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.177942 10040 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
W20260709 13:16:43.175423 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 119804us
I20260709 13:16:43.180867 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.184437 11588 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:43.184979 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 611) took 1031 ms. Trace:
I20260709 13:16:43.194229 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.230700 10038 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:43.131428 11568 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.196578 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:43.232666 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 126231us
I20260709 13:16:43.198400 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.234340 10037 raft_consensus.cc:2410] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:43.122018 12208 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.125214 12081 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:16:43.202481 12235 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.137013 12189 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.239814 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.241473 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.237834 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:43.243117 10712 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.206192 10713 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:43.208631 10039 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:16:43.206080 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86968.6us
I20260709 13:16:43.135720 12159 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.230371 10708 rpcz_store.cc:276] 0709 13:16:42.153844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.153993 (+   149us) service_pool.cc:224] Handling call
0709 13:16:42.154313 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.241003 (+ 86690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.243765 (+  2762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.245705 (+  1940us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.249785 (+  4080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.184727 (+934942us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b54003ce1d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:43.184776 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.184912 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175229696}
I20260709 13:16:43.251261 11568 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.208875 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.127480 11933 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.214535 11983 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.136570 12162 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.209728 12246 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.256004 12246 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:43.119728 12123 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.003s
I20260709 13:16:43.212473 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:43.207772 12207 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.227223 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.243036 12189 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.263590 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:43.264211 10708 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.231853 10189 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.229864 11588 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:43.244956 10182 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:43.246788 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.267856 12081 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.268134 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:43.268488 12123 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.269265 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.233160 12224 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:43.270561 12123 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.270979 12224 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.271788 10034 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:43.272224 12174 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:43.274048 12071 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.273840 12207 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.274773 12071 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.275149 12071 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.275488 12071 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.276072 12207 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.276867 11933 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:43.277323 11933 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.211038 12185 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:43.254992 12201 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.255287 12208 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:43.255666 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 46853.6us
W20260709 13:16:43.258714 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46283.4us
I20260709 13:16:43.285831 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.286170 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:43.229451 10036 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:43.260521 10038 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:43.287287 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2199) took 1019 ms. Trace:
I20260709 13:16:43.261018 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.262063 11742 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.263118 10032 raft_consensus.cc:2410] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:43.278400 10039 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:43.279543 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.240514 12254 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.281693 11933 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.288058 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.287612 10038 rpcz_store.cc:276] 0709 13:16:42.267614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.240103 (+972489us) service_pool.cc:224] Handling call
0709 13:16:43.260295 (+ 20192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.287014 (+ 26719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.287224 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.289456 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2198) took 1022 ms. Trace:
I20260709 13:16:43.290377 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:43.301584 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:43.291249 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2200) took 1023 ms. Trace:
I20260709 13:16:43.295676 12172 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.302758 10039 rpcz_store.cc:276] 0709 13:16:42.267898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.245772 (+977874us) service_pool.cc:224] Handling call
0709 13:16:43.259795 (+ 14023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.290998 (+ 31203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.291186 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.299883 10036 rpcz_store.cc:276] 0709 13:16:42.267388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.226696 (+959308us) service_pool.cc:224] Handling call
0709 13:16:43.226979 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.289212 (+ 62233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.289397 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.298187 12081 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:43.313486 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.314234 10036 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:43.315289 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:43.291029 12207 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.319315 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:43.319993 10039 raft_consensus.cc:2376] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5. Re-sending same reply.
I20260709 13:16:43.321324 10038 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:43.322012 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2201) took 1053 ms. Trace:
I20260709 13:16:43.322317 10038 rpcz_store.cc:276] 0709 13:16:42.268136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.299616 (+1031480us) service_pool.cc:224] Handling call
0709 13:16:43.321133 (+ 21517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.321765 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.321954 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.294669 12168 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:43.327508 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.333254 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.335407 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.341776 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:43.342475 10111 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.345089 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.305572 12254 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.311678 12201 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.356058 12168 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.356457 12168 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.356807 12168 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.357707 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.358851 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2208) took 1089 ms. Trace:
I20260709 13:16:43.359221 10035 rpcz_store.cc:276] 0709 13:16:42.269809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.806019 (+536210us) service_pool.cc:224] Handling call
0709 13:16:43.358692 (+552673us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b540039c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:43.358792 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175827712}
I20260709 13:16:43.359923 12208 raft_consensus.cc:2764] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:43.360078 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.360265 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.360929 10035 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:43.361756 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.362334 10035 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:43.361544 10710 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:43.363137 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.363868 12241 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:43.364425 12241 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:43.365334 12241 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.368573 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:43.369094 10712 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:43.369760 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:43.370184 12189 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.370800 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:43.372570 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.373695 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.374724 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.375378 10112 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:43.330019 12081 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:43.376744 12081 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.289855 11588 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.348033 11742 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.348264 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:43.294312 12066 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:43.347110 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.350278 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1305) took 1170 ms. Trace:
I20260709 13:16:43.360682 10713 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:43.383447 10036 raft_consensus.cc:2376] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6. Re-sending same reply.
I20260709 13:16:43.353474 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:43.383229 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:43.382311 10185 rpcz_store.cc:276] 0709 13:16:42.179762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.967603 (+787841us) service_pool.cc:224] Handling call
0709 13:16:43.099841 (+132238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.100535 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.350051 (+249516us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540019c3d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:43.350208 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296546688}
I20260709 13:16:43.387355 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.388067 10038 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:43.389788 10036 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:43.385608 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.392139 10035 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:43.393095 10004 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.394500 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2205) took 1121 ms. Trace:
I20260709 13:16:43.394901 10036 rpcz_store.cc:276] 0709 13:16:42.269105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.389175 (+1120070us) service_pool.cc:224] Handling call
0709 13:16:43.389466 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.390157 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.390341 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.397104 10035 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:43.397521 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.398491 10035 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:43.398877 10035 pending_rounds.cc:85] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 4
I20260709 13:16:43.399097 10035 pending_rounds.cc:107] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:43.399323 10035 raft_consensus.cc:2889] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.400333 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:43.401681 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:43.402602 10112 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:43.403283 10185 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:43.403836 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:43.380517 12235 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.350323 12254 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:43.393896 11946 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.434891 11938 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.435323 11938 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.435580 10712 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:43.435706 11938 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.436437 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.437676 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.438647 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.440080 12249 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:43.440660 12249 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.439613 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.435460 11799 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.389024 10708 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:43.394945 11568 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:43.450156 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46421.8us
I20260709 13:16:43.451288 10039 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:43.453450 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2204) took 1184 ms. Trace:
I20260709 13:16:43.453562 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.453794 10039 rpcz_store.cc:276] 0709 13:16:42.268878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.388976 (+1120098us) service_pool.cc:224] Handling call
0709 13:16:43.450996 (+ 62020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.453221 (+  2225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.453396 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.371093 12159 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.455489 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:43.456063 10112 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.433254 12252 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:43.396116 12201 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:43.485643 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.409158 12123 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.493218 10188 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:43.498363 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.509918 12248 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.514518 12259 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:16:43.515954 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.516301 12247 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.516716 12247 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:43.517083 12247 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.519097 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 317) took 1095 ms. Trace:
I20260709 13:16:43.519658 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 311) took 1153 ms. Trace:
I20260709 13:16:43.520052 10110 rpcz_store.cc:276] 0709 13:16:42.366409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.366536 (+   127us) service_pool.cc:224] Handling call
0709 13:16:43.519492 (+1152956us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54000b4d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:43.519596 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668518784}
I20260709 13:16:43.521134 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:43.521803 10110 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:43.522773 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2211) took 1246 ms. Trace:
I20260709 13:16:43.522853 12249 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.523540 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.471910 12252 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.519462 10106 rpcz_store.cc:276] 0709 13:16:42.424162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.425132 (+   970us) service_pool.cc:224] Handling call
0709 13:16:42.478090 (+ 52958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.591973 (+113883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.518848 (+926875us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54000db954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:43.519035 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35502976}
I20260709 13:16:43.524319 10113 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:43.409273 12208 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:16:43.459141 12254 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:16:43.479179 12207 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.548271 10112 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:43.549599 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:43.550251 10112 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.452397 12174 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:43.454603 12246 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.487845 11983 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:43.585382 10112 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:43.580782 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.619427 10113 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:43.523216 10033 rpcz_store.cc:276] 0709 13:16:42.276553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.515626 (+1239073us) service_pool.cc:224] Handling call
0709 13:16:43.522709 (+  7083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.546532 12201 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.521898 12117 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.657670 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:43.673286 12201 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:43.673791 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 246160us
I20260709 13:16:43.605365 12039 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:43.675246 12039 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.674649 10112 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:43.548738 12252 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.672629 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.629578 11983 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.676782 10113 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:43.678251 11983 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.626567 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.674500 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:43.680181 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1127) took 1041 ms. Trace:
I20260709 13:16:43.680365 11742 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.680814 11742 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:43.681351 11742 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.672703 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:43.680579 10112 rpcz_store.cc:276] 0709 13:16:42.638382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.674065 (+1035683us) service_pool.cc:224] Handling call
0709 13:16:43.674421 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.679925 (+  5504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.680127 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:43.689699 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 236205us
W20260709 13:16:43.657299 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.657904 12266 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:43.770359 10110 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:43.771306 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2373) took 1121 ms. Trace:
I20260709 13:16:43.771713 10110 rpcz_store.cc:276] 0709 13:16:42.650006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.683692 (+1033686us) service_pool.cc:224] Handling call
0709 13:16:43.683969 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.770987 (+ 87018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.771198 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.772498 10111 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:43.773138 10110 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:43.773598 10111 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:43.774209 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2386) took 1039 ms. Trace:
I20260709 13:16:43.774514 10111 rpcz_store.cc:276] 0709 13:16:42.734407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.773198 (+1038791us) service_pool.cc:224] Handling call
0709 13:16:43.773448 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.773984 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.774154 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.780308 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2385) took 1045 ms. Trace:
I20260709 13:16:43.780884 10110 rpcz_store.cc:276] 0709 13:16:42.728673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.772567 (+1043894us) service_pool.cc:224] Handling call
0709 13:16:43.772965 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.773600 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.773811 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.786283 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2384) took 1068 ms. Trace:
I20260709 13:16:43.683346 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 254) took 1025 ms. Trace:
I20260709 13:16:43.786888 10112 rpcz_store.cc:276] 0709 13:16:42.717780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.685413 (+967633us) service_pool.cc:224] Handling call
0709 13:16:43.785787 (+100374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.785973 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.785999 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.786038 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:43.786066 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.786116 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.786221 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.675606 12201 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:43.787454 10036 rpcz_store.cc:276] 0709 13:16:42.657140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.434576 (+777436us) service_pool.cc:224] Handling call
0709 13:16:43.451040 (+ 16464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.451223 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:43.457616 (+  6393us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.681300 (+223684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.681554 (+   254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:43.681888 (+   334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.682159 (+   271us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.682947 (+   788us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6590,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":260,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":3968,"thread_start_us":222521,"threads_started":1}
I20260709 13:16:43.800957 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1322) took 1067 ms. Trace:
I20260709 13:16:43.801376 10036 rpcz_store.cc:276] 0709 13:16:42.737803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.800060 (+1062257us) service_pool.cc:224] Handling call
0709 13:16:43.800356 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.800519 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.800545 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.800585 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:43.800619 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.800667 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.800893 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.803268 11983 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:43.804061 10036 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:43.804409 10036 pending_rounds.cc:85] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 4
I20260709 13:16:43.804613 10036 pending_rounds.cc:107] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:43.804854 10036 raft_consensus.cc:2889] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.805647 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1324) took 1062 ms. Trace:
I20260709 13:16:43.805994 10036 rpcz_store.cc:276] 0709 13:16:42.743659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.803399 (+1059740us) service_pool.cc:224] Handling call
0709 13:16:43.803731 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.805311 (+  1580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.805572 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.789917 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:43.807528 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1326) took 1005 ms. Trace:
I20260709 13:16:43.808650 10036 rpcz_store.cc:276] 0709 13:16:42.802604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.806685 (+1004081us) service_pool.cc:224] Handling call
0709 13:16:43.807023 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.807220 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.807244 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.807284 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:43.807322 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.807370 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.807474 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.674664 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 256) took 1017 ms. Trace:
I20260709 13:16:43.811456 12201 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:43.818133 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.821538 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:43.799623 12168 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.815727 10033 rpcz_store.cc:276] 0709 13:16:42.657571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.673729 (+1016158us) service_pool.cc:224] Handling call
0709 13:16:43.674069 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.674273 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.674301 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.674393 (+    92us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:43.674430 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.674492 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.674605 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.833489 12039 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:43.837227 11933 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.005s
I20260709 13:16:43.840340 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:43.840734 11933 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.841926 10108 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:43.843842 11933 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.808058 11938 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.846038 11938 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:43.835517 12071 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.006s
I20260709 13:16:43.839372 12168 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:43.847131 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:43.847024 12071 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:43.848707 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1013) took 1354 ms. Trace:
I20260709 13:16:43.849750 12071 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:43.849085 10181 rpcz_store.cc:276] 0709 13:16:42.493976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.253889 (+759913us) service_pool.cc:224] Handling call
0709 13:16:43.254811 (+   922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.262789 (+  7978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.262822 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.263349 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.392696 (+129347us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:43.392737 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.392808 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.848518 (+455710us) raft_consensus.cc:1685] finished
0709 13:16:43.848537 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.848651 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7568,"raft.queue_time_us":8758,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":128944,"threads_started":1,"wal-append.queue_time_us":554186}
I20260709 13:16:43.850419 10106 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:43.850759 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:43.823583 12086 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:43.817875 11799 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.854636 11742 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:43.872578 12246 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:43.873523 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:43.874989 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.875483 12252 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.877601 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1328) took 1049 ms. Trace:
I20260709 13:16:43.878067 10032 rpcz_store.cc:276] 0709 13:16:42.827983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.053864 (+225881us) service_pool.cc:224] Handling call
0709 13:16:43.877353 (+823489us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540031ced4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:43.877528 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367982336}
I20260709 13:16:43.881446 12252 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:43.890847 12276 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:43.891426 12276 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:43.892525 12276 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.512462  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:43.894248 12276 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.897472 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 442) took 1423 ms. Trace:
W20260709 13:16:43.901386 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.901787 10033 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:43.903329 10033 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:43.910691 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 302) took 3248 ms. Trace:
I20260709 13:16:43.911168 10114 rpcz_store.cc:276] 0709 13:16:40.662645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.663013 (+   368us) service_pool.cc:224] Handling call
0709 13:16:42.138514 (+1475501us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:42.731212 (+592698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.106074 (+374862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.907025 (+800951us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54000b5c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:43.910443 (+  3418us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54000b5c50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:43.910582 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230789120}
I20260709 13:16:43.912354 12259 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:43.912773 12259 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:43.912884 10114 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:43.913630 12259 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:43.914515 12247 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:44.093148 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.119421 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:44.119712 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:44.115623 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2376) took 1463 ms. Trace:
I20260709 13:16:44.112471 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2370) took 1465 ms. Trace:
I20260709 13:16:44.121693 10106 rpcz_store.cc:276] 0709 13:16:42.647153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.679864 (+1032711us) service_pool.cc:224] Handling call
0709 13:16:43.680147 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.850801 (+170654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.112224 (+261423us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400404054. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:44.112404 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391214464}
I20260709 13:16:44.115166 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2378) took 1462 ms. Trace:
I20260709 13:16:44.122911 10108 rpcz_store.cc:276] 0709 13:16:42.652902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.357463 (+704561us) service_pool.cc:224] Handling call
0709 13:16:44.114948 (+757485us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54000b5254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.115097 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111689472}
I20260709 13:16:44.110961 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1015) took 1616 ms. Trace:
I20260709 13:16:44.128257 10188 rpcz_store.cc:276] 0709 13:16:42.494462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.376522 (+882060us) service_pool.cc:224] Handling call
0709 13:16:43.376817 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.493661 (+116844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.110685 (+617024us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001009d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:44.110888 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267279232}
I20260709 13:16:44.120793 10109 rpcz_store.cc:276] 0709 13:16:42.652386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.963169 (+310783us) service_pool.cc:224] Handling call
0709 13:16:44.115458 (+1152289us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001bf154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.115556 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358196480}
I20260709 13:16:44.133230 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:44.134460 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:43.989336 12272 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:44.028146 11874 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:44.139693 12272 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.140097 11874 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.141311 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 397) took 1273 ms. Trace:
I20260709 13:16:44.142469 12248 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:44.143028 12086 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:43.915251 12221 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:44.144757 12221 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:44.144883 12169 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.145949 12169 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.145668 12221 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.146608 12221 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.945901 12252 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:44.148389 12240 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:44.148418 12252 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.148967 12071 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:44.149253 12268 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:44.151249 12252 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:43.921886 12231 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.029s	user 0.004s	sys 0.000s
I20260709 13:16:44.152208 11982 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:44.149641 12071 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.154881 12071 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.154933 11742 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.142163 12272 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.160326 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 396) took 1354 ms. Trace:
I20260709 13:16:44.160748 10187 rpcz_store.cc:276] 0709 13:16:42.806282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.159476 (+1353194us) service_pool.cc:224] Handling call
0709 13:16:44.159843 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.160016 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.160042 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.160080 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.160118 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.160167 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.160267 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.162573 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 400) took 1261 ms. Trace:
I20260709 13:16:44.162915 10187 rpcz_store.cc:276] 0709 13:16:42.900911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.161771 (+1260860us) service_pool.cc:224] Handling call
0709 13:16:44.162101 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.162275 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.162300 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.162339 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.162369 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.162417 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.162521 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.148918 12240 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.164254 12240 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:44.156494 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 319) took 1684 ms (client timeout 2094 ms). Trace:
I20260709 13:16:44.156910 11588 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.106743 12189 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.170768 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:44.171393 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:44.172150 10714 raft_consensus.cc:2368] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:44.173058 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:44.187575 10034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2207) took 1918 ms (client timeout 1510 ms). Trace:
W20260709 13:16:44.188175 10034 rpcz_store.cc:269] 0709 13:16:42.269573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.409844 (+140271us) service_pool.cc:224] Handling call
0709 13:16:44.187295 (+1777451us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400411c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.187485 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823011712}
I20260709 13:16:44.189401 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:44.190042 10034 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:44.167935 10115 rpcz_store.cc:269] 0709 13:16:42.471882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.472024 (+   142us) service_pool.cc:224] Handling call
0709 13:16:44.156318 (+1684294us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400210f54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.156430 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128209152}
I20260709 13:16:44.194073 10115 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 7. Ops: [3.2-5.3]
I20260709 13:16:44.197346 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1011) took 1959 ms. Trace:
I20260709 13:16:44.197824 10189 rpcz_store.cc:276] 0709 13:16:42.238076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.215657 (+977581us) service_pool.cc:224] Handling call
0709 13:16:43.217121 (+  1464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.266274 (+ 49153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.197038 (+930764us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b54003f0cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:44.197270 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33305344}
I20260709 13:16:44.199482 10189 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:44.227108 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 401) took 1323 ms. Trace:
W20260709 13:16:44.202698 10040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2212) took 1925 ms (client timeout 2147 ms). Trace:
W20260709 13:16:44.227937 10040 rpcz_store.cc:269] 0709 13:16:42.276979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.949383 (+672404us) service_pool.cc:224] Handling call
0709 13:16:44.202462 (+1253079us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540031d8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.202621 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454498688}
I20260709 13:16:44.228514 10107 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:16:44.204463 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:44.205365 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:44.170872 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:44.207039 11938 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.234118 11938 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.208045 12201 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:44.236047 12201 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.237697 12240 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.238199 12201 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.209103 10035 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.210253 12159 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:44.212049 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:44.241645  9934 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 4, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 4 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:43.914803 12259 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.213699 10114 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:44.214342 10032 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:44.213510 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 246) took 1558 ms. Trace:
I20260709 13:16:44.244524 10038 rpcz_store.cc:276] 0709 13:16:42.655145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.388735 (+733590us) service_pool.cc:224] Handling call
0709 13:16:44.212791 (+824056us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:44.212992 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.213182 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.213211 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.213255 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.213295 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.213355 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.213453 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17725696}
W20260709 13:16:44.206421 12228 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.370s	user 0.004s	sys 0.000s
I20260709 13:16:44.246690 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2388) took 1017 ms. Trace:
I20260709 13:16:44.247119 10114 rpcz_store.cc:276] 0709 13:16:43.228810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.120485 (+891675us) service_pool.cc:224] Handling call
0709 13:16:44.213459 (+ 92974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.246424 (+ 32965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.246630 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.148635 12188 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.248445 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1292) took 2239 ms. Trace:
I20260709 13:16:44.248822 10184 rpcz_store.cc:276] 0709 13:16:42.008877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.018293 (+  9416us) service_pool.cc:224] Handling call
0709 13:16:42.109027 (+ 90734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.360182 (+251155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.360234 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.381093 (+ 20859us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.724661 (+343568us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:42.724701 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.724777 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.205819 (+1481042us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:44.248145 (+ 42326us) raft_consensus.cc:1685] finished
0709 13:16:44.248165 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.248367 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72947,"raft.queue_time_us":113791,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":25911680,"thread_start_us":441905,"threads_started":2,"wal-append.queue_time_us":327464}
I20260709 13:16:44.251084 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1026) took 1184 ms. Trace:
I20260709 13:16:44.251579 12189 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.252347 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 398) took 1360 ms. Trace:
I20260709 13:16:44.252179 12189 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.252698 10182 rpcz_store.cc:276] 0709 13:16:42.892374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.953455 (+ 61081us) service_pool.cc:224] Handling call
0709 13:16:44.252143 (+1298688us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000b4fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.252291 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668266880}
I20260709 13:16:44.254419 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 402) took 1047 ms. Trace:
I20260709 13:16:44.254832 10182 rpcz_store.cc:276] 0709 13:16:43.206863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.253644 (+1046781us) service_pool.cc:224] Handling call
0709 13:16:44.253929 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.254114 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.254139 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.254183 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:44.254211 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.254268 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.254364 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.254346 12189 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.206521 10710 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:44.260406 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 253) took 1603 ms. Trace:
I20260709 13:16:44.260803 10035 rpcz_store.cc:276] 0709 13:16:42.656915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.416530 (+759615us) service_pool.cc:224] Handling call
0709 13:16:44.167942 (+751412us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:44.208905 (+ 40963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.240396 (+ 31491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.260242 (+ 19846us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b5400411c50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:44.260347 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111001216}
I20260709 13:16:44.217500 10187 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:44.225694 10140 heartbeater.cc:646] Failed to heartbeat to 127.8.186.254:36577 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.186.254:36577 timed out after 15.000s (SENT)
W20260709 13:16:44.226323  9935 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 290) took 15549 ms (client timeout 15000 ms). Trace:
I20260709 13:16:44.221761 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:44.268446 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1023) took 1202 ms. Trace:
I20260709 13:16:44.227566 10189 rpcz_store.cc:276] 0709 13:16:42.903286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.198965 (+1295679us) service_pool.cc:224] Handling call
0709 13:16:44.199301 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.226829 (+ 27528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.227037 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.141693 10188 rpcz_store.cc:276] 0709 13:16:42.868060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.140500 (+1272440us) service_pool.cc:224] Handling call
0709 13:16:44.140817 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.140995 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.141021 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.141062 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.141095 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.141143 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.141255 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:44.272682 10079 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.186.254:36577, user_credentials={real_user=slave}} blocked reactor thread for 48436.9us
I20260709 13:16:44.251402 10184 rpcz_store.cc:276] 0709 13:16:43.066726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.250295 (+1183569us) service_pool.cc:224] Handling call
0709 13:16:44.250633 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.250811 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.250837 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.250875 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:44.250903 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.250948 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.251033 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.269352 10187 rpcz_store.cc:276] 0709 13:16:43.066011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.216819 (+1150808us) service_pool.cc:224] Handling call
0709 13:16:44.217138 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.268177 (+ 51039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.268387 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:44.078516 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.291245 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69590.6us
I20260709 13:16:44.292294 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:44.293229 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 155127us
I20260709 13:16:44.294010 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:44.243216  9934 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 4 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.297048 10189 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:44.297576 10189 pending_rounds.cc:85] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 2
I20260709 13:16:44.297861 10189 pending_rounds.cc:107] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:44.298164 10189 raft_consensus.cc:2889] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.301033 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:44.305423 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:44.306806 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:44.308077 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.308656 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.235524 12169 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.322489 12169 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.310357 12161 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.323539 12161 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:44.323967 12161 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.325147 12169 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.296367 11799 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.330322 11799 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.311700 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:44.331522 10109 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.332970 11799 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.315191 10108 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:44.317181 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.335776 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.337620  9934 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.897979 10709 rpcz_store.cc:276] 0709 13:16:42.473681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.477598 (+  3917us) service_pool.cc:224] Handling call
0709 13:16:42.588432 (+110834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.001342 (+412910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.001384 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.001903 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.054822 (+ 52919us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:43.062374 (+  7552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.896746 (+834372us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003cd554. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:43.896808 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.896864 (+    56us) raft_consensus.cc:1685] finished
0709 13:16:43.896882 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.897381 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1699,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":596040960,"thread_start_us":166365,"threads_started":2,"wal-append.queue_time_us":119909}
I20260709 13:16:44.348668 10034 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:44.339298  9934 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.354949 10114 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:44.310468 12189 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:44.310293 12249 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:44.378851 12189 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.379083 12249 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.381258 12249 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.381199 12189 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:44.384997 12240 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:44.389696 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 97504us
W20260709 13:16:44.341657 12149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.023s	sys 0.040s
I20260709 13:16:43.910867 12162 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.351670 12268 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:44.401646 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 107724us
W20260709 13:16:44.268886  9935 rpcz_store.cc:269] 0709 13:16:28.676669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.698981 (+ 22312us) service_pool.cc:224] Handling call
0709 13:16:28.826830 (+127849us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f452090 00007f3c6f4f0f3a 00007f3c752a71cc 00007f3c753a537e 00007f3c738662a4 00007f3c73866232 00007f3c73866161 00007f3c738660dc 00007f3c73865392 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:44.226205 (+15399375us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:39.407936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:39.465992 (+ 58056us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:39.466046 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:16:39.466062 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:39.466674 (+   612us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:39.466757 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:39.466789 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:39.467226 (+   437us) tablet.cc:701] Row locks acquired
0709 13:16:39.467275 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:16:39.467443 (+   168us) write_op.cc:270] Start()
0709 13:16:39.467590 (+   147us) write_op.cc:276] Timestamp: P: 1783602999467382 usec, L: 0
0709 13:16:39.467616 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:16:39.524874 (+ 57258us) log.cc:844] Serialized 1626 byte log entry
0709 13:16:40.001232 (+476358us) op_driver.cc:464] REPLICATION: finished
0709 13:16:40.351591 (+350359us) write_op.cc:301] APPLY: starting
0709 13:16:40.356026 (+  4435us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:40.371102 (+ 15076us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:40.386892 (+ 15790us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:40.454782 (+ 67890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:40.454974 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:40.455023 (+    49us) write_op.cc:312] APPLY: finished
0709 13:16:40.455271 (+   248us) log.cc:844] Serialized 35 byte log entry
0709 13:16:40.455441 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:40.455542 (+   101us) write_op.cc:454] Released schema lock
0709 13:16:40.455586 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:40.456016 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:40.456044 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":537265,"reported_tablets":20,"spinlock_wait_cycles":32400128,"child_traces":[["op",{"apply.queue_time_us":322737,"apply.run_cpu_time_us":2912,"apply.run_wall_time_us":115304,"num_ops":3,"prepare.queue_time_us":99214,"prepare.run_cpu_time_us":14430,"prepare.run_wall_time_us":256502,"raft.queue_time_us":265251,"raft.run_cpu_time_us":17464,"raft.run_wall_time_us":301141,"replication_time_us":505984,"thread_start_us":543020,"threads_started":4,"wal-append.queue_time_us":144240,"wal-append.run_cpu_time_us":35231,"wal-append.run_wall_time_us":1843065}]]}
I20260709 13:16:44.405920 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:44.395998 12149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.023s	sys 0.040s
I20260709 13:16:44.407398 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:44.393392 12039 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.411408 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:44.352098 12086 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:16:44.411536 10185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.008s	sys 0.087s
W20260709 13:16:44.413391 10185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.008s	sys 0.088s
I20260709 13:16:44.391731 12237 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:44.423054 10079 leader_election.cc:400] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:16:44.424614 10079 leader_election.cc:403] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:16:44.424827 10113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.034s
W20260709 13:16:44.426251 10113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.020s	sys 0.034s
W20260709 13:16:44.424679 10036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.022s	sys 0.032s
W20260709 13:16:44.426975 10036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.022s	sys 0.032s
I20260709 13:16:44.431631 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:44.432308 10114 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.421413 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 394) took 1737 ms. Trace:
I20260709 13:16:44.432688 10185 rpcz_store.cc:276] 0709 13:16:42.684404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.434051 (+749647us) service_pool.cc:224] Handling call
0709 13:16:43.452526 (+ 18475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.452713 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:43.597256 (+144543us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.421027 (+823771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.421098 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:44.421146 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.421218 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.421348 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5079,"prepare.queue_time_us":354095,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":922711,"threads_started":2}
I20260709 13:16:44.434527 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2364) took 1795 ms. Trace:
I20260709 13:16:44.434940 10113 rpcz_store.cc:276] 0709 13:16:42.645601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.677554 (+1031953us) service_pool.cc:224] Handling call
0709 13:16:43.677833 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.678023 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:43.820961 (+142938us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.434203 (+613242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.434253 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.434306 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.434363 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.434472 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":382531,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"thread_start_us":747957,"threads_started":2}
I20260709 13:16:44.414881  9934 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 5, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:44.400904 11889 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:44.450314 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:44.455858  9934 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.411933 12252 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.413861 12276 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:44.618182 10155 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.007s	sys 0.051s
W20260709 13:16:44.618611 10155 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.051s
W20260709 13:16:44.618904 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 598274us
W20260709 13:16:44.619529 10155 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.689s (SENT)
I20260709 13:16:44.620536 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.620812  9934 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.413748 12259 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.465394 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:44.418365 12189 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.431565 12249 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
W20260709 13:16:44.485877 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.608784 12162 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.466665 12159 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:16:44.637960 12162 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.638754 12159 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:44.639154 12159 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:44.640265 12162 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.639997 12159 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.641372 12159 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.642581 12276 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:44.494408 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 255) took 1837 ms. Trace:
I20260709 13:16:44.643337 10039 rpcz_store.cc:276] 0709 13:16:42.657356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.454989 (+797633us) service_pool.cc:224] Handling call
0709 13:16:43.479285 (+ 24296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.479656 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.479686 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.480165 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.116649 (+636484us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.116689 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.116770 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.494154 (+377384us) raft_consensus.cc:1685] finished
0709 13:16:44.494180 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.494337 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8367,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":23207,"thread_start_us":427249,"threads_started":1,"wal-append.queue_time_us":968209}
I20260709 13:16:44.644688 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2223) took 1336 ms. Trace:
I20260709 13:16:44.496052 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:44.496915 12161 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.501410 10109 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:44.503931 12268 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.417392 12031 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:44.627381  9934 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:44.505949 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:44.464588 12272 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:44.664196 12272 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.664645 12272 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.667147 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.469257 12262 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:44.668043 10184 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:44.504747 10031 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:44.458592 12086 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:16:44.643961 12168 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:44.663843  9934 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:44.548730 10112 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.010s	sys 0.025s
W20260709 13:16:44.670058 10112 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.011s	sys 0.025s
I20260709 13:16:44.670677  9934 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:44.623358 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.624632 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:44.631922 12259 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:44.683369 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 60096.9us
I20260709 13:16:44.645588 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.647246 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.684255 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:44.684377 10188 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:44.685462 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.686661 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.648428 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.645112 10036 rpcz_store.cc:276] 0709 13:16:43.307944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.820028 (+512084us) service_pool.cc:224] Handling call
0709 13:16:43.820326 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.828463 (+  8137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.828499 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.829022 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.427448 (+598426us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:44.427491 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.427577 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.644453 (+216876us) raft_consensus.cc:1685] finished
0709 13:16:44.644477 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.644629 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1762,"raft.queue_time_us":7800,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2751,"thread_start_us":594582,"threads_started":1,"wal-append.queue_time_us":800174}
I20260709 13:16:44.659045 10185 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:44.661553 10109 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:44.537786 10186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.019s	sys 0.048s
W20260709 13:16:44.698355 10186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.020s	sys 0.048s
W20260709 13:16:44.458902 10111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.008s
I20260709 13:16:44.671494 12161 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.669098 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:44.651026 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.593855 10114 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:44.669695 12086 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:44.690673 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:44.700683 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 567529us
I20260709 13:16:44.669879 12168 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.694517 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.695358 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:44.685391  9934 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 5, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:44.693615 12262 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:44.692425 12022 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:44.687772 10188 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
W20260709 13:16:44.544147 10180 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.043s	sys 0.083s
W20260709 13:16:44.717726 10180 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.044s	sys 0.084s
I20260709 13:16:44.688900 10113 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:44.697247 12187 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.720854 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1295) took 2711 ms. Trace:
I20260709 13:16:44.643523 12276 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.706007 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:44.707758 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.729225 10189 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:44.726691 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:44.726747 10680 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.008s	sys 0.004s
W20260709 13:16:44.730468 10680 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.008s	sys 0.004s
W20260709 13:16:44.730825 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 678636us
I20260709 13:16:44.709381  9934 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 3, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:44.733180  9934 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.703608 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.699993 12259 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:44.725732 10180 rpcz_store.cc:276] 0709 13:16:42.009679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.015034 (+  5355us) service_pool.cc:224] Handling call
0709 13:16:42.335726 (+320692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.335985 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:42.506561 (+170576us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.731868 (+225307us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.380459 (+648591us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18003369a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:16:43.921305 (+540846us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:44.718105 (+796800us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.720488 (+  2383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.720541 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.720593 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.720673 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.720789 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4060,"prepare.queue_time_us":127878,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":78,"raft.queue_time_us":12231,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":25609,"spinlock_wait_cycles":16545792,"thread_start_us":1435882,"threads_started":3,"wal-append.queue_time_us":313367}
I20260709 13:16:44.708616 12168 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:44.724897 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 575013us
W20260709 13:16:44.715845 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 247563us
I20260709 13:16:44.708375 12262 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:44.765298 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.699731 10111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.009s	sys 0.009s
I20260709 13:16:44.770370 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 321) took 1970 ms. Trace:
I20260709 13:16:44.734889  9934 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.741398 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.772234 10184 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:44.741025 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.741405 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.774266 11588 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:44.774603 11588 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.752636 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.774889 11588 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.758394 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:44.759317 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:44.705592 12086 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:44.777055  9934 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:44.778915  9934 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:44.726308 12241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.007s	sys 0.048s
I20260709 13:16:44.717087 12282 raft_consensus.cc:2764] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:16:44.716950 12022 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:44.724861 12209 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:44.760392 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 345950us
I20260709 13:16:44.782143 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.806331 12247 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:44.770830 10111 rpcz_store.cc:276] 0709 13:16:42.799701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.775234 (+975533us) service_pool.cc:224] Handling call
0709 13:16:43.775526 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.791815 (+ 16289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.791842 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.809791 (+ 17949us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.769968 (+960177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.770013 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.770105 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.770147 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:44.770159 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.770306 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2641,"raft.queue_time_us":23557,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":6289,"thread_start_us":869087,"threads_started":1,"wal-append.queue_time_us":818019}
I20260709 13:16:44.740013 12187 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.785661 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:44.794103 11588 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:44.815944 12241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.007s	sys 0.049s
I20260709 13:16:44.780349 12262 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.840296 11588 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:44.805194 10005 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.005s	sys 0.006s
I20260709 13:16:44.760053 12174 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:44.783692 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 474530us
W20260709 13:16:44.813387 10037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.006s
I20260709 13:16:44.769239 10188 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
W20260709 13:16:44.816502 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.795513 12231 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:16:44.815029 10040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.014s
I20260709 13:16:44.783787 12189 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.765668 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:44.830971 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.000s	sys 0.015s
W20260709 13:16:44.838150 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 56103.1us
W20260709 13:16:44.852469 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.015s
I20260709 13:16:44.792366 12249 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:44.849274 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:44.787199 12259 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:44.805119 12254 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:16:44.854473 10110 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:44.854131 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.864552 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.867841 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:44.854753 12282 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:44.856308 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 90812.9us
I20260709 13:16:44.897248 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:44.841363 10005 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.006s
I20260709 13:16:44.857372 11588 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.899506 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:44.825352 10709 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:44.814730 12248 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:44.901365 12248 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:44.903362 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:44.827834 12022 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:44.858180 10037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.006s
W20260709 13:16:44.858703 10040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.000s	sys 0.015s
I20260709 13:16:44.807977 12272 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:44.861588 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:44.861591 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:44.859969 12288 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:16:44.851506 12174 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:44.855703 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68555.7us
I20260709 13:16:44.900219 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:44.907867 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.914256 10180 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:44.859997 12187 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.924280 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.915992 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:44.859656 11742 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:16:44.857372 12189 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.077193 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1137) took 1998 ms. Trace:
I20260709 13:16:45.077411 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:44.957829 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 104589us
I20260709 13:16:44.947309 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:44.958431 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1150) took 1571 ms. Trace:
W20260709 13:16:45.011703 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.072711 10038 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:45.046247 10187 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:44.927012 10039 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:44.925458 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.092346 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.092983 10035 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:45.078841 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83394.5us
I20260709 13:16:45.097990 10034 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.083592 10106 rpcz_store.cc:276] 0709 13:16:43.386907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.184234 (+797327us) service_pool.cc:224] Handling call
0709 13:16:44.184608 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.184840 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:44.185179 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.958058 (+772879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.958119 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.958171 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.958242 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.958370 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":645,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":93660,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"thread_start_us":772437,"threads_started":2}
W20260709 13:16:45.114867 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 190654us
W20260709 13:16:45.085422 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 163900us
I20260709 13:16:45.086802 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.133894 10034 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:45.139010 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.263566 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 395) took 2544 ms. Trace:
I20260709 13:16:45.283381 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:45.262113 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 183221us
I20260709 13:16:45.287021 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:45.285984 10181 rpcz_store.cc:276] 0709 13:16:42.719487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.874665 (+1155178us) service_pool.cc:224] Handling call
0709 13:16:43.875010 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.875241 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:44.132468 (+257227us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.815629 (+683161us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b180023ab80. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:16:45.263203 (+447574us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.263264 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:45.263313 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.263379 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.263502 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301684,"prepare.queue_time_us":257011,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":42,"raft.queue_time_us":302290,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":209607040,"thread_start_us":145609,"threads_started":1}
I20260709 13:16:44.929425 12282 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:44.980118 12247 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.147715 10035 raft_consensus.cc:2410] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:44.952349 10183 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:45.290004 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.081303 12201 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.135638 12241 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.185s
I20260709 13:16:45.009404 12305 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.303s
W20260709 13:16:45.215701 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 129005us
I20260709 13:16:45.088526 12272 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.288692 12282 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.010957 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:45.285032 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 189624us
I20260709 13:16:45.088761 12174 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.294839 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.296197 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.295650 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:44.952369 12162 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:44.927577 12286 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:16:45.298161 11588 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:45.220067 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 136810us
W20260709 13:16:45.263365 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.136495 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:45.135704 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:45.301586 10187 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:45.288446 12247 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.291090 10035 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:45.306563 12247 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.293036 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.309046 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.313072 12272 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:45.318607 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.322873 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.329789 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.332916 10035 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:44.927084 12281 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:45.077608 10112 rpcz_store.cc:276] 0709 13:16:43.079259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.789609 (+710350us) service_pool.cc:224] Handling call
0709 13:16:43.799007 (+  9398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.799223 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:44.670425 (+871202us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.076876 (+406451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.076925 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:45.076965 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.077028 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.077137 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":359942,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":156724,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":21278,"thread_start_us":1263342,"threads_started":3,"wal-append.queue_time_us":381216}
I20260709 13:16:45.341848 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.342550 10039 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:45.216410 11568 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.330933 11588 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:45.347194 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52477.2us
W20260709 13:16:45.351950 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67853.4us
I20260709 13:16:45.352911 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:45.262617 12307 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:16:45.355736 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.357152 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.225337 12159 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.369657 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 76711.2us
I20260709 13:16:45.159947 12188 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.379020 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.380662 10039 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.366640 12247 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:45.408069 12249 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:45.269042 12313 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:45.407840 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.359105 12293 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:45.333986 12187 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:45.376753 12159 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:45.417699 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69713.1us
I20260709 13:16:45.262426 12314 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
W20260709 13:16:45.418702 12281 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:45.382100 10035 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:45.472823 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.419754 12315 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:45.358688 11568 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.418298 12241 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:16:45.423430 10033 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:45.456756 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.471381 10180 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:45.431056 10034 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:45.475991 12294 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.492638 12294 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.493031 12294 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:45.493927 12294 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.495105 12294 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.438577 11874 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.496043 11874 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.496546 11874 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.473846 10035 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:45.497900 12189 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.498592 11874 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:45.498775 12311 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:45.499104 10035 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:45.501027 10035 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:45.430150 12188 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:16:45.502880 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 626) took 1041 ms. Trace:
I20260709 13:16:45.503443 10035 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:16:45.502205 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45629us
I20260709 13:16:45.505764 10035 pending_rounds.cc:85] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 1
I20260709 13:16:45.506083 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.506131 10035 pending_rounds.cc:107] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:45.470988 12310 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.476281 12315 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:45.509071 10035 raft_consensus.cc:2889] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.435665 12293 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.517140 10039 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:45.517802 12162 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:45.509277 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 156472us
I20260709 13:16:45.509963 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.521248 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:45.524868 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 225623us
I20260709 13:16:45.439174 12249 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:16:45.527969 11799 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:45.528525 11799 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.530925 11799 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.531384 11799 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:45.507500 11874 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.534737 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:45.579663 12318 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:16:45.557590 12308 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 13:16:45.630682 12322 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:16:45.518797 12310 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.804884 12310 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.805709 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:45.806095 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.807307 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.808127 10036 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:45.808862 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.809990 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 324) took 1474 ms. Trace:
I20260709 13:16:45.810380 10108 rpcz_store.cc:276] 0709 13:16:44.335870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.340364 (+  4494us) service_pool.cc:224] Handling call
0709 13:16:44.340650 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.387708 (+ 47058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.387754 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.387795 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.387825 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.809767 (+1421942us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400362c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:45.809813 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.809927 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107754880}
I20260709 13:16:45.804790 12249 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.812639 12249 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:45.813441 12249 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.814066 12107 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:45.816679 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:45.816917 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:45.817482 10714 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:45.675093 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.818948 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.518088 12315 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.820915 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:45.821154 12315 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.824524 12254 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.825044 12254 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.826133 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.826704 10035 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:45.827051 12254 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.827215 10714 raft_consensus.cc:2410] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:45.827844 10035 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:45.533540 11799 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.827986 12248 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:45.828558 12248 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.830008 11799 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.830600 12248 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:45.700316 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 305106us
I20260709 13:16:45.835268 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:45.835976 10108 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:45.780495 11588 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.838552 11588 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.781235 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.781589 11568 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.782470 10038 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:45.782950 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1016) took 3288 ms. Trace:
I20260709 13:16:45.784065 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:45.784361 12208 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:45.784081 11982 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:45.856498 11982 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:45.856900 11938 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.851552 10186 rpcz_store.cc:276] 0709 13:16:42.494709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.381646 (+886937us) service_pool.cc:224] Handling call
0709 13:16:43.389322 (+  7676us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.399890 (+ 10568us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:43.557934 (+158044us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.698791 (+1140857us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.699326 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.699464 (+   138us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:44.705843 (+  6379us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.707672 (+  1829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.707766 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.495290 (+787524us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180030d600. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:16:45.782716 (+287426us) raft_consensus.cc:1685] finished
0709 13:16:45.782742 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.782886 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11633,"prepare.queue_time_us":406779,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":9592,"raft.queue_time_us":14051,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":47985,"spinlock_wait_cycles":9841664,"thread_start_us":1076786,"threads_started":2,"wal-append.queue_time_us":1181535}
I20260709 13:16:45.827558 12254 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.578275 12162 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.864451 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:45.785339 12168 consensus_meta.cc:287] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.998s	user 0.017s	sys 0.000s
I20260709 13:16:45.785526 10033 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:45.786298 12159 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.784147 12188 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.515945 12326 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:45.791697 12201 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:45.792830 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2230) took 1802 ms. Trace:
I20260709 13:16:45.859477 12329 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.874416 10037 rpcz_store.cc:276] 0709 13:16:43.990040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.231507 (+241467us) service_pool.cc:224] Handling call
0709 13:16:44.231847 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.917270 (+685423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.917303 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.922678 (+  5375us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.075910 (+153232us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:45.075948 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.086354 (+ 10406us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.792642 (+706288us) raft_consensus.cc:1685] finished
0709 13:16:45.792661 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.792775 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6873,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":834312,"threads_started":2,"wal-append.queue_time_us":574726}
I20260709 13:16:45.791527 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2228) took 1970 ms. Trace:
I20260709 13:16:45.505626 10710 rpcz_store.cc:276] 0709 13:16:44.461973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.464247 (+  2274us) service_pool.cc:224] Handling call
0709 13:16:45.049672 (+585425us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:45.049878 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.050260 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.050291 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.050818 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.283257 (+232439us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:45.335886 (+ 52629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.349538 (+ 13652us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.499981 (+150443us) raft_consensus.cc:1685] finished
0709 13:16:45.501616 (+  1635us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.502813 (+  1197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1159,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5544,"spinlock_wait_cycles":29582208,"thread_start_us":83742,"threads_started":1,"wal-append.queue_time_us":372067}
I20260709 13:16:45.852106 10039 raft_consensus.cc:2376] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7. Re-sending same reply.
I20260709 13:16:45.853641 12332 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:45.854163 12294 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.854277 12327 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:45.853976 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72808.5us
I20260709 13:16:45.882829 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.855144 11874 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:45.860466 11588 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.862730 12268 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:45.836279 12107 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:16:45.791787 12325 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.827874 11742 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:45.857442 11982 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.848856 12241 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.858235 12208 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:45.868639 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:45.877279 10040 rpcz_store.cc:276] 0709 13:16:43.820871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.228801 (+407930us) service_pool.cc:224] Handling call
0709 13:16:44.229154 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.917841 (+688687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.917871 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.076495 (+158624us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.489455 (+412960us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:45.489492 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.489564 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.791304 (+301740us) raft_consensus.cc:1685] finished
0709 13:16:45.791325 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.791464 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9343,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":892296,"threads_started":2,"wal-append.queue_time_us":354159}
I20260709 13:16:45.868507 12168 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.869046 12247 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.886487 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.781418 12174 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.879045 12201 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.873441 12326 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:45.864843 12254 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.885855 11938 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.888031 12268 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:45.902155 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.904348 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:45.902647 12262 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.044s	user 0.012s	sys 0.008s
I20260709 13:16:45.909853 11588 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.912283 10182 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:45.885362 12294 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.892925 12296 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.917930 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.881415 12329 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.883752 12332 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.889535 11874 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:45.922580 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 90623.8us
I20260709 13:16:45.920827 11588 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.894217 11742 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.924923 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.904321 11982 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.906131 12188 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:45.906481 12326 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.907109 12293 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.931362 11588 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.920437 12187 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.897243 12241 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.932281 12344 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.932199 12208 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.935412 10003 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.956874 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.957945 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.959070 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:45.938787 12189 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:45.939292 11972 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.939756 12294 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.945077 12332 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.949613 12168 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.952335 11874 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.926826 12327 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:45.904204 12247 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.936168 12188 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.961165 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:45.961902 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57652us
I20260709 13:16:45.962010 12347 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:45.919919 11938 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.925310 12262 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:45.963534 12022 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.009s
I20260709 13:16:45.982338 12022 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:45.984413 12022 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.960053 12187 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.968273 12254 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.969250 12174 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.970430 12241 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.946168 12296 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.988437 12329 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.972043 11742 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:45.962782 12268 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:45.962646 12293 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:45.974416 12208 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.978025 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:45.978138 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:45.959829 12336 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:45.975330 12327 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:45.980556 12247 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:45.981003 10180 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:45.981885 12262 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.005755 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:45.993541 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:45.990218 11874 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.006704 10187 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.996629 10185 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:45.997130 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:45.998425 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:45.975221 12189 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.008996 10186 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:45.976889 12188 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.980567 11938 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:45.992480 12347 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:46.008047 10181 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:46.012679 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:46.018671 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:46.022505 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.023873 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.005992 12346 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.006424 12293 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:46.030539 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.006280 12327 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.012403 12332 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.034022 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.034889 10185 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.038887 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1010) took 3805 ms. Trace:
I20260709 13:16:46.039352 10183 rpcz_store.cc:276] 0709 13:16:42.233870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.056925 (+823055us) service_pool.cc:224] Handling call
0709 13:16:44.255826 (+1198901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.290309 (+1034483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.973202 (+682893us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54000b4fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:46.038644 (+ 65442us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000b4fd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:46.038814 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4162205824}
I20260709 13:16:46.040832 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.042138 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.042954 10183 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.045203 12086 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:46.046908 12086 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.026031 11874 raft_consensus.cc:2764] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:16:46.048219 12342 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 13:16:46.048919 12293 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.060204 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1130) took 3016 ms. Trace:
I20260709 13:16:46.060680 10110 rpcz_store.cc:276] 0709 13:16:43.043777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.789313 (+745536us) service_pool.cc:224] Handling call
0709 13:16:43.789620 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.864167 (+1074547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.059915 (+1195748us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540017e154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:46.060110 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448618368}
W20260709 13:16:46.062589 10031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2210) took 3786 ms (client timeout 2606 ms). Trace:
W20260709 13:16:46.063081 10031 rpcz_store.cc:269] 0709 13:16:42.275992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.127735 (+851743us) service_pool.cc:224] Handling call
0709 13:16:46.062338 (+2934603us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400165654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:46.062465 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972560768}
I20260709 13:16:46.064862 12347 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.071389 12334 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.072397 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2401) took 1317 ms. Trace:
I20260709 13:16:46.074154 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.074817 10032 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:46.075022 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.075433 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.075898 12313 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.036051 12332 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.076823 12332 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.076382 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.077719 10038 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:46.078385 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.078930 10180 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:46.072778 10113 rpcz_store.cc:276] 0709 13:16:44.755021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.755187 (+   166us) service_pool.cc:224] Handling call
0709 13:16:44.755501 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.755930 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.755958 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.756555 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.854998 (+ 98443us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:44.868876 (+ 13878us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.869103 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.869180 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.068135 (+1198955us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b180032d640. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:16:46.072105 (+  3970us) raft_consensus.cc:1685] finished
0709 13:16:46.072211 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.072341 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12164,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":121533,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":3520,"spinlock_wait_cycles":21579520,"thread_start_us":98070,"threads_started":1,"wal-append.queue_time_us":189054}
I20260709 13:16:46.079700 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.080681 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.085831 10181 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:46.086651 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.087388 10111 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:46.087568 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.076841 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:46.088402 10108 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.032068 12268 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.090348 10187 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:46.092154 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:46.098510 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:46.088415 10185 raft_consensus.cc:2410] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:46.102222 10035 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.102504 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.102847 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:46.103050 10187 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:46.098479 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.090080 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:46.103847 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.104157 10109 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:46.090276 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.105013 10111 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:46.101336 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:46.113905 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.115042 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.116189 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.116989 10111 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:46.118592 10108 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:46.120196 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.120798 10040 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:46.121615 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:46.076107 12241 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.130189 10113 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:46.131316 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:46.131717 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.132349 10114 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:46.132771 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:46.126813 10035 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:46.127482 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:46.127857 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45952.2us
I20260709 13:16:46.112263 11799 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.128343 11972 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:46.129043 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.123395 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.076979 11874 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.135850 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.135713 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:46.141892 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:46.138016 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.143018 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.138646 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.145025 10107 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:46.139286 10714 raft_consensus.cc:2368] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:46.139602 10115 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:46.088275 12254 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.150631 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.124634 12208 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.162776 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.123864 12174 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.200666 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.207257 10188 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:46.208539 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.209170 10188 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:46.209293 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.210116 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.210537 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.210913 10188 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 3: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.135015 12071 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.211602 10110 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.212611 10108 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:46.209656 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.210007 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.200294 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.119650 12315 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:16:46.279090 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.278335 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:46.336220 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.337116 10108 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:46.331138 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.141817 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:46.201617 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.136030 12328 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.332749 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.336524 10188 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.338498 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.149745 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.214745 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:46.338666 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.339473 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:46.275422 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 190770us
I20260709 13:16:46.216007 10714 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:46.339380 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.338109 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.366637 10108 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:46.341195 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.367334 10113 raft_consensus.cc:2368] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:46.204281 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.366938 10036 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:46.368013 10184 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.345547 10035 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:46.368372 10107 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 3: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.076416 12313 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.370932 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.371897 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.372740 10184 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:46.369190 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.343420 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:46.341594 10031 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:46.378139 10188 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:46.378368 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.379148 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.366824 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:46.369366 10035 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:46.381909 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:46.368018 10036 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:46.211781 12304 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.204628 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:46.384030 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 251333us
I20260709 13:16:46.100423 12334 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.384574 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:46.151994 11874 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.393028 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.393685 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:16:46.399909 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56549.7us
I20260709 13:16:46.401139 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:46.212903 12344 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 13:16:46.379634 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:46.278111 12314 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.141320 11799 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.408516 10004 leader_election.cc:400] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:46.408932 10004 leader_election.cc:403] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.409965 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.385257 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:46.138569 12241 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.214632 12352 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:16:46.216385 11982 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 13:16:46.364473 12305 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.390465 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:46.425071 10184 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.407816  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.403409 10032 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:46.416538 10111 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:46.376240 12247 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.384997 10033 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:46.207824 12254 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.212918 12326 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:46.418641 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 217246us
I20260709 13:16:46.281001 12174 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.485766 10184 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:46.148506 12312 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.270s
I20260709 13:16:46.424127 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:46.213477 12208 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.411697 10004 leader_election.cc:400] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
W20260709 13:16:46.492328 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 68374.6us
W20260709 13:16:46.492615 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 81056.8us
I20260709 13:16:46.391436 12325 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.493481 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:46.494352 10040 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.399802 11972 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:46.372033 12162 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:46.505448 10184 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:46.445312 12310 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:46.526320 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 125243us
I20260709 13:16:46.423234 12272 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:46.476061 12189 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.414356 12336 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.528568 12272 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.529073 12272 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.529567 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.406667 12187 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:46.503445 12296 consensus_meta.cc:287] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:16:46.419281 12293 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.412640 12294 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.495905 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:46.530943 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:46.541569 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 45746.5us
I20260709 13:16:46.542850 10040 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:46.499687 10180 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.544952 10180 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:46.500567 10182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1312) took 1850 ms (client timeout 2352 ms). Trace:
I20260709 13:16:46.501276 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.435916 12315 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:46.555160 10115 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:16:46.493803 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:46.558456 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:46.535233 12306 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:46.443797 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.509722 12314 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:46.512105 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.507155 11972 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.512701 12208 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:46.513501 10188 raft_consensus.cc:2410] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:46.514868 12241 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:46.516418 12327 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.554996 12315 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:46.480398 12353 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.518519 12174 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.519992 12254 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.520434 10031 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:46.520627 12305 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:46.523097 12326 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:46.488708 12345 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:46.618785 12345 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:46.619772 12345 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.620841 12345 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.495407 12247 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.624097 12247 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.626318 12247 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.525157 12329 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.626859 12329 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:46.627418 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.627666 12329 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.628732 12329 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:46.631091 12201 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.002s
I20260709 13:16:46.480686 12262 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.465703 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:46.502475 12364 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:16:46.533733 10186 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:46.498042 12312 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:16:46.507864 12356 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:16:46.633375 11972 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:46.536325 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:46.546851 10182 rpcz_store.cc:269] 0709 13:16:44.649927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.650761 (+   834us) service_pool.cc:224] Handling call
0709 13:16:46.500348 (+1849587us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003f0054. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:46.500488 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786114432}
I20260709 13:16:46.634120 10186 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:46.634883 10182 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.635299 10186 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.587954 12367 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.602310 12314 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:46.516278 12313 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.639019 12304 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.507630 10184 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:46.541363 12293 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.644886 12293 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.571638 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.646790 10114 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
W20260709 13:16:46.648141 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 111909us
I20260709 13:16:46.649237 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:46.620671 12355 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.504773 12188 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.548058 11938 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:46.575280 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 63264.5us
I20260709 13:16:46.657027 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:46.512301 12334 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:46.517765 11874 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:46.533209 12187 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.665989 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:46.572549 12306 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:46.571897 12221 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.605324 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 238565us
I20260709 13:16:46.671132 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.628091 10115 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:46.638176 12314 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:16:46.564950 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71224us
W20260709 13:16:46.649385 12332 consensus_meta.cc:287] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.003s
I20260709 13:16:46.540383 12310 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:46.540405 12296 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.650136 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:46.652833 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.594082 12268 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.601275 12208 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.660224 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:46.661077 10078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.023s
I20260709 13:16:46.604054 12353 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:46.611239 10033 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:46.638115 12249 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.639817 11742 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.639415 12304 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:46.655186 12355 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:46.672672 12368 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:46.690160 10078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.024s
I20260709 13:16:46.631569 12201 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:46.687016 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.713745 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.682746 12159 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:46.692621 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 439983us
I20260709 13:16:46.690888 12262 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.688954 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.678784 12039 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:46.709501 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 619461us
I20260709 13:16:46.682369 12334 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:46.685196 12241 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:16:46.668395 12373 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.755481 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.704650 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.718776 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:46.719365 10109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.009s
I20260709 13:16:46.685434 12312 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:46.686957 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.721872 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:46.673115 12221 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.728184 10186 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.730440 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:46.684223 12332 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.718138 12107 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.693888 12370 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:16:46.731181 10115 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 3: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:46.733971 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.673588 12315 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:46.759532 10109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.010s
I20260709 13:16:46.727376 12368 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:46.764228 10182 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.720754 12262 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.694208 12268 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.798408 10184 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:46.736011 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.772580 10186 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:46.799759 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63833.6us
I20260709 13:16:46.800990 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:46.802217 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:46.773651 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.732059 12039 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:46.696786 12208 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:46.707515 11742 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:46.843588 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:46.838726 10115 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:46.763720 12373 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:46.722427 12366 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.691781 12353 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.797032 12262 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:46.857800 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 127564us
I20260709 13:16:46.771298 12022 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.766855 12086 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:16:46.843655 11938 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:46.767366 12374 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 13:16:46.719806 12306 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:46.905417 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.843523 12039 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.900735 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:46.909469 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 151889us
I20260709 13:16:46.958437 10114 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:46.893060 12282 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.790552 12344 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:16:46.845968 12326 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.920624 12296 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.998395 10707 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:46.956106 12309 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:46.932945 12071 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.934548 12159 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:46.860852 12373 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.006294 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.850729 12347 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.896207 12327 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:46.938373 11938 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:46.788739 12107 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.991659 12168 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.934291 12188 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:46.998317 12306 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.792716 12355 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.024562 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:46.834908 12304 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:46.997835 12187 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:47.048645 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 246479us
I20260709 13:16:47.090888 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.092554 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:46.855028 12382 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 13:16:47.035804 12375 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:47.100253 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.855598 12310 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.080178 10036 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.072124 11938 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.104471 10036 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.109892 10034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:34120
W20260709 13:16:47.111035 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 110591us
I20260709 13:16:47.114223 12262 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.052868 12159 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:46.993525 12379 consensus_queue.cc:1175] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a67604b91f54791b1316fd327793337" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
W20260709 13:16:47.106685 12388 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:16:47.099727 12188 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.099535 12327 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.026398 12296 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.131908 12268 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:47.104619 12358 consensus_queue.cc:1175] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:16:47.123813 12355 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.000651 12368 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.116297 12221 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:47.139241 12345 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.003s
W20260709 13:16:47.187970 12384 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:16:47.191414 12329 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.003s
I20260709 13:16:47.192652 12346 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:47.196919 12293 consensus_meta.cc:287] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 13:16:47.132262 12332 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:47.105132 12375 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.215565 12375 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.149626 12397 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.143357 12387 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:16:47.142839 12272 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.003s
W20260709 13:16:47.146922 12336 consensus_meta.cc:287] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.000s
I20260709 13:16:47.199939 11742 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:47.201799 12346 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:47.207872 12293 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.167927 12208 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.135715 12086 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:47.191476 11799 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.236440 12039 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.262848 12159 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.263833 12039 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:47.251401 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 517469us
I20260709 13:16:47.172883 12107 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:47.147104 11982 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:16:47.263877 12346 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.265821 12346 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:47.272308 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.255808 12336 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6.
I20260709 13:16:47.255944 12272 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.280633 12272 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.282560 12373 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.283704 10182 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:47.283910 10187 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.286108 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1050) took 1256 ms. Trace:
I20260709 13:16:47.286489 10183 rpcz_store.cc:276] 0709 13:16:46.029774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.606027 (+576253us) service_pool.cc:224] Handling call
0709 13:16:46.606413 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.606753 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.606781 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.653613 (+ 46832us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.857479 (+203866us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:46.857584 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.857710 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.285874 (+428164us) raft_consensus.cc:1685] finished
0709 13:16:47.285896 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.286045 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14713,"raft.queue_time_us":1174,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":36682,"thread_start_us":179850,"threads_started":1,"wal-append.queue_time_us":585245}
I20260709 13:16:47.290031 11938 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.293030 12296 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:47.298072 12293 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:47.249243 12397 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.300983 12397 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:47.301837 12394 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:16:47.304577 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.304796 12022 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.305541 12022 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.305996 12374 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.306685 12354 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:47.307060 12354 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:47.307842 12354 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.308427 12159 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.309754 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2407) took 1225 ms. Trace:
I20260709 13:16:47.310119 12282 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:47.310613 12282 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:47.310811 12249 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.007s
I20260709 13:16:47.310954 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:47.311589 10112 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:16:47.311702 11742 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.311947 10112 pending_rounds.cc:85] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:16:47.312225 10112 pending_rounds.cc:107] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:16:47.312450 10112 raft_consensus.cc:2889] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.312829 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.313026 12168 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:47.314038 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.310159 10106 rpcz_store.cc:276] 0709 13:16:46.084456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.084568 (+   112us) service_pool.cc:224] Handling call
0709 13:16:46.129394 (+ 44826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.412018 (+282624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.412050 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.412905 (+   855us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.719155 (+306250us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:46.719191 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.719257 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.309500 (+590243us) raft_consensus.cc:1685] finished
0709 13:16:47.309521 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.309661 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4506,"raft.queue_time_us":243406,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12872,"thread_start_us":516754,"threads_started":2,"wal-append.queue_time_us":693540}
I20260709 13:16:47.313481 12168 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.325749 12397 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.328457 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:47.330245 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.261059 12086 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:47.325687 12272 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.362166 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.348739 11742 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.365710 12086 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.366410 12071 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.367115 12086 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.370049 10716 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:47.371838 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.373639 10709 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.393879 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2405) took 1316 ms. Trace:
I20260709 13:16:47.380151 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.389786 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:47.417990 10112 rpcz_store.cc:276] 0709 13:16:46.077128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.080074 (+  2946us) service_pool.cc:224] Handling call
0709 13:16:46.080335 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.312880 (+1232545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.393643 (+ 80763us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540022bad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:47.393816 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2830940544}
I20260709 13:16:47.393142 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 420) took 1401 ms. Trace:
I20260709 13:16:47.407091 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2246) took 1309 ms. Trace:
I20260709 13:16:47.419481 10187 rpcz_store.cc:276] 0709 13:16:45.991845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.502647 (+510802us) service_pool.cc:224] Handling call
0709 13:16:46.502918 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.284293 (+781375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.392867 (+108574us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54002d37d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:47.393074 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795794688}
I20260709 13:16:47.382571 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:47.409509 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1164) took 1199 ms. Trace:
I20260709 13:16:47.421725 10109 rpcz_store.cc:276] 0709 13:16:46.209842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.210141 (+   299us) service_pool.cc:224] Handling call
0709 13:16:46.210438 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.771285 (+560847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.771321 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.771845 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.894758 (+122913us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.897801 (+  3043us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.408849 (+511048us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b180020f9e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:16:47.409056 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.409147 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.409192 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:47.409297 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.409441 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2339,"prepare.queue_time_us":3583,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3559,"raft.queue_time_us":189618,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12429,"spinlock_wait_cycles":7301376,"thread_start_us":682759,"threads_started":2,"wal-append.queue_time_us":430299}
I20260709 13:16:47.378415 10106 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:47.391145 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.425434 10108 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:47.384694 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:47.433873 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.434114 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.436115 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.350927 12397 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.439270 10106 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:47.437172 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.419020 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.380903 10114 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:47.464433 10112 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:47.419629 10035 rpcz_store.cc:276] 0709 13:16:46.097255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.380863 (+283608us) service_pool.cc:224] Handling call
0709 13:16:46.381164 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.669368 (+288204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.669399 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.669442 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:46.669472 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.406808 (+737336us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400156dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:47.406863 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.407020 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25043,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":93020928,"thread_start_us":247329,"threads_started":1}
I20260709 13:16:47.471038 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.471999 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.481657 10109 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.474711 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.375571 12188 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.485918 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.381206 12373 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.361373 12262 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.399667 12268 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:47.408555 12329 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:47.488112 12293 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.440261 12365 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.400832 11938 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:47.406701 12326 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.492992 12168 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.510622 12391 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.405965 10711 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:47.537083 10034 raft_consensus.cc:606] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:47.537560 10034 raft_consensus.cc:614] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:47.404569 12201 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.382179 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.400084 12366 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:47.456666 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.463253 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 508488us
W20260709 13:16:47.446242 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 95470.5us
W20260709 13:16:47.509193 10181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.014s	sys 0.046s
I20260709 13:16:47.463212 12374 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:47.511092 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 425739us
I20260709 13:16:47.516237 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:47.523128 12262 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.496424 12282 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.463855 11972 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:47.521852 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.523692 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.581414 10183 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.524833 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.582461 10184 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:47.525887 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.583571 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.584355 10185 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:47.508950 12252 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.530665 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.497249 10110 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:47.509686 12162 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:47.510170 12188 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.534639 12168 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.511861 12355 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:47.536363 12395 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.512004 12268 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:47.550927 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:47.596930 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.597469 10186 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:47.551836 10033 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:16:47.554143 10181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.014s	sys 0.046s
I20260709 13:16:47.598413 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1039) took 1607 ms. Trace:
I20260709 13:16:47.599890 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.556805 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.557144 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:47.560925 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44791.5us
I20260709 13:16:47.555068 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:47.516842 10109 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:47.601384 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.517412 12296 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:47.578784 11588 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.602312 11588 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.519197 12329 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.575898 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 632) took 1356 ms. Trace:
I20260709 13:16:47.586449 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:47.589318 10180 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:47.591799 10107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.016s	sys 0.023s
I20260709 13:16:47.622783 10184 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:47.593230 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.593364 10185 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:47.559852 12366 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.601320 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:47.598780 10181 rpcz_store.cc:276] 0709 13:16:45.990931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.414004 (+423073us) service_pool.cc:224] Handling call
0709 13:16:46.445544 (+ 31540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.445808 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:46.668149 (+222341us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.598052 (+929903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.598115 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:47.598162 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.598228 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.598352 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273798,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":19949,"raft.queue_time_us":333984,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":1115370,"threads_started":3,"wal-append.queue_time_us":329896}
I20260709 13:16:47.556514 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:47.603438 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48476.8us
I20260709 13:16:47.636915 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.638269 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:47.576131 12336 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.602588 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.640338 10035 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:47.641376 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.576218 12201 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.632596 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:47.586449 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:47.645125 10039 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:47.612404 12374 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.548929 12391 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.602954 12395 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.595793 12241 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.617292 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:47.618651 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 278) took 1107 ms. Trace:
W20260709 13:16:47.623076 10107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.016s	sys 0.023s
I20260709 13:16:47.625998 11588 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.604483 11938 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.649142 10038 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:47.595954 12328 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.654510 10081 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:47.588011 12373 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:16:47.661185 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:16:47.662632 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.014s	sys 0.065s
W20260709 13:16:47.663026 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.015s	sys 0.065s
I20260709 13:16:47.665187 10037 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:16:47.671239 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:16:47.671613 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.596578 12162 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.672431 10034 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:47.648928 12247 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:47.671896 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 92875us
I20260709 13:16:47.643914 12336 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:47.652280 12332 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.650768 12403 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.602018 12355 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.604241 12262 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.656294 12379 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.592610 12252 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.655318 12201 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.685757 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.685879 10185 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:47.699121 10181 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:47.650328 12296 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:47.649154 12375 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:47.700743 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.649211 12188 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:47.724718 12188 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:47.725098 12188 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:47.725845 12188 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.726527 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.727154 10115 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.727859 12354 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.692652 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.728789 10040 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:47.729408 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.730269 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.730500 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.730964 10112 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:47.730449 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:47.731484 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.732102 10114 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.731037 10707 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:47.732915 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:47.730134 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.732844 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.734551 10715 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:47.736042 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1337) took 1714 ms. Trace:
I20260709 13:16:47.736373 10189 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:47.736756 10189 pending_rounds.cc:85] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 2
I20260709 13:16:47.736960 10189 pending_rounds.cc:107] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:47.737167 10189 raft_consensus.cc:2889] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.736388 10188 rpcz_store.cc:276] 0709 13:16:46.021307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.378876 (+357569us) service_pool.cc:224] Handling call
0709 13:16:47.735858 (+1356982us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002d8cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:47.735977 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306810112}
I20260709 13:16:47.740600 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.682492 10183 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:47.695660 12377 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.695873 12408 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.678368 12332 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:47.678498 12336 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.697062 12404 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:47.697378 12329 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.696034 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.700090 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.768805 10184 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:47.770296 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.771363 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.703100 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.703820 12314 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.621852 10711 rpcz_store.cc:276] 0709 13:16:46.205335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.211245 (+  5910us) service_pool.cc:224] Handling call
0709 13:16:47.405324 (+1194079us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:47.405574 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.537030 (+131456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.561947 (+ 24917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17387776}
I20260709 13:16:47.704702 12282 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.656373 10032 rpcz_store.cc:276] 0709 13:16:46.511493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.519650 (+  8157us) service_pool.cc:224] Handling call
0709 13:16:46.520045 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.698924 (+178879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.704697 (+  5773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.708455 (+  3758us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.715389 (+  6934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.618380 (+902991us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400066dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:47.618433 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.618587 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379052288}
I20260709 13:16:47.705958 12396 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.707469 12395 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.678117 12268 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.678628 12247 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:47.709312 12162 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.660467 12241 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.710022 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.713032 12355 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.713485 10039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2398a1470b87449dab93ba045655ca29"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:47.715241 10038 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:47.703774 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.717015 12391 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.691116 12382 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:47.684865 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:47.720050 12252 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.722383 12201 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.664171 12328 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.727034 12188 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.745446 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.683733 12344 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:16:47.748503 10185 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:47.689913 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.773321 10184 raft_consensus.cc:2376] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4. Re-sending same reply.
I20260709 13:16:47.775619 10114 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:16:47.847440 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:47.848397 10184 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:16:47.778157 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 273759us
W20260709 13:16:47.849102 10078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.366s (SENT) [suppressed 28 similar messages]
I20260709 13:16:47.782666 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.732692 12189 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.751395 12406 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:16:47.728359 11938 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:16:47.729138 12187 consensus_queue.cc:1175] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 13:16:47.793257 10180 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:47.793831 12329 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.763370 12398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.027s	sys 0.035s
I20260709 13:16:47.795435 12262 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:47.739763 12312 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:47.805775 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 75704.2us
I20260709 13:16:47.768821 12332 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.815776 11742 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.816431 12403 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:47.816603 12353 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.817574 12304 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.743896 12370 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:16:47.768353 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:47.782619 12375 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:47.830121 10039 raft_consensus.cc:606] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.916251 10039 raft_consensus.cc:614] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:47.825146 10110 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:47.830678 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.832015 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.918010 10038 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:47.826839 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.740063 12313 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:16:47.846429 10107 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:47.735435 12379 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:16:47.860698 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 115349us
I20260709 13:16:47.926484 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:47.927093 11938 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.927788 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:47.821408 12247 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.929975 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1041) took 1938 ms. Trace:
I20260709 13:16:47.930390 10189 rpcz_store.cc:276] 0709 13:16:45.991421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.496098 (+504677us) service_pool.cc:224] Handling call
0709 13:16:47.736016 (+1239918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.741914 (+  5898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.929734 (+187820us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002d8cd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:47.929906 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850941312}
W20260709 13:16:47.862098 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 217132us
I20260709 13:16:47.932248 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:47.863885 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.864655 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:47.871439 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2241) took 1780 ms. Trace:
I20260709 13:16:47.935575 12296 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.823709 12408 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:47.935914 10036 rpcz_store.cc:276] 0709 13:16:46.091454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.366561 (+275107us) service_pool.cc:224] Handling call
0709 13:16:46.366832 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.079792 (+712960us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b540012e1a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f46606f 00007f3c6f4def60 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62
0709 13:16:47.245761 (+165969us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:47.398601 (+152840us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b180047ca40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:16:47.631633 (+233032us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.871027 (+239394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:47.871085 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:47.871137 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.871233 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.871371 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":584911,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":5592,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":20937,"spinlock_wait_cycles":15504512,"thread_start_us":610974,"threads_started":2}
I20260709 13:16:47.937601 12408 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.936127 12296 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:47.940543 12296 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.792237 12407 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:16:47.942781 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.943431 10711 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:47.944573 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.801236 12314 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.895475 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:47.945845 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:47.946507 10707 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:47.899377 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:47.880084 12398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.027s	sys 0.036s
I20260709 13:16:47.869750 12252 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.947563 12252 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.870404 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:47.871645 12201 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.948664 12187 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:47.949265 12187 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:47.950146 12187 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:47.950671 12252 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:47.951396 10112 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:47.907348 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:47.924820 12390 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:47.952296 12390 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:47.952692 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.953518 12201 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.953184 12390 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.953908 12201 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:47.837574 12382 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.954423 12201 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.950977 12247 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.954870 12162 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.955704 12162 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.956447 12247 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.909315 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:47.957015 12247 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:47.957345 10108 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
W20260709 13:16:47.948202 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.955924 10111 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:47.948585 10032 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:47.923583 10040 pending_rounds.cc:85] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 4
I20260709 13:16:47.972506 10040 pending_rounds.cc:107] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:16:47.973057 10040 raft_consensus.cc:2889] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.909475 12315 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.954653 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:47.908910 12403 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:47.894533 12329 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:47.985765 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 78482.5us
I20260709 13:16:47.992080 10115 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:47.960224 12358 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.970420 12370 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:47.954493 12390 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.009949 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:48.018922 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 154361us
W20260709 13:16:48.021937 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.022864 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:48.024832 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:48.026419 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:47.954206 12296 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.945876 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:47.909811 12312 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.004527 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:48.040747 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:48.031890 11588 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.042316 11588 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.980646 12382 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.042711 11588 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.033752 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:48.191576 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 157687us
I20260709 13:16:48.194809 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:48.196928 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:48.197685 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 243018us
I20260709 13:16:48.199360 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:48.201236 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 178355us
I20260709 13:16:48.204448 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:48.208297 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 183423us
I20260709 13:16:48.210929 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:48.044653 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 639) took 1072 ms. Trace:
W20260709 13:16:48.216251 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.214366 10710 rpcz_store.cc:276] 0709 13:16:46.969899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.992921 (+ 23022us) service_pool.cc:224] Handling call
0709 13:16:47.069096 (+ 76175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.087229 (+ 18133us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:47.505595 (+418366us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.989796 (+484201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.010999 (+ 21203us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:48.016396 (+  5397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.023439 (+  7043us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.041723 (+ 18284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119043,"prepare.queue_time_us":557880,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":128333,"spinlock_wait_cycles":10213120,"thread_start_us":698232,"threads_started":2,"wal-append.queue_time_us":477486}
I20260709 13:16:47.915267 11742 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.025735 11799 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.266866 11799 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.968919 11938 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.055764 12039 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:48.011317 12086 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:48.025913 12189 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.340449 12189 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.036366 12221 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.344208 12221 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.344653 12221 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.072528 12241 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.058818 12312 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.049882 12314 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.993553 12327 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.081723 12328 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.049029 12344 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.350065 11742 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.043885 12350 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.019857 12358 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.352102 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:48.353291 12039 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.354185 12358 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.307410 12201 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:47.988579 12366 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.113626 12374 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:48.356580 12201 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:47.974606 12375 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.357970 12366 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.359310 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:48.360234 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:48.351688 12350 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.360739 10033 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:48.361066 10186 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:48.047721 12411 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.360738 10037 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:48.362600 12350 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:48.057934 12414 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:16:48.363308 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:48.057267 12416 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
W20260709 13:16:48.056640 12417 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:16:48.102442 12293 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.003s
I20260709 13:16:48.368278 12293 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.235306 12326 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:48.236608 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.237327 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:48.240371 12262 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.369751 12262 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:48.369843 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 138013us
I20260709 13:16:48.241416 12310 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.370179 12262 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.348834 12086 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:48.400645 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 189986us
I20260709 13:16:48.400894 12086 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.240833 12395 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:48.123389 12332 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.246263 12354 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:48.154991 12382 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.247421 12252 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.248196 12282 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:48.251327 12379 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.130980 12336 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.253743 12159 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.252408 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:48.254590 12296 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.256137 12208 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:48.257359 12370 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:48.258574 12247 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.259001 12329 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.234781 12295 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.267663 11799 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.398779 12310 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:48.303339 11938 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:48.306891 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 107898us
I20260709 13:16:48.310835 12377 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.303561 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:48.327486 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58445.1us
W20260709 13:16:48.329066 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.338729 12396 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:48.347942 12445 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.356681 10113 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:47.987236 12403 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:48.359839 12375 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.039572 12407 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:48.477927 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:48.398679 10031 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.479446 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:48.248384 12413 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:48.412889 12189 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.416409 12379 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:48.416491 12159 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:48.436728 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 103144us
I20260709 13:16:48.416196 12282 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.449379 10037 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:48.449863 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 146515us
I20260709 13:16:48.434247 12396 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:48.452075 12312 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:48.452744 12328 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:48.453389 12443 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.454201 12370 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:48.454607 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:48.495620 12379 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:48.502159 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47809.2us
I20260709 13:16:48.455092 12445 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.458362 12247 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.459204 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:48.460574 12310 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.463909 12377 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.511999 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:48.512537 10110 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:48.464838 12304 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.552s	user 0.016s	sys 0.000s
I20260709 13:16:48.450237 12354 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.515051 12354 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.515666 12401 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.468569 12221 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.469059 12382 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.472169 12039 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.483922 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:48.485124 12336 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.485450 12332 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.488822 12268 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.480484 12404 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.516294 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:48.525209 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:48.516659 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:48.511937 12377 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.498152 12159 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.530078 12295 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:48.516271 12401 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.527442 11588 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.535871 12375 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:48.564144 12375 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:48.565515 12375 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.566531 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:48.567324 10112 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:48.536315 12241 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:16:48.536999 12315 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:48.567655 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:48.569013 12039 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.538256 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:48.570423 12446 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:16:48.538573 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:48.571084 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:48.571468 10182 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:48.539186 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:48.559841 10185 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:48.541882 11982 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.542734 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:48.544117 12188 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.012s
I20260709 13:16:48.544611 12304 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.579145 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99887.8us
I20260709 13:16:48.545691 12282 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:48.546622 12442 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.498720 12413 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:48.558769 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:48.559873 10035 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:48.562124 10109 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:48.572391 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:48.539400 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 167457us
I20260709 13:16:48.560194 10710 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:48.578349 10188 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:48.576277 10108 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:48.584190 11588 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.586567 10186 raft_consensus.cc:2368] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:48.587918 12304 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.552397 12404 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:16:48.592569 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 118643us
I20260709 13:16:48.576745 12247 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.578644 11982 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.604717 11982 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.594861 10106 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.600451 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:48.606021 10112 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:48.611276 12304 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:48.613404 12221 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:48.616884 12445 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.598295 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:48.624102 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:48.624781 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:48.625398 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 109227us
I20260709 13:16:48.626353 10114 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:48.626780 10114 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:48.635157 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:48.593856 12404 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.553470 12396 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.646399 12396 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.626264 12315 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.652197 12252 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.657470 12315 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.657403 12252 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.658203 12304 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.658599 12304 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.658946 12304 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.657925 12315 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.665982 12354 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.666730 12354 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.679767 10107 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:48.695616 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:48.696395 10711 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:48.618043 12413 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.599408 12452 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:16:48.644573 12039 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:16:48.654227 12262 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.667577 12445 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.837385 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 239237us
W20260709 13:16:48.860391 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 235766us
W20260709 13:16:48.732529 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65068.8us
W20260709 13:16:48.799571 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 104661us
I20260709 13:16:48.767707 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:48.850255 10106 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:48.842926 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:48.836722 12354 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:48.842355 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:48.833949 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:34120 (request call id 22) took 1144 ms. Trace:
I20260709 13:16:48.717097 12442 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.782951 12370 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.845963 10032 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:48.943706 10039 rpcz_store.cc:276] 0709 13:16:47.689286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.713328 (+ 24042us) service_pool.cc:224] Handling call
0709 13:16:48.833482 (+1120154us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b540031c9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e2853 00007f3c744b060a 00007f3c6da367d4 00007f3c6da36762 00007f3c6da36691 00007f3c6da3660c 00007f3c6da358c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:48.833692 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17658752}
I20260709 13:16:48.699177 12405 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:48.997762 12405 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:48.846740 12295 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.722551 12314 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:48.837802 11799 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:48.755476 12188 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:48.993206 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:48.994038 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 230842us
I20260709 13:16:48.943122 12403 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.820436 12379 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:48.996955 11938 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.812321 12326 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:48.713377 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.000995 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:48.820152 12221 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.004144 12444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.004s
I20260709 13:16:49.004514 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:48.697695 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:48.996611 12454 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:16:48.993657 12252 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.002892 12314 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:49.023571 10036 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:49.029991 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 354302us
I20260709 13:16:49.011777 12370 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:49.033476 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.017431 11938 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:49.021710 12444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.005s
I20260709 13:16:49.019248 12452 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:49.035292 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.037879 11938 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.021397 12241 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:49.042586 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 96677.4us
W20260709 13:16:49.041941 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53539.9us
I20260709 13:16:48.999023 12405 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.017613 12445 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.050203 11982 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.031075 10712 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:49.045861 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.036468 12159 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.040043 10033 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:49.055879 12395 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:49.075963 12395 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.036847 12295 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.076359 12395 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:49.082405 12268 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.003s
I20260709 13:16:49.083128 12295 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.084417 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:49.083842 12453 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:16:49.040899 12221 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.089003 10715 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:49.036919 12326 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:49.090931 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.081614 12435 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.747s	user 0.004s	sys 0.000s
I20260709 13:16:49.073197 12382 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:49.100345 12405 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.101055 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:16:49.102627 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.106233 12355 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:49.107473 12355 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:49.108040 12355 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:49.108731 12443 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:49.109032 12355 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.090880 12241 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:49.111352 12365 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:49.111876 12365 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:49.112353 12456 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:16:49.111392 12241 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.112957 12365 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.114078 12365 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.114755 11799 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:49.119056 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 67557.5us
I20260709 13:16:49.120457 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.122094 12344 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.122705 12344 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:49.122561 12304 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.112480 12403 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.137405 12379 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.144279 10107 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:49.125000 12241 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.133416 12443 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.156657 10037 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 13:16:49.156476 12396 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.006s
I20260709 13:16:49.156462 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.138911 12262 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.168509 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.172200 10106 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:16:49.177801 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 106665us
I20260709 13:16:49.162949 12442 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:49.183517 10715 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:49.188277 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:49.144630 12404 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.188227 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:49.124562 12344 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.132917 12314 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.203362 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.186305 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.185735 12442 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.208993 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.192557 12304 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:49.204485 12457 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:16:49.217898 10189 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:49.220072 12382 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:49.223153 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:49.224174 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.226923 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2435) took 1501 ms. Trace:
I20260709 13:16:49.227594 12404 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.162468 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:16:49.229115 10031 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:49.229481 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.230866 10109 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:49.231251 12375 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:49.235455 10113 rpcz_store.cc:276] 0709 13:16:47.725440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.733831 (+  8391us) service_pool.cc:224] Handling call
0709 13:16:47.764035 (+ 30204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.444725 (+680690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.226631 (+781906us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54001c9654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:49.226841 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361789696}
I20260709 13:16:49.231936 12159 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:49.232769 12455 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:16:49.237345 10037 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:49.242605 10039 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.243155 10040 raft_consensus.cc:606] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:49.243530 10040 raft_consensus.cc:614] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:49.216701 12442 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.244447 10036 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
W20260709 13:16:49.234521 12315 consensus_meta.cc:287] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:16:49.247262 10711 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:49.251000 11938 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.252245 12314 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.254303 12344 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.243003 12221 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.255808 10114 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.256763 10114 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.252441 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.194612 12370 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:49.261265 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 160348us
I20260709 13:16:49.237653 12382 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.262854 12315 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.273908 10707 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:49.254300 12391 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:49.278846 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.279759 10112 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:49.280321 10113 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:16:49.281476 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.277359 10038 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:49.290421 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.272418 12366 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.301105 10114 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:49.301529 10114 pending_rounds.cc:85] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 2
I20260709 13:16:49.301829 10114 pending_rounds.cc:107] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:16:49.302130 10114 raft_consensus.cc:2889] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:49.302874 12306 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:49.304487 10034 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:49.305650 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:49.306398 10034 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:49.309572 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:49.309823 12441 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.954s	user 0.004s	sys 0.000s
I20260709 13:16:49.308540 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.285192 12189 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.301025 10711 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:49.328042 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.280023 12391 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:49.322865 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.266506 12375 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.314886 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2442) took 1280 ms. Trace:
I20260709 13:16:49.315447 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.317191 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.319326 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.319938 12315 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.321056 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.370527 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.322916 12445 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.324936 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 648) took 1291 ms. Trace:
I20260709 13:16:49.277590 12247 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.336347 12159 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:49.356124 12405 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.359036 12401 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.360968 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.362896 12329 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:49.363807 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2443) took 1060 ms. Trace:
I20260709 13:16:49.364178 12208 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.394513 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.394768 12208 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.395311 10189 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:49.395388 12221 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.396013 12221 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.397634 12208 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.327308 12241 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.367138 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:49.371207 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:49.372918 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 143553us
I20260709 13:16:49.398010 12159 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.400203 12159 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.400905 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.393554 12329 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:49.401594 12241 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.393729 10110 rpcz_store.cc:276] 0709 13:16:48.303637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.314170 (+ 10533us) service_pool.cc:224] Handling call
0709 13:16:48.323991 (+  9821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.512907 (+188916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.363538 (+850631us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001bf154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:49.363730 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432549760}
I20260709 13:16:49.372715 12268 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.402257 12241 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:49.402848 12268 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.376878 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.366138 10115 rpcz_store.cc:276] 0709 13:16:48.034492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.034655 (+   163us) service_pool.cc:224] Handling call
0709 13:16:48.035010 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.035229 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.035273 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.190685 (+155412us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.297765 (+107080us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:48.308259 (+ 10494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.310599 (+  2340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.309258 (+998659us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:49.311345 (+  2087us) raft_consensus.cc:1685] finished
0709 13:16:49.311363 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.314721 (+  3358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35965696,"thread_start_us":98366,"threads_started":1,"wal-append.queue_time_us":133589}
I20260709 13:16:49.381954 10185 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:49.384034 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.385739 12326 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.385928 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.386158 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:49.386538 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.436342 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.387375 12403 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.387830 12469 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:49.387991 10003 leader_election.cc:400] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:49.439906 10003 leader_election.cc:403] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.389130 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.391081 12395 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.391664 12310 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:49.392710 10106 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:49.441056 10186 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:49.398239 12221 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.397790 10709 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:16:49.438643 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 200054us
I20260709 13:16:49.392593 12405 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.440460 10181 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:49.443938 10108 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.445446 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 438) took 1221 ms. Trace:
I20260709 13:16:49.368736 12366 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.447203 10188 rpcz_store.cc:276] 0709 13:16:48.220646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.222328 (+  1682us) service_pool.cc:224] Handling call
0709 13:16:48.223031 (+   703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.592348 (+369317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.439676 (+847328us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002adfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:49.442035 (+  2359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808343424}
I20260709 13:16:49.451172 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:49.454444 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.392696 12304 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:16:49.461712 11588 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.462288 11588 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.464217 11588 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.464461 12404 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:49.466696 10112 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:16:49.458632 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93145.4us
I20260709 13:16:49.459273 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.443166 12188 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.443049 12310 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.441716 10032 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.470468 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.464979 12404 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.449347 12405 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.469877 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.466203 12221 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.477407 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.477543 12221 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.478016 10106 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:49.394273 12247 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.444612 12159 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:16:49.471835 12445 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.442266 12208 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:49.450034 12326 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:49.473340 12310 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.482321 10114 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:49.402472 12329 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.482827 12221 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.497416 12391 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.474308 11938 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.375449 10708 rpcz_store.cc:276] 0709 13:16:48.033411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.036071 (+  2660us) service_pool.cc:224] Handling call
0709 13:16:48.055718 (+ 19647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.362680 (+306962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.362735 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.363449 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.442763 (+ 79314us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:48.446510 (+  3747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.324265 (+877755us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54004a9cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:49.324334 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.324392 (+    58us) raft_consensus.cc:1685] finished
0709 13:16:49.324406 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.324700 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30,"raft.queue_time_us":684,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":160,"spinlock_wait_cycles":704135552,"thread_start_us":72672,"threads_started":1,"wal-append.queue_time_us":123632,"wal-append.run_cpu_time_us":2140,"wal-append.run_wall_time_us":1006072}
I20260709 13:16:49.505931 12159 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:49.509711 10181 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:49.514164 12329 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.514513 12395 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.516258 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.517280 10711 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.483696 12188 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.519863 12188 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.484632 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.520560 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.496745 12268 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.496893 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.470119 12355 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:49.520593 10184 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:49.522311 12355 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:49.523377 12355 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.524271 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.524678 12355 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.524956 10180 raft_consensus.cc:2376] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7. Re-sending same reply.
I20260709 13:16:49.526010 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.526584 10180 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:49.446110 12403 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.513438 12159 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:49.529783 12403 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.520756 12375 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.521946 10182 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:49.532850 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.507390 12442 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.505779 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.493643 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.521907 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.540102 10113 raft_consensus.cc:2368] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:49.535699 12442 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.527462 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.541544 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.543267 12404 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.545192 10108 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:49.548220 11972 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:49.548667 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.550513 10189 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:49.551628 10111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2431) took 1827 ms (client timeout 1640 ms). Trace:
I20260709 13:16:49.548727 11972 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:49.553436 11972 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.554785 11972 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.557129 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.545324 10183 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:49.560397 10187 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:49.556672 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:49.561239 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 66612.9us
I20260709 13:16:49.562129 10039 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:49.564069 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.565850 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:49.552110 10111 rpcz_store.cc:269] 0709 13:16:47.724425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.729151 (+  4726us) service_pool.cc:224] Handling call
0709 13:16:49.537488 (+1808337us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000db954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:49.551426 (+ 13938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519487872}
I20260709 13:16:49.567508 10108 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:49.565471 12375 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:49.568802 12366 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.544363 12326 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:49.635017 12465 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.556s	user 0.003s	sys 0.000s
W20260709 13:16:49.694815 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.624876 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.645141 12247 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.692345 12481 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.699712 10109 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:49.700279 12481 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.702674 12481 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.608685 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.570283 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:49.595894 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.656538 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.698156 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.580161 10114 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:16:49.571610 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 1.16807e+06us
I20260709 13:16:49.710664 10107 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:49.708041 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 137830us
I20260709 13:16:49.575655 12188 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:49.709367 11938 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:49.717727 10032 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:49.635972 12327 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.137s
W20260709 13:16:49.721057  9934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 284) took 12007 ms (client timeout 15000 ms). Trace:
I20260709 13:16:49.656819 12403 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:49.740736 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.740845 12403 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.742162 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:49.635367 12443 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.707466 12404 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.743559 12404 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.730173 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.731088  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:49.732132 10115 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:49.727160 11938 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.733908 12327 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.718704 12310 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:49.729945  9934 rpcz_store.cc:269] 0709 13:16:37.713842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.714387 (+   545us) service_pool.cc:224] Handling call
0709 13:16:49.720864 (+12006477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:45.491175 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:45.667356 (+176181us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:45.667392 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:45.667407 (+    15us) tablet.cc:662] Decoding operations
0709 13:16:45.792425 (+125018us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:45.792509 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:45.792562 (+    53us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:16:45.794831 (+  2269us) tablet.cc:701] Row locks acquired
0709 13:16:45.794855 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:16:45.795245 (+   390us) write_op.cc:270] Start()
0709 13:16:45.795510 (+   265us) write_op.cc:276] Timestamp: P: 1783603005795121 usec, L: 0
0709 13:16:45.795533 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:45.856785 (+ 61252us) log.cc:844] Serialized 6400 byte log entry
0709 13:16:46.323374 (+466589us) op_driver.cc:464] REPLICATION: finished
0709 13:16:46.572234 (+248860us) write_op.cc:301] APPLY: starting
0709 13:16:46.575270 (+  3036us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:46.610608 (+ 35338us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:46.613494 (+  2886us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:46.615253 (+  1759us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:46.615513 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:16:46.615561 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:46.644894 (+ 29333us) log.cc:844] Serialized 113 byte log entry
0709 13:16:46.645104 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.645312 (+   208us) write_op.cc:454] Released schema lock
0709 13:16:46.645374 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:46.645815 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.645847 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77262,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":223143,"apply.run_cpu_time_us":4287,"apply.run_wall_time_us":85556,"num_ops":16,"prepare.queue_time_us":516378,"prepare.run_cpu_time_us":30763,"prepare.run_wall_time_us":447955,"raft.queue_time_us":273746,"raft.run_cpu_time_us":12169,"raft.run_wall_time_us":79725,"replication_time_us":527616,"thread_start_us":723901,"threads_started":4,"wal-append.queue_time_us":104738,"wal-append.run_cpu_time_us":43396,"wal-append.run_wall_time_us":1711648}]]}
I20260709 13:16:49.740167 10711 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:49.748654 12404 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.749147 12413 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:49.749598 12481 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.749842 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.749035 12241 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.750439 10106 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:49.745484 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:49.754061 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.760334 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.726853 12252 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.762645 10113 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:49.726364 12188 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.711289 10710 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:49.765401 10114 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:49.761786 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:49.739380 12382 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.767791 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.768568 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.757253 11938 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.771888 10182 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:49.772100 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.772878 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.771159 12413 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:49.775566 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.775835 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.773867 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.771055 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.772462 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.761502 12355 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.782127 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.756914 12327 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:49.745584 12405 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.788283 10707 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.787892 10184 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:49.780519 10107 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:49.788908 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.773166 12188 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.771510 12404 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:49.794185 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.794682 10184 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.774448 12268 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:16:49.788107 12241 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:49.781934 12481 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:49.797715 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.797192 12310 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.799819 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.799885 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.782142 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 469) took 1113 ms. Trace:
I20260709 13:16:49.792203 12355 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.801504  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:49.792346 12315 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:49.771951 12252 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:49.808276 12479 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:16:49.809068 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.833133 10711 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 4: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:49.834059 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.837266 12252 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.837674 12405 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:49.838160 12445 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5.
I20260709 13:16:49.839051 12315 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:49.840011 12315 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.799389 12221 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.800369 12262 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:49.811266 12443 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.812099 12413 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.813761 12241 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:49.798624 10716 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:49.793704 12404 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.823097 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.821513 12310 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:49.825356 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.795845 12208 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:16:49.826285 12382 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.843731 10714 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3.
I20260709 13:16:49.801043 12344 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:49.850262 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:49.852092 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 63254.4us
I20260709 13:16:49.850262 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.862059 10189 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:49.862819 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.863209 10189 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:49.857303 10108 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:49.854472 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:49.859520 10713 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:49.865319 10115 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.866012 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:49.866467 10189 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.849933 12262 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.868150 10107 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
W20260709 13:16:49.877158 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54162.9us
I20260709 13:16:49.877528 10153 leader_election.cc:400] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:49.877811 10153 leader_election.cc:403] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.858840 12310 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:49.821292 10710 rpcz_store.cc:276] 0709 13:16:48.665443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.692645 (+ 27202us) service_pool.cc:224] Handling call
0709 13:16:49.573486 (+880841us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:49.775224 (+201738us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25243520}
I20260709 13:16:49.858722 12404 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.880440 10707 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:16:49.831548 12327 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.882861 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:49.853237 12221 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.881578 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.885720 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.872370 12262 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.871642 12443 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.885353 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.872223 10712 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:49.891705 12355 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.892175 12310 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.892210 12159 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.893507 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:49.893744 12159 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.895220 11982 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.897914 12221 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.903226 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.881371 12401 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:49.905530 11588 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.905900 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.908480 12241 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.908975 12241 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.909303 12241 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.909652 11938 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.912752 12306 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:49.914361 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:49.874035 12344 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.915812 12312 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:49.916185 12312 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.916541 12312 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:49.916200 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.878991 12481 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:49.921088 12445 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:49.924451 12445 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.925944 12326 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.930837 12312 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:49.921175 12401 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:49.917117 12327 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.893515 12310 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.944023 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:49.948439 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 45293.8us
I20260709 13:16:49.985796 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.046675 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.943389 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:49.948031 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.048357 10185 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.047788 11588 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4.
I20260709 13:16:49.941607 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:49.937242 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:49.937911 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:49.975991 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.939925 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:50.051091 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.950309 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:49.935210 10183 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:49.947830 10716 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.052767 10186 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:50.051805 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.054150 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.055460 10711 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:50.056932 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.921422 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:49.944286 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.025816 10115 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:50.044023 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:49.989454 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.046953 10181 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:50.065148 12189 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:50.065560 12189 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.065891 12189 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.065836 12187 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.067596 12187 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.944675 12312 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.067997 12187 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:50.068747 10155 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.147s (SENT)
I20260709 13:16:50.069357 12442 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:50.069936 12442 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:49.938238 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.072734 11588 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:50.074307 10189 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:16:49.982990 12344 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:49.941341 12382 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 13:16:49.948940 12329 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.156s
I20260709 13:16:49.945036 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:50.106079 10708 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.938627 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.107357 10033 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:50.108628 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.109289 10033 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:50.110282 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:49.934415 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:49.941183 12247 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.943583 12403 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.981386 12326 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:49.941946 12467 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 13:16:50.112404 11982 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:50.113875 12445 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:50.116200 12481 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.144593 12326 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.146711 12326 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.911691 11938 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.118880 10031 raft_consensus.cc:2376] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 3. Re-sending same reply.
I20260709 13:16:50.148797 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.149909 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.119505 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.150771 10181 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:50.120114 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.123231 12401 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.151961 10036 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:50.152817 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.129242 12329 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.153067 12241 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.153644 12329 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.155297 12241 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:50.155761 12405 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:50.138770 10709 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.159024 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.159581 10182 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.128840 12247 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:50.160559 12247 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.129344 12413 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.168045 12413 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.168488 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.169054 10031 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:50.155623 12329 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.161803 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.173049 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.173697 10181 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:50.173821 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:50.174583 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.139897 12442 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.175343 10181 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:50.175666 12403 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.176565 10181 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:50.170143 12413 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:49.981256 12188 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.180672 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:50.181461 12188 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.120630 10034 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:50.138309 12493 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:50.188066 10034 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:50.189039 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.190085 12404 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.170069 10031 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:50.192631 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.193661 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.194737 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:50.195417 10711 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:50.195360 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:50.196045 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.122861 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.123471 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:50.104430 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 183101us
I20260709 13:16:50.088970 10184 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:50.123891 11588 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:50.104310 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51022.8us
I20260709 13:16:50.197278 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:50.124441 10038 raft_consensus.cc:2410] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:50.123265 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.126159 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:50.122366 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.127658 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.128355 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.201412 11588 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:50.201599 10716 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:50.135023 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.190181 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.136924 10680 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
I20260709 13:16:50.202718 10115 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:50.202996 10680 leader_election.cc:403] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:50.137562 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.139235 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.204289 10035 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:50.121618 12189 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.138940 10033 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.185053 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:50.196062 10715 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:50.161674 12247 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.198462 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:50.199138 10036 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:50.228036 10189 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:50.192652 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:50.199486 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 73430us
I20260709 13:16:50.201327 10182 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:49.987110 12443 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.993527 12391 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.197716 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.205355 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:50.205884 10039 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.206781 10037 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.208617 10185 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
W20260709 13:16:50.257335 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 64745.8us
W20260709 13:16:50.352342 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 218299us
I20260709 13:16:50.365154 10709 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:50.230501 10034 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:50.230247 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:50.348299 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 151089us
I20260709 13:16:50.368389 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:50.368549 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.356999 10183 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:50.366848 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:50.369782 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.370576 11588 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:50.372335 10035 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:50.366848 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:50.377283 10111 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:50.377391 10112 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:50.378000 10713 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:16:50.379900 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 181501us
I20260709 13:16:50.389148 12304 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:50.352075 12491 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.346491 12397 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.391912 12491 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.378201 12221 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:50.378575 11972 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
I20260709 13:16:50.381547 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:50.423313 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:50.243096 10184 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 13:16:50.427357 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.427610 10184 pending_rounds.cc:85] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 2
I20260709 13:16:50.426355 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.207019 12413 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:50.409825 10188 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:50.410018 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.391361 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:50.420266 12491 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.387305 11982 raft_consensus.cc:2764] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:50.389793 12312 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:50.383764 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:50.458565 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 74887.6us
I20260709 13:16:50.392403 12467 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:50.426185 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53869.7us
I20260709 13:16:50.465193 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:50.465103 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.229329 12493 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.427901 10184 pending_rounds.cc:107] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:50.468423 10184 raft_consensus.cc:2889] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:50.441597 12252 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:50.378087 12159 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:16:50.432668 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.398802 12397 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.398597 12370 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.411688 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:50.405633 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 248445us
W20260709 13:16:50.457229 10155 leader_election.cc:336] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.606s (SENT)
I20260709 13:16:50.487236 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:50.487375 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.462815 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.467924 10182 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 2. (index mismatch)
I20260709 13:16:50.488144 10037 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
W20260709 13:16:50.433163 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.425109 12366 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:50.430518 12315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.023s	sys 0.023s
I20260709 13:16:50.299930 12187 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.477111 10038 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:16:50.475590 12262 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.000s
I20260709 13:16:50.442523 12188 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.461598 12329 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.435452 12413 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.507871 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.477861 12481 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.512614 10186 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:16:50.484552 12397 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:50.502592 12315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.023s	sys 0.023s
I20260709 13:16:50.514834 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.520424 10037 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.478331 12467 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:50.486523 12404 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:50.503639 11982 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.524156 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.521377 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1381) took 1032 ms. Trace:
I20260709 13:16:50.515220 12481 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:50.527238 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.515039 12413 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.523826 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.524744 10038 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:50.490579 12252 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:50.524982 10186 rpcz_store.cc:276] 0709 13:16:49.482888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.567013 (+ 84125us) service_pool.cc:224] Handling call
0709 13:16:49.939786 (+372773us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:50.515703 (+575917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15723904}
I20260709 13:16:50.532289 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:50.533111 10713 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:50.537495 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:50.538245 10707 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:50.539433 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.492100 12403 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:50.502466 12370 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.542862 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.549324 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:50.511844 12262 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.531261 12481 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.515790 12188 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.550180 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.518184 12329 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:50.556996 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 165629us
I20260709 13:16:50.557287 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.549685 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.559692 11588 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:50.560154 11588 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:50.561559 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 84365.9us
I20260709 13:16:50.562868 10039 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:50.563962 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.549382 10183 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.565683 10187 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:50.567130 10035 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.568624 10040 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.531435 11982 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.554327 12159 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.549396 12326 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:50.566587 12496 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:50.573822 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.579569 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:50.583094 10707 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:16:50.572762 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:50.645787 10031 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:50.647070 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.648355 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.649453 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:50.650219 10031 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.653509 10038 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.568519 10708 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:50.771267 11588 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.790699 11588 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.791218 10709 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:50.791976 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.793208 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:50.794167 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.581638 12497 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.795084 10113 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:50.792654 10111 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:50.804107 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.837643 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:50.839564 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.839789 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:50.841132 12500 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 13:16:50.841686 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:50.842527 10109 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:50.843384 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.844141 10114 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:50.561925 12467 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.581480 12304 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:50.840986 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.804195 12315 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:50.847657 12189 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.858052 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.848693 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.858959 10034 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:50.859985 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:50.860325 10034 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:50.862264 12262 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:50.863658 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.864019 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.864414 10182 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:50.865302 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:50.865922 10035 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:50.867226 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.867925 10186 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:50.868929 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:50.869618 10189 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
I20260709 13:16:50.869817 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:50.855470 12401 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:50.870970 12401 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:50.871625 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.857087 12315 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.873211 10036 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:50.874190 12315 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.875363 10036 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:50.867925 12493 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:50.871920 12401 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.875257 12315 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.882946 12445 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:50.883283 12315 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:50.884040 12315 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.870756 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:50.852438 12304 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:50.890302 12188 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.882709 12370 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:50.903374 10036 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:16:50.903755 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 436867us
I20260709 13:16:50.906860 10036 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:50.907673 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:50.909430 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:50.886754  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 6, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 6 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:50.912371 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:50.916347 10709 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:50.919139 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1088) took 1260 ms. Trace:
I20260709 13:16:50.919767 10038 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:50.923187 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:50.930879 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 358188us
I20260709 13:16:50.789393 12501 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:50.843448 12498 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.321s	user 0.000s	sys 0.000s
I20260709 13:16:50.770951 11938 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.933893 10679 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
I20260709 13:16:50.934962 10187 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
W20260709 13:16:50.942086 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.789500 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:50.891518 12375 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:50.943290 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1080) took 1368 ms. Trace:
I20260709 13:16:50.891466 12189 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:50.953012 10033 consensus_meta.cc:287] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 13:16:51.090771 10033 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:51.091645  9935 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.804826 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 480) took 1254 ms. Trace:
I20260709 13:16:50.975826 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:50.987839 10153 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:50.919591 10181 rpcz_store.cc:276] 0709 13:16:49.658312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.178128 (+519816us) service_pool.cc:224] Handling call
0709 13:16:50.178405 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.257172 (+ 78767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.257204 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.329144 (+ 71940us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.561356 (+232212us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:50.918680 (+357324us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.918889 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.918942 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.918969 (+    27us) raft_consensus.cc:1685] finished
0709 13:16:50.918975 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.919072 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22664,"raft.queue_time_us":78447,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":61537,"thread_start_us":485960,"threads_started":2,"wal-append.queue_time_us":414418}
W20260709 13:16:51.102487 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 114770us
I20260709 13:16:51.103231 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.114431 11588 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.115059 11588 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:50.639175 12252 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.124996 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2276) took 1136 ms. Trace:
I20260709 13:16:51.124991 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.129148 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:51.136309 10033 rpcz_store.cc:276] 0709 13:16:49.955339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.109999 (+154660us) service_pool.cc:224] Handling call
0709 13:16:51.091280 (+981281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.140033 12405 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:51.140479 12405 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:50.769342 12326 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:51.126418 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150701us
I20260709 13:16:51.144132 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:51.101253 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:50.945600 12484 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:16:51.124718 10712 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.089480 12375 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:51.129118  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.089803 10180 rpcz_store.cc:276] 0709 13:16:49.587212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.588122 (+   910us) service_pool.cc:224] Handling call
0709 13:16:49.911121 (+322999us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:49.911314 (+   193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.922072 (+ 10758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.922105 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.976722 (+ 54617us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.200711 (+223989us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:50.200737 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.200779 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.931359 (+730580us) raft_consensus.cc:1685] finished
0709 13:16:50.931376 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.943206 (+ 11830us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10317,"raft.queue_time_us":10905,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":158,"spinlock_wait_cycles":12372864,"thread_start_us":156749,"threads_started":1,"wal-append.queue_time_us":445072}
I20260709 13:16:50.911065 12445 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:50.930370 12401 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.130041 11588 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:51.012724 11938 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.156855 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.132402 12508 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.158907  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.916555 11972 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.217s
I20260709 13:16:51.206784 11972 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:51.133074 12404 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.047s	sys 0.052s
I20260709 13:16:51.088892 12187 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.211344 12187 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.212102 12187 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.214321 12187 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.214872 12187 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:51.215310 12187 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:51.217131 12404 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.048s	sys 0.053s
I20260709 13:16:50.944691 12310 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.226s
W20260709 13:16:51.185770 12504 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:16:51.138254 12159 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:50.943674 12370 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.226s
I20260709 13:16:51.137261 12442 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:51.155401 12189 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:51.186978 12493 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:50.943989 12497 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:51.227582 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 70801.9us
W20260709 13:16:51.232755 12413 consensus_meta.cc:287] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.000s
I20260709 13:16:51.187716 12502 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.233104 12497 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.233219 12413 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:51.231340 12491 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.756s	user 0.005s	sys 0.005s
I20260709 13:16:51.219762 12508 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.237336 10034 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:51.235020 10108 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:51.230064  9935 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 4, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.218859 12507 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.093537 10708 rpcz_store.cc:276] 0709 13:16:49.539806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.545154 (+  5348us) service_pool.cc:224] Handling call
0709 13:16:49.944873 (+399719us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:50.794469 (+849596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77362432}
I20260709 13:16:51.171100 12443 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:51.234007 12189 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.235361 11588 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.201653 11938 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:51.236455 12247 consensus_meta.cc:287] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.936s	user 0.005s	sys 0.005s
W20260709 13:16:51.248646 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 104615us
I20260709 13:16:51.227161 12510 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:51.253293 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:51.255419 10039 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:51.239027 12508 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.250643  9935 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:51.258541 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 157394us
I20260709 13:16:51.238404 12329 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:51.270735 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 477596us
I20260709 13:16:51.272475 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.225462 12445 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.241690 12515 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.244733 12493 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:51.283224 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.292186 10180 raft_consensus.cc:2410] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:51.283885 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:51.279440 10155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.057s	sys 0.064s
I20260709 13:16:51.225756 12511 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:16:51.290709 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.255046 12497 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.293179 10155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.058s	sys 0.064s
I20260709 13:16:51.292779 10181 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.296785 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.254115 12241 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:51.227265 12405 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.236510 12442 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.239569 12491 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.315065  9935 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.316913 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.316685 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1091) took 1608 ms. Trace:
I20260709 13:16:51.317826 10188 rpcz_store.cc:276] 0709 13:16:49.693949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.922806 (+228857us) service_pool.cc:224] Handling call
0709 13:16:51.301701 (+1378895us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5400098654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:51.301817 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60754176}
W20260709 13:16:51.318671 10183 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.001s
I20260709 13:16:51.319067 10183 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:16:51.287128 12329 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:51.321030 10037 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.799s	user 0.004s	sys 0.006s
I20260709 13:16:51.288609 12262 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.292372 12515 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:51.253015 12443 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.326723  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.326558 10037 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:51.306905 12507 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:51.346793 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:51.265332 12510 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.253960 12375 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.316188 12241 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:51.355005 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 118964us
I20260709 13:16:51.362614 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:51.395800 10113 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:16:51.348395 12397 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.000s
I20260709 13:16:51.340023 12526 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:51.331872 12391 consensus_meta.cc:287] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.942s	user 0.010s	sys 0.001s
W20260709 13:16:51.394776 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98091.9us
W20260709 13:16:51.352687 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 926618us
W20260709 13:16:51.396696 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.402949 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.345785 12506 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:51.399860  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 5, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 5 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.316463 12497 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.406550  9935 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:51.407521 12497 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.408110 12497 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.405808 12506 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:51.401750 12310 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.398979 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.328177 12413 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.344843 12517 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.408149  9935 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.285319 12187 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.388561 12507 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.331570 12515 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.413405 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.417389 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.387912 12522 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:51.412297 12467 raft_consensus.cc:2764] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:51.409919 12519 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:51.419031 12312 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.427111 12188 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.431581 12326 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.443856 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.444800 12241 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.405795 12397 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.438179 12526 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.418535 12310 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.474802 10181 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:51.454052 12445 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.430115  9935 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 2 to 3, term changed from 4 to 5, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193), VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194), VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195), VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:51.476735  9935 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 2, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 2 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.478425  9935 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 4, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.415779 12493 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:51.480199 12521 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:51.479964  9935 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 3, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:51.481653 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2281) took 1293 ms. Trace:
I20260709 13:16:51.481467  9935 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 1 to 3, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 3 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.418604 12366 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:51.424100 12391 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:51.448470 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.439340 12329 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:51.482041 10035 rpcz_store.cc:276] 0709 13:16:50.188021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.866737 (+678716us) service_pool.cc:224] Handling call
0709 13:16:50.867028 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.867288 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.867313 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.880740 (+ 13427us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.243553 (+362813us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:51.243592 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.243667 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.481445 (+237778us) raft_consensus.cc:1685] finished
0709 13:16:51.481466 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.481594 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":362323,"threads_started":1,"wal-append.queue_time_us":433034}
I20260709 13:16:51.471367 10032 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
W20260709 13:16:51.496920 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.497396 12497 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.497757 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:51.501093 10033 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.510706 10033 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:51.429387 12506 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:51.514061 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 65632.2us
I20260709 13:16:51.421368 12517 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.517094 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.457842 12312 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.519277 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:51.528527 12506 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.493419 12531 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:51.517035 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2289) took 1322 ms. Trace:
I20260709 13:16:51.518882 12510 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.525262 12536 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.462227 12519 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.498725 12329 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.540393 12310 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.534899 10032 rpcz_store.cc:276] 0709 13:16:50.190239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.424870 (+1234631us) service_pool.cc:224] Handling call
0709 13:16:51.512248 (+ 87378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.534184 12526 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.539315 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:51.575699 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 141939us
I20260709 13:16:51.529027 12442 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.531349 12467 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:51.558694 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 130417us
I20260709 13:16:51.541987 10712 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:51.573271 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.535113 12491 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.542224 12507 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:51.583021 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 50142.8us
I20260709 13:16:51.645681 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.654188 10031 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:51.639101 10037 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:51.631917 12187 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.578641 12536 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.615433 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:51.661154 10035 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.623342 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:51.655622 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.644857 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.668650 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:51.610886 12481 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.046s	user 0.009s	sys 0.000s
I20260709 13:16:51.582448 12497 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:51.678663 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:51.679352 10037 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:51.680706 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57432.1us
I20260709 13:16:51.681552 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:51.672473 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.682673 10031 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:16:51.585043 12530 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:51.658793 12187 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.695354 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.666833 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 484) took 1103 ms. Trace:
I20260709 13:16:51.587827 12467 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:51.640520 12443 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:51.677781 12535 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:16:51.685864 12262 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:51.610244 12528 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:51.697211 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.703261 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.684667 12497 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:51.704627 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.678700 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.686400 12526 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:51.711608 10038 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:51.677708 12397 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.712606 10037 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:16:51.713078 10031 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:51.698233 10712 rpcz_store.cc:276] 0709 13:16:50.560513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.568535 (+  8022us) service_pool.cc:224] Handling call
0709 13:16:51.663897 (+1095362us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:51.700287 12501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.023s
I20260709 13:16:51.695465 12542 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.718427 10033 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:51.706525 12262 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.706247 12497 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.695287 12481 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.710424 12310 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.722772 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2267) took 1769 ms. Trace:
I20260709 13:16:51.767057 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.759771 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:51.772130 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.583048 12522 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:51.713681 12241 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:16:51.775029 12315 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.890s	user 0.008s	sys 0.003s
I20260709 13:16:51.775477 12315 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.775372 12241 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:51.777685 12375 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.777953 12315 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:51.779297 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47930.9us
I20260709 13:16:51.767915 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:51.780069 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.781708 12315 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.782122 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:51.782290 12241 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.782132 12315 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.784260 12315 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.784410 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:51.706077 12443 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 13:16:51.721220 12501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.023s
I20260709 13:16:51.780153 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:51.721920 12533 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:51.800297 10185 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:51.768280 10040 rpcz_store.cc:276] 0709 13:16:49.952875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.859102 (+906227us) service_pool.cc:224] Handling call
0709 13:16:50.859413 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.266518 (+407105us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:51.393996 (+127478us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.416265 (+ 22269us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.423111 (+  6846us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.423275 (+   164us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:51.423463 (+   188us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.423625 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.423718 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.722557 (+298839us) raft_consensus.cc:1685] finished
0709 13:16:51.722580 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.722699 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2401,"prepare.queue_time_us":159997,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":78997,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":27903,"thread_start_us":490298,"threads_started":3,"wal-append.queue_time_us":120554}
I20260709 13:16:51.788034 10181 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:51.763057 12187 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.715197 11938 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.810683 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:51.807654 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:51.719966 12491 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:16:51.819110 10180 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:51.761888 12536 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.760828 12543 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.788501 12188 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.796502 12501 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:51.773065 11982 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.715270 12510 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:16:51.817250 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.900660 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.817334 10036 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:51.902737 10036 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:51.817242 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:51.817996 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.822041 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.822320 11938 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.796682 12241 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:51.828037 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:51.911682 10032 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:51.828962 12520 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.815207 12467 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.830013 12395 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:51.792162 12397 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.816074 10040 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.808224 12526 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.710930 12528 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:51.850095 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48509.5us
I20260709 13:16:51.851897 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:16:51.852339 12546 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:51.811643 12355 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:16:51.815163 12533 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:51.939932 12516 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:51.940171 12533 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.872900 12519 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:51.874497 12481 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:51.880651 12508 consensus_meta.cc:287] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:16:51.833671 12517 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:51.884123 12497 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.810961 12159 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:16:51.886412 12515 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.832321 12189 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:51.799564 12327 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.892517 12501 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.894279 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:51.968499 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2274) took 2007 ms. Trace:
W20260709 13:16:51.968681 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 74477.7us
I20260709 13:16:51.895692 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.897166 10181 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:51.861753 12522 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:51.906203 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 89040.6us
I20260709 13:16:51.970358 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:51.970579 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.969341 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:51.934788 12395 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:51.916172 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.923141 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2301) took 1427 ms. Trace:
W20260709 13:16:51.925223 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 140868us
I20260709 13:16:51.977275 10187 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:51.972846 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:51.924502 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.935231 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.937901 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:51.921864 12188 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.951342 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:51.984746 10189 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:51.984742 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46925us
I20260709 13:16:51.985065 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:51.965317 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:51.965924 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:51.967190 12315 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:51.963191 12327 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:51.970932 10112 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.908376 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:51.969213 10034 rpcz_store.cc:276] 0709 13:16:49.954813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.861099 (+906286us) service_pool.cc:224] Handling call
0709 13:16:50.861377 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.237742 (+376365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.958996 (+721254us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540039c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:51.962421 (+  3425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858822528}
I20260709 13:16:51.991358 10188 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:51.990962 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:51.977178 10039 rpcz_store.cc:276] 0709 13:16:50.502268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.563578 (+ 61310us) service_pool.cc:224] Handling call
0709 13:16:51.904952 (+1341374us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400042754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:51.918090 (+ 13138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588375808}
I20260709 13:16:51.978955 10180 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:51.964572 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:51.985850 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:51.987619 10107 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.988261 10110 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:51.989666 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:51.989615 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:51.995034 10114 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:51.995092 10109 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.000010 12326 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.003593 12531 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:52.004101 12395 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.001029 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:51.989821 12208 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.982946 12536 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:51.981089 12517 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.934229 12241 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.989665 12355 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.993510 12327 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.015693 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.017189 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:51.976325 10712 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:51.983266 12159 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:51.985123 12519 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:52.035702 10112 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:16:52.020565 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.002628 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.026170 10035 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:51.990345 12493 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.957661 12508 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.976152 12189 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:51.989285 12329 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.011307 10040 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:16:52.031586 10707 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:52.028492 10189 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:52.004050 12326 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.054531 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:51.984222 12188 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.000595 12262 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:52.034847 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44000.1us
I20260709 13:16:52.038327 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.039429 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.036942 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:51.945046 12526 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.012462 12520 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.041416 10111 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:52.048421 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.004065 12531 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:52.021509 12208 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:52.049677 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.033361 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:52.052434 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67446.3us
I20260709 13:16:52.030304 12536 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:52.071305 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.035976 12159 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:52.039942 12554 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.991422 11938 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:52.056063 12304 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:52.040483 12397 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.063725 10114 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:52.054278 12326 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.076876 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.064041 12188 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:52.080372 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.084240 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:52.037087 12355 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.092090 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.093605 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.071049 12531 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.086876 12366 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:52.095835 12366 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:52.096844 12526 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.096719 12366 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.098696 10716 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:52.099620 12355 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:52.062026 12329 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.101601 12329 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:52.085718 12502 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.001s
W20260709 13:16:52.076346 12506 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 13:16:52.107113 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:52.112978 10107 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:52.067668 12553 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:52.110585 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.116513 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.120010 10111 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:52.122584 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.087529 12510 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.126119 10184 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:52.081517 12554 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:52.126236 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.094988 12326 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.092669 12304 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:52.132205 12481 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:52.137058 12555 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:52.140933 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.141299 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.152449 11588 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:52.152606 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.152967 11588 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:52.125514 12502 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.134267 12515 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.135669 12553 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:52.247000 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 176606us
I20260709 13:16:52.132766 12493 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:52.273331  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:52.246198 11588 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.144399 12506 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.140602 12554 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.146111 12304 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.134485 12519 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:52.280268 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.284507 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.297479 10109 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:52.305238 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:52.308394 10114 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:16:52.310987 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 188475us
I20260709 13:16:52.134706 12520 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.143s
I20260709 13:16:52.233067 12497 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.330755 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:52.331867 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:52.153151 12510 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.328013 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.336026 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.291914 11982 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.291328 12511 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.142354 12536 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.310083 12506 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.351718 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.352885 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.309870 12262 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:52.316303 12515 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.354178 10109 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:52.354630 10115 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:52.355211 12506 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.364444 12519 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.366492 12567 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.366963 12567 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.367317 12567 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.330258 12315 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.359952 12511 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:16:52.355250 12564 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:16:52.369186 10111 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:52.231928 12159 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.359081 12493 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:52.433578 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 97626.6us
I20260709 13:16:52.358860 12528 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.330674 12509 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:16:52.440692 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 156249us
I20260709 13:16:52.441171 10035 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:52.441859 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:52.442517 10108 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:52.431434 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 277418us
I20260709 13:16:52.381381 12497 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:52.447486 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:52.357753 11982 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.449353 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.451989 11588 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.453395 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.454020 10109 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:52.432571 12344 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.456467 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:52.460408 10707 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:52.460851 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.436455 12329 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.436079 12493 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:52.463085 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 160592us
I20260709 13:16:52.463932 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.451933 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.465804 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.466579 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.442817 12189 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.470592 11588 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.469885 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:52.469570 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:52.448832 12395 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:52.471633 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.472406 11588 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:52.474073 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:52.448661 12511 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.475049 12580 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:52.449007 12553 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.476202 12561 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:52.478251 12562 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:16:52.466764 12557 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:16:52.485802 12568 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:52.465010 12493 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.489837 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:52.490382 12563 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:52.494431 11588 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.455973 12497 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.469897 12445 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.469866 12528 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:52.492064 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:52.452179 12262 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:16:52.468554 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:52.468554 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:52.490598 11982 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.484203 12510 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.465257 12344 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:52.528292 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.489347 12501 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:52.525038 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 83499.5us
I20260709 13:16:52.535441 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:52.529436 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 60963.4us
W20260709 13:16:52.531000 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.537075 10108 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:52.537333 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.545322 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:52.546062 10032 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:52.548663 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.551102 10713 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:52.551119 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:52.553943 10039 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:52.530444 12519 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.559247 10682 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:52.534720 12501 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.543277 12554 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.549986 12445 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:52.495992 12395 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.560168 12481 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.556764 12519 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.574318 10032 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.572875 12445 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.577066 12445 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:52.576608 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.558303 12262 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.581610 11588 raft_consensus.cc:2764] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:16:52.584379 10112 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
W20260709 13:16:52.584575 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60571.7us
I20260709 13:16:52.564657 12520 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.550514 12327 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.569721 12501 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.591775 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.596079 11588 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.597529 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.571602 12582 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.602579 12344 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:52.636927 12188 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 13:16:52.637435 12188 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.638583 10031 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:16:52.640648 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85726us
I20260709 13:16:52.603996 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:52.578877 12519 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.641552 10114 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:52.642957 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:52.699118 11588 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.699409 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:52.700142 10031 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:52.581332 12506 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.639654 12188 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.697115 11982 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.707223 10032 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:52.585019 12481 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:52.710887 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 113436us
I20260709 13:16:52.716127 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.718458 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.697947 12582 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:52.711797 12531 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.002s
I20260709 13:16:52.699802 12493 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:52.723003 11588 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.710217 11982 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.597466 12520 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.737771 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.720657 12578 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.737613 11588 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:16:52.727953 12397 consensus_meta.cc:287] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.003s
I20260709 13:16:52.750722 12445 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.752938 12445 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.754503 12405 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.757747 12510 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:16:52.758221 12576 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:16:52.758559 12543 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:52.758363 12510 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.758955 12543 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:52.745235 12262 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:52.759831 12262 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:52.759735 12543 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.760774 12543 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.763914 10708 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:52.764528 10714 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:52.765115 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:52.766702 10713 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:52.768011 12508 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.769244 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:52.770152 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:52.770910 12188 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:52.722374 12582 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.726491 11982 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.725672 12531 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:52.781303 12586 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:52.781741 10034 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.782047 12506 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.777812 12568 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:52.782797 12531 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.741679 12497 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.784462 12312 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.786193 12497 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:52.788281 12327 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.791172 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:52.791893 10713 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:16:52.754535 12481 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.743961 12587 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.819973 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:52.776005 12397 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.841853 10713 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:52.782744 12506 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:16:52.845539 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:52.812546 12188 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:52.848004 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69488.5us
I20260709 13:16:52.849253 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:52.850596 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 76399us
I20260709 13:16:52.760790 12262 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.857489 12262 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.858412 12519 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.844195 12515 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.860527 12554 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.864281 12188 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.852250 12567 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.867431 12567 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:52.855679 12493 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
W20260709 13:16:52.856498 12584 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:16:52.848693 12395 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.803274 12310 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:16:52.873603 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:52.872571 10040 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:52.889424 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.849104 12594 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:52.889617 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:52.854143 12491 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:52.892633 10183 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:52.863405 12501 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.896413 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:52.896996 10181 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.898207 12599 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:52.898801 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.899886 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:52.900982 12589 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:52.900681 11982 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.901331 12491 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.901701 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.902490 10187 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:52.901167 10189 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: [7.2-7.2]
I20260709 13:16:52.904644 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.905557 10186 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:52.905727 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:52.906379 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:52.900087 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.907485 10182 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:52.891037 12344 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:52.911710 10182 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:52.912917 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.913707 10182 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:52.914570 10186 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:52.895730 12587 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.917987 10181 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:16:52.903451 12588 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.902912 12594 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:52.908761 12304 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.003s
I20260709 13:16:52.921173 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:52.901286 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 674) took 1124 ms. Trace:
I20260709 13:16:52.922945 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.925983 10180 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.945787 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.946565 10182 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:52.947278 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:52.949731 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.950644 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:52.947906 10182 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:52.928292 10181 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:52.951344 10035 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:16:52.953469 10003 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.842s (SENT) [suppressed 18 similar messages]
I20260709 13:16:52.952562 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:52.922376 12588 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.959129 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:52.960069 10033 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:52.920388 12587 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.962349 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:52.963709 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.920593 12344 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.966602 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.968973 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:52.952836 12567 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:52.954329 12507 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.970983 12509 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.971236 12507 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.961581 12588 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.960686 12467 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:52.976024 10711 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:52.943378 10712 rpcz_store.cc:276] 0709 13:16:51.776929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.779765 (+  2836us) service_pool.cc:224] Handling call
0709 13:16:52.901112 (+1121347us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540062dc54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:52.901223 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421225728}
I20260709 13:16:52.961783 12520 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:52.964708 12395 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.944375 12304 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.965240 12587 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.966176 12554 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.985966 12507 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:52.986805 12326 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
I20260709 13:16:52.976115 12467 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:52.986523 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:52.971143 12567 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:52.967649 12312 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:52.968178 12519 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:52.954557 12543 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:16:52.973083 12413 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:53.060734 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47918.7us
W20260709 13:16:52.997450 12591 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:16:52.999994 12547 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.009986 12491 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:52.959833 12594 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.059496 12326 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.092206 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:53.094148 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.094708 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.094225 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.095472 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1403) took 1162 ms. Trace:
W20260709 13:16:53.095865 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.991981 12553 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:16:53.100797 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.108263 10115 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:53.107898 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.108011 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.125509 10106 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.126077 10107 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:53.125218 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.127542 12609 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:53.128219 12609 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.129005 12391 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.129403 12391 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:53.130348 12609 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.130209 12391 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.2, Last appended by leader: 2, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.131425 12391 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.132536 10180 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:52.997105 12565 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:16:53.133679 10032 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:53.133596 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.134544 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.134675 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:53.104362 12442 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.167595 10114 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.167934 12442 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.168730 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.170049 12442 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.170603 12442 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:53.107517 12560 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:53.171331 12560 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:53.168107 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.106030 10184 rpcz_store.cc:276] 0709 13:16:51.932864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.935004 (+  2140us) service_pool.cc:224] Handling call
0709 13:16:53.095263 (+1160259us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000febd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:53.095402 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334042496}
I20260709 13:16:53.105418 12501 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.180583 12208 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.154844 12405 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.153131 12567 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:53.151693 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.146968 12582 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:53.152143 12605 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:53.166767 10107 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.151557 12506 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.173799 10110 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:53.193871 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.194621 10189 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.196008 10109 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:53.176075 10180 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:53.172264 12560 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.182960 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.200202 10184 raft_consensus.cc:2368] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
I20260709 13:16:53.200289 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.189916 10106 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:16:53.190860 10114 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:53.201135 10031 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
W20260709 13:16:53.203585 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81616.2us
I20260709 13:16:53.166136 12609 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:53.174263 12578 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.081259 12547 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.182437 12599 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.175311 12442 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:53.214725 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 261274us
I20260709 13:16:53.215947 10679 leader_election.cc:400] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
W20260709 13:16:53.215080 12580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.016s	sys 0.042s
I20260709 13:16:53.218537 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.219425 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.201375 12326 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.221796 10679 leader_election.cc:403] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.217584 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.201205 12567 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:53.226951 10107 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:53.183998 12405 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.214735 12609 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:53.228928 10107 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:53.230299 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:53.233362 10189 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:53.234529 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.235270 10184 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:53.235610 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.236726 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.203349 12506 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.247524 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 489) took 1230 ms. Trace:
I20260709 13:16:53.220851 12445 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:53.238338 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.239475 12561 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.243391 12304 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.246635 12547 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.233955 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:53.249415 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:53.232439 12614 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:16:53.225646 12580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.016s	sys 0.043s
I20260709 13:16:53.252512 12506 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.253214 12404 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:53.253582 10708 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.254804 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.247931 10716 rpcz_store.cc:276] 0709 13:16:52.016712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.016902 (+   190us) service_pool.cc:224] Handling call
0709 13:16:53.247322 (+1230420us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54005195d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:53.247468 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144796928}
I20260709 13:16:53.277518 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.257402 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.258234 10184 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.259145 12442 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.261426 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.263366 12510 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:53.283600 12566 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.160s	user 0.006s	sys 0.000s
I20260709 13:16:53.263783 12413 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.226761 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.259502 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.250108 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:53.276463 12561 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.232857 12326 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.280620 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.281252 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.282615 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.292115 10031 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:53.292912 12188 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:53.293118 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.294468 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.282768 12582 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.231607 12567 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.271768 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:53.294580 10709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 492) took 1256 ms (client timeout 1513 ms). Trace:
I20260709 13:16:53.270488 12397 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:53.310627 10108 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.269796 12445 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.330595 10031 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:53.308046 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.292301 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:53.335315 10709 rpcz_store.cc:269] 0709 13:16:52.038087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.038260 (+   173us) service_pool.cc:224] Handling call
0709 13:16:53.259345 (+1221085us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:53.294518 (+ 35173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5077248}
I20260709 13:16:53.338289 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:16:53.340384 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 68704.6us
I20260709 13:16:53.342105 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:53.345577 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:53.348440 10184 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:53.231309 12599 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.349609 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.309152 10710 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:53.350411 10184 raft_consensus.cc:2376] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7. Re-sending same reply.
I20260709 13:16:53.291291 12561 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.290755 12560 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:53.353113 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:53.359995 10031 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:16:53.362293 10108 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:53.363282 10031 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.338742 12397 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:53.351794 12519 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:53.354156 12188 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.308869 12326 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.355463 12533 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.370213 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.371236 10189 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.374826 12567 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.375203 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1430) took 1395 ms. Trace:
I20260709 13:16:53.376283 12405 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.377024 12404 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:53.377568 12404 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.379339 12506 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.379894 12506 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.380357 12588 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.382090 12506 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.382493 12588 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.382903 10182 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:53.384426 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.360778 12561 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.290825 12609 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:16:53.380164 10185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1390) took 2854 ms (client timeout 1842 ms). Trace:
I20260709 13:16:53.375653 10034 rpcz_store.cc:276] 0709 13:16:51.979608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.992588 (+ 12980us) service_pool.cc:224] Handling call
0709 13:16:52.004559 (+ 11971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.782151 (+777592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.374978 (+592827us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400165b54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:53.375146 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786995584}
I20260709 13:16:53.390735 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:53.391283 10034 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.396313 10182 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:53.397310 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.398447 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.399403 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.400897 10182 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:53.402159 10182 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.402742 10031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:53.405017 10031 raft_consensus.cc:606] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:16:53.375412 12567 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:53.389143 10185 rpcz_store.cc:269] 0709 13:16:50.525607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.535403 (+  9796us) service_pool.cc:224] Handling call
0709 13:16:53.379942 (+2844539us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001009d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:53.380075 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2866709888}
I20260709 13:16:53.368829 12519 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.425094 10189 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:53.426280 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.427004 10189 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:53.410408 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.410953 12567 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:53.438530 12567 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.439939 12614 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8.
W20260709 13:16:53.440450 12548 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.572s	user 0.005s	sys 0.000s
I20260709 13:16:53.439502 12599 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.402550 12370 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:53.379580 12404 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.408274 10034 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:16:53.418066 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:53.456614 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 103559us
I20260709 13:16:53.418249 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.418960 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.418686 12397 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.420069 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.419613 12312 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:53.428325 12609 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.431277 12159 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.433030 12326 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.369386 12587 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.433946 12519 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.441479 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.477820 10189 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:53.417307 12445 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.457031 10714 raft_consensus.cc:2410] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:53.465170 10107 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:53.463837 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:53.455710 12560 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:53.472270 10182 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.455863 12391 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:16:53.449649 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:16:53.497685 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48123.9us
I20260709 13:16:53.498618 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:53.499454 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:16:53.483613 10031 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:53.458114 12614 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:16:53.490514 12587 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:53.502574 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 88618.8us
I20260709 13:16:53.485191 10710 raft_consensus.cc:2368] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:16:53.510562 12445 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.511899 12445 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:53.512812 12445 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.509202 12401 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:53.524283 10031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:53.524770 10031 raft_consensus.cc:606] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:16:53.516739 12405 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:53.510784 12580 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:53.529925 12558 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.444s	user 0.010s	sys 0.006s
I20260709 13:16:53.531114 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.528523 12515 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:53.536307 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.536705 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 327) took 1592 ms. Trace:
I20260709 13:16:53.537659 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:53.538102 12583 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.823s	user 0.002s	sys 0.002s
I20260709 13:16:53.526597 12401 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:53.536311 12515 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.500597 12561 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.539323 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 488) took 2191 ms. Trace:
I20260709 13:16:53.537181 10036 rpcz_store.cc:276] 0709 13:16:51.944111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.944364 (+   253us) service_pool.cc:224] Handling call
0709 13:16:51.944693 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:51.952552 (+  7859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.952582 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:51.962995 (+ 10413us) log.cc:844] Serialized 52 byte log entry
0709 13:16:52.036842 (+ 73847us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.036934 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.037019 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.523855 (+1486836us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:53.536390 (+ 12535us) raft_consensus.cc:1685] finished
0709 13:16:53.536411 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.536646 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296,"raft.queue_time_us":9611,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9708,"spinlock_wait_cycles":2476928,"thread_start_us":71345,"threads_started":1,"wal-append.queue_time_us":90973}
I20260709 13:16:53.539362 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.539896 12401 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.548287 10185 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:53.539335 12529 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:53.528885 12580 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.551705 10036 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:53.533383 12622 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.546110 10715 rpcz_store.cc:276] 0709 13:16:51.347835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.348557 (+   722us) service_pool.cc:224] Handling call
0709 13:16:51.348934 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.399350 (+ 50416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.399381 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.368832 (+969451us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b2c00047828. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:16:52.371498 (+  2666us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.550988 (+179490us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.551023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.551086 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.537529 (+986443us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:53.539100 (+  1571us) raft_consensus.cc:1685] finished
0709 13:16:53.539120 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.539245 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39277,"raft.queue_time_us":50928,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7016,"spinlock_wait_cycles":9119872,"thread_start_us":179097,"threads_started":1,"wal-append.queue_time_us":226437}
I20260709 13:16:53.559075 10181 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:53.561177 12515 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.540557 12241 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.562144 12623 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.562680 12623 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.564749 12623 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.550990 12529 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:53.566416 12529 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.567468 12529 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.545511 12405 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:53.569061 12405 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.569829 10186 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.570256 12622 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.571456 10186 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:53.572423 12622 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:53.572310 10112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1226) took 1501 ms (client timeout 1767 ms). Trace:
I20260709 13:16:53.522703 12519 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.584522 10183 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:53.585763 10707 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:53.593336 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 494) took 1127 ms. Trace:
I20260709 13:16:53.593730 10707 rpcz_store.cc:276] 0709 13:16:52.465485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.466470 (+   985us) service_pool.cc:224] Handling call
0709 13:16:53.585197 (+1118727us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:53.585429 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.593045 (+  7616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.593273 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4351872}
I20260709 13:16:53.594799 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:53.592788 10112 rpcz_store.cc:269] 0709 13:16:52.071288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.072171 (+   883us) service_pool.cc:224] Handling call
0709 13:16:53.572137 (+1499966us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000497d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:53.572247 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126457216}
I20260709 13:16:53.596129 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.596742 10183 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:53.597589 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.598356 10183 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:53.601768 12519 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.605252 10185 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:53.596917 10036 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:53.608307 10186 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:53.552323 12580 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.612794 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.614106 10182 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.614495 10185 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.610728 12614 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:16:53.639724 12561 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.637979 12619 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.652814 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:53.660236 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1216) took 1666 ms. Trace:
I20260709 13:16:53.660725 10111 rpcz_store.cc:276] 0709 13:16:51.993529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.120753 (+127224us) service_pool.cc:224] Handling call
0709 13:16:52.121017 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.374289 (+253272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.652121 (+1277832us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54001bdfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:53.660158 (+  8037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555161472}
I20260709 13:16:53.665827 12413 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.666285 12413 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:53.667043 12413 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.609789 12560 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.626099 12519 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:53.651669 12619 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.792979 12553 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:53.709856 12567 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:16:53.743621 12344 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:53.805791 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51615.2us
I20260709 13:16:53.737723 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2487) took 1767 ms. Trace:
I20260709 13:16:53.803656 10033 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: [7.2-7.2]
I20260709 13:16:53.751618 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.750181 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:53.804430 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.752305 10040 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:53.736660 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 54062.8us
I20260709 13:16:53.753494 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1231) took 1299 ms. Trace:
I20260709 13:16:53.689250 10182 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:53.683094 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.678758 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:53.673952 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150624us
I20260709 13:16:53.812546 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:53.813850 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:53.809319 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:53.836086 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:53.836822 10182 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:16:53.838138 10182 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:53.809154 10115 rpcz_store.cc:276] 0709 13:16:52.453911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.454083 (+   172us) service_pool.cc:224] Handling call
0709 13:16:52.466765 (+ 12682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.125020 (+658255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.753250 (+628230us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400189a54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:53.753433 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450072960}
I20260709 13:16:53.809419 10113 rpcz_store.cc:276] 0709 13:16:51.970202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.970494 (+   292us) service_pool.cc:224] Handling call
0709 13:16:51.970755 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.050109 (+ 79354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.050142 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.050211 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.050245 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.737486 (+1687241us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54002b8254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:53.737536 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.737661 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182037376}
I20260709 13:16:53.807858 10034 raft_consensus.cc:2368] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:16:53.842948 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:16:53.663499 12624 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
I20260709 13:16:53.845827 10186 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:53.680735  9925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 67253.7us
I20260709 13:16:53.667513 12401 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.802822 12580 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.681280 12467 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.844945 12329 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.848543 12329 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:53.849440 12329 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.844987 12315 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:53.852192 12315 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.853384 10186 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:53.853672 10184 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:16:53.854197 12315 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.855355 12516 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:53.855491 12619 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:53.857587 12575 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.861447 12312 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:53.861905 12312 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:53.862283 12312 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:53.867595 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.804062 12543 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:53.710214 12622 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:53.793359 12609 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.870242 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:53.870340 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.871227 10108 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:53.815092 12442 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.871964 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.875521 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.877257 12401 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.879601 11982 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.867390 12516 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:16:53.889726 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 46871.4us
I20260709 13:16:53.872674 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:53.879987 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.893026 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:53.873363 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.829326 12515 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.900699 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.904476 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.906142 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:53.906770 10110 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.907143 10114 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:53.908710 10111 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:53.909124 10111 pending_rounds.cc:85] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 2
I20260709 13:16:53.909348 10111 pending_rounds.cc:107] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:53.672435 12391 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:53.710145 12241 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:53.897682 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:53.898522 10079 leader_election.cc:400] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:16:53.909586 10111 raft_consensus.cc:2889] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.669446 12561 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.203s
I20260709 13:16:53.913141 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:53.913573 10079 leader_election.cc:403] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.840375 12519 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:53.848562 12580 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:53.874782 12621 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:53.842549 12553 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:16:53.867942 12567 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:53.933657 10707 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:53.910275 12542 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:53.874363 12543 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.912575 12326 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:53.910804 12391 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:53.942462 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.912186 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.876149 12623 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:16:53.875290 12609 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.876610 12622 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.958674 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:53.880654 12442 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:53.933153 12621 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.950955 12560 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:16:53.970059 10107 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:53.949105 12515 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.949344 12326 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:53.971105 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70576.7us
I20260709 13:16:53.924458 12241 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.946614 12646 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.960908 12516 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:54.165370 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 295780us
I20260709 13:16:54.362746 10707 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:54.363901 12401 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.364532 12401 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:53.965611 12621 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.320976 12312 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.369009 12312 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:54.366858 12401 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:53.983755 12326 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.373323 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:54.373983 10183 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:54.035565 12188 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:54.376397 12188 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:54.377394 12188 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.378700 12188 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.347194 10110 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
W20260709 13:16:54.238734 12638 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:16:54.400683 12622 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:54.401960 12543 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:54.236450 12642 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:16:54.022931 12241 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:54.239521 12639 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:16:54.404637 12561 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:54.406315 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 428891us
I20260709 13:16:54.407006 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:54.022470 12519 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:54.410976 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 122045us
I20260709 13:16:54.411803 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:54.414867 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52503.7us
I20260709 13:16:53.971828 12522 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.444s
W20260709 13:16:54.420128 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.057243 12609 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:54.411684 12516 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.435899 10004 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:54.437446 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:54.438302 10183 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:53.985997 12515 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:54.451364 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.983522 12391 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.506572 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:54.507872 10185 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:54.465404 12623 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:54.418493 12315 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:16:54.525132 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.032s
W20260709 13:16:54.525571 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.032s
I20260709 13:16:54.507463 12329 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.420889 12654 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:16:54.467947 12560 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:16:54.544647 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:54.549185 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.549934 10110 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:54.517278 12652 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:54.554167 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1103) took 1663 ms. Trace:
I20260709 13:16:54.554780 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.532361 12510 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.554584 10188 rpcz_store.cc:276] 0709 13:16:52.891230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.891345 (+   115us) service_pool.cc:224] Handling call
0709 13:16:52.891625 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.891838 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:52.897407 (+  5569us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.545337 (+1647930us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b180034c120. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:16:54.553855 (+  8518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.553905 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:54.553952 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.554012 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.554113 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33973,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1441,"spinlock_wait_cycles":21418368,"thread_start_us":48452,"threads_started":2,"wal-append.queue_time_us":84772,"wal-append.run_cpu_time_us":5396,"wal-append.run_wall_time_us":1226175}
I20260709 13:16:54.525652 12370 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.532779 12391 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.525336 12241 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:54.562870 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:54.533245 12651 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.589815 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:54.576259 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:54.590440 10707 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:54.596539 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.607316 10709 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.607376 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:54.611503 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 175727us
I20260709 13:16:54.613377 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:54.614687 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:54.605782 12536 raft_consensus.cc:993] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:16:54.559659 12329 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:54.588940 12445 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:54.629477 10707 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:54.564880 12370 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.638655 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:54.608201 12262 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.562958 12652 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.643033 10709 raft_consensus.cc:2368] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5.
I20260709 13:16:54.572734 12241 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.617313 12645 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.660141 10187 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:54.667956 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:54.633185 12609 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.639320 12649 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.639405 12660 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:54.646179 12654 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.645490 12519 raft_consensus.cc:1081] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
W20260709 13:16:54.717281 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49471.6us
I20260709 13:16:54.706506 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.642484 12370 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:54.719238 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.666368 12405 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:54.722282 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.722324 10716 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:54.666179 12508 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:54.726284 10111 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:54.727385 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.732069 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.732734 10111 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:54.733619 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:54.734668 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:54.700502 12366 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:54.665285 12262 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:54.740769 10181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1125) took 1802 ms (client timeout 2195 ms). Trace:
I20260709 13:16:54.647545 12445 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.705241 12536 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:54.724515 12405 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.716483 12660 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:16:54.744201 10181 rpcz_store.cc:269] 0709 13:16:52.938226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.958852 (+ 20626us) service_pool.cc:224] Handling call
0709 13:16:54.740540 (+1781688us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54003f16d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:54.740671 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377945984}
I20260709 13:16:54.705386 12609 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.724905 12560 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:16:54.760413 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:54.736874 12508 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.747715 12515 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:54.751111 12405 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.790558 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:16:54.793799 10181 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:54.794165 10181 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.728799 12649 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.743175 12366 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.801745 10181 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.808094 10180 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:54.755473 12536 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.872699 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:54.874053 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:54.874374 12647 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:54.874614 10113 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.875048 12647 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.877308 12647 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:54.888624 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:54.889443 12621 consensus_meta.cc:287] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:16:54.889890 12621 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.891865 12442 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:54.806785 12660 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:54.893601 12652 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:54.895165 12646 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.000s
W20260709 13:16:54.956763 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 340827us
I20260709 13:16:55.170156 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:54.895589 12646 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:16:54.962751 10711 raft_consensus.cc:2410] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:16:55.170974 10078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.020s	sys 0.029s
W20260709 13:16:55.210095 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.010s	sys 0.006s
I20260709 13:16:55.206390 10107 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:16:55.211129 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.006s
W20260709 13:16:54.936017 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.211788 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.213111 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.213743 10107 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:55.210911 10078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.023s	sys 0.029s
W20260709 13:16:55.211767 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 635566us
I20260709 13:16:55.232661 10079 leader_election.cc:400] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5.
W20260709 13:16:54.899498 12188 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.000s
I20260709 13:16:55.233824 10079 leader_election.cc:403] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:55.234972 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.236326 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:54.896579 12445 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:54.915493 12262 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:54.898123 12241 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:54.897842 12366 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:55.243449 10183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.007s	sys 0.020s
I20260709 13:16:55.240984 10679 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:55.244417 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.255319 10107 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:55.269865 10107 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:54.957033 12623 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:55.271188 10107 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:55.271572 10107 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:55.271291 12623 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.272336 10107 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:54.962312 12652 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.274861 12652 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:55.276916 12659 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.641s	user 0.001s	sys 0.000s
I20260709 13:16:55.229120 12660 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.277684 12405 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.248588 12188 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:55.279322 12672 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5.
I20260709 13:16:55.215783 12312 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:16:55.280367 12654 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.280581 12594 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:55.224623 12515 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.281611 12515 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.200762 12582 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.284024 12582 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.228153 12442 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.285423 12442 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:55.246966 12326 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.876s	user 0.007s	sys 0.004s
I20260709 13:16:55.287446 12442 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.246682 12519 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.288730 10183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.007s	sys 0.020s
I20260709 13:16:55.287556 12326 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.290282 12405 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.291411 10113 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
W20260709 13:16:55.292831 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51924.1us
I20260709 13:16:55.238828 12645 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.241369 12673 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.228785 12647 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:55.249028 12575 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.312793 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.314491 10707 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:55.313598 10113 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.318826 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.320257 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.323951 12621 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:55.325500 12657 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.624s	user 0.001s	sys 0.001s
I20260709 13:16:55.326794 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1245) took 1458 ms. Trace:
I20260709 13:16:55.327193 10106 rpcz_store.cc:276] 0709 13:16:53.868790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.872450 (+  3660us) service_pool.cc:224] Handling call
0709 13:16:53.872799 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.898995 (+ 26196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.899026 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.912648 (+ 13622us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.525947 (+613299us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:54.525989 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.526172 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.324814 (+798642us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:55.326452 (+  1638us) raft_consensus.cc:1685] finished
0709 13:16:55.326473 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.326723 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36525,"raft.queue_time_us":26373,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8253,"spinlock_wait_cycles":158949248,"thread_start_us":568583,"threads_started":1,"wal-append.queue_time_us":652777}
I20260709 13:16:55.329348 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.330010 10106 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:16:55.330871 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.331420 10106 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:55.332736 12647 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:55.333185 12647 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:55.334319 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.334122 12647 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.335012 10108 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:55.336102 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.340584 12326 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.341133 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.314225 12645 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.341864 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1446) took 1590 ms. Trace:
I20260709 13:16:55.342195 10039 rpcz_store.cc:276] 0709 13:16:53.765465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.340827 (+1575362us) service_pool.cc:224] Handling call
0709 13:16:55.341796 (+   969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.343415 12645 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.294734 12445 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.299810 12519 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.270216 12262 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.341874 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1431) took 1709 ms. Trace:
I20260709 13:16:55.358799 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:55.365725 10186 rpcz_store.cc:276] 0709 13:16:53.632226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.633285 (+  1059us) service_pool.cc:224] Handling call
0709 13:16:55.341680 (+1708395us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400096d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:55.341802 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442219776}
I20260709 13:16:55.350234 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:55.351466 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.349653 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.309618 12513 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:55.293316 12366 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.362840 12666 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.367777 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.335475 12647 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.377805 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.313408 12560 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:16:55.381135 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 212414us
I20260709 13:16:55.370479 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.388013 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.247808 12609 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.393904 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.390134 10108 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:16:55.398144 10035 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:55.408562 10108 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:55.364621 12508 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:55.368918 12687 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.411140 10108 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:55.369844 12673 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.363094 12667 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.414852 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.394639 12405 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.369437 12513 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.418115 10108 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:55.388396 12391 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.001s
I20260709 13:16:55.437371 12513 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.391847 12401 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.438076 12401 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.439232 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.439865 10038 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:16:55.440083 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:55.440289 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:55.440806 10033 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:55.441414 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.441891 10033 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:55.442308 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.437047 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.437156 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.368995 12366 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.443550 10040 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:55.442070 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.444880 10109 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:55.445211 12366 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.446560 12513 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.394644 12675 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:55.448079 12675 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.412547 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.450179 12675 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.450498 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:55.450996 12513 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.387279 12683 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:16:55.451676 12401 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:55.448639 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.419440 12673 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.424052 10113 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:55.394817 12560 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.419199 12621 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.421401 12687 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.398205 12329 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.484928 10111 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:16:55.395593 12690 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.496448 12690 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.496899 12690 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.369218 12666 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.420125 12508 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.497639 12508 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.499027 12666 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.488826 12678 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.500391 12678 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.394466 12516 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:55.443259 10035 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:55.469800 12665 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:55.469595 12401 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.469789 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.437242 12405 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.452248 12536 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.472221 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1435) took 1031 ms. Trace:
I20260709 13:16:55.370164 12445 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.395147 12326 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:16:55.503252 12665 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.473858 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.508762 10031 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:55.474448 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.444798 10037 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:55.442883 10039 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:16:55.509903 12567 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:55.510353 12567 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:55.510761 12622 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:55.511150 12567 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.512036 12622 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.512502 12622 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:55.517323 12641 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.116s	user 0.001s	sys 0.012s
I20260709 13:16:55.519865 12516 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.522778 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.501940 12508 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.508496 12665 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.348718 12575 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.527961 12516 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:55.529253 12653 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.135s	user 0.000s	sys 0.014s
I20260709 13:16:55.530273 12575 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.509016 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:16:55.536307 10152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.007s	sys 0.016s
I20260709 13:16:55.357463 12686 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:16:55.537220 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 480) took 1947 ms. Trace:
I20260709 13:16:55.492393 12687 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.482147 12621 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.481207 12673 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.539333 12684 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:55.543435 12684 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.543823 12684 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.546875 12649 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.426422 12667 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.547904 12663 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:55.549371 12667 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:55.549600 12663 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.539449 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.542357 12536 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:16:55.512408 12567 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.551939 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1254) took 1645 ms. Trace:
I20260709 13:16:55.552441 10109 rpcz_store.cc:276] 0709 13:16:53.906313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.923203 (+ 16890us) service_pool.cc:224] Handling call
0709 13:16:53.923547 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.445217 (+1521670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.551664 (+106447us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540026cad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:55.551865 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3498171264}
I20260709 13:16:55.500891 12519 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.537742 10189 rpcz_store.cc:276] 0709 13:16:53.589807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.709228 (+119421us) service_pool.cc:224] Handling call
0709 13:16:53.709575 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.813796 (+104221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.813831 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.840841 (+ 27010us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.149248 (+308407us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:54.417046 (+267798us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.417280 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.417359 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.528698 (+1111339us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:55.532967 (+  4269us) raft_consensus.cc:1685] finished
0709 13:16:55.537011 (+  4044us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.537157 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":374780,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":485,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":5340,"spinlock_wait_cycles":49763200,"thread_start_us":439734,"threads_started":2,"wal-append.queue_time_us":522044}
I20260709 13:16:55.489565 12560 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.505251 12405 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.505386 12401 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.505983 12329 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.508060 12326 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 7.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:55.398697 12645 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:16:55.503122 10183 rpcz_store.cc:276] 0709 13:16:54.440352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.519484 (+ 79132us) service_pool.cc:224] Handling call
0709 13:16:54.538658 (+ 19174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.561388 (+ 22730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.561423 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.586935 (+ 25512us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.292491 (+705556us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:55.292742 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.292811 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.472011 (+179200us) raft_consensus.cc:1685] finished
0709 13:16:55.472034 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.472158 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8104,"raft.queue_time_us":22354,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":19707,"thread_start_us":655114,"threads_started":1,"wal-append.queue_time_us":777005}
W20260709 13:16:55.565814 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 242307us
I20260709 13:16:55.377558 12262 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:55.536615 10152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.007s	sys 0.016s
I20260709 13:16:55.536617 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.571621 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.572314 10113 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:55.572782 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.573191 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:55.532600 12655 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.133s	user 0.009s	sys 0.008s
I20260709 13:16:55.489076 10034 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:16:55.542428 12445 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.566239 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1242) took 1698 ms. Trace:
I20260709 13:16:55.542624 12621 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.574112 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.574899 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.575707 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.591922 10031 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:55.576439 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.577214 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.580603 10709 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 4: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:55.583310 10037 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:55.593997 10032 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:55.591157 10040 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:16:55.596827 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.523047 12678 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.601603 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.602212 10184 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.603976 10039 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:55.588516 12560 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:55.605526 12560 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:55.605873 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.606384 12560 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.596586 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.592748 12445 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:55.588703 12575 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:55.603003 12687 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.608330 12575 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.608436 12687 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.611482 12687 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:55.582019 12667 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.611989 12513 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.612138 12667 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.612614 12513 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.613689 12401 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.614210 12667 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:55.614668 12513 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.614908 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.615469 10189 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.616357 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.617101 10186 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:55.617861 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.621606 12684 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.623270 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.626351 10037 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:16:55.581496 12561 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.629680 12651 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.630183 12651 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.634599 10183 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:55.629323 10184 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
W20260709 13:16:55.637895 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 247377us
I20260709 13:16:55.621619 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.639984 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:55.640452 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.640758 10037 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:55.641363 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:55.642580 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.646589 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.588132 12519 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:16:55.649713 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.625777 12513 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.626560 12445 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.653462 10113 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:55.617631 12575 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.654435 12513 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.655303 12445 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.638260 12690 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.657614 12690 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.649560 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.642452 10039 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.652464 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:55.647802 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.638238 12621 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:55.667274 12621 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.658288 12391 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:16:55.668401 12580 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:55.669009 12513 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.668401 12667 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:55.670559 12445 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.654480 12366 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:16:55.668181 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.637389 12561 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.672922 12445 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.674003 12561 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.653549 12622 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.675953 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:55.679836 10037 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.681152 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.680399 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.683449 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.684809 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.676262 12622 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.686422 12366 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:55.687433 12262 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:55.687961 12665 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.688666 12687 raft_consensus.cc:2764] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:55.689143 10035 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:55.660629 12686 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:55.689471 12667 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:55.689913 12686 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.690340 12686 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.690752 12667 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:55.691143 12667 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:55.691969 12667 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.692701 12582 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.693113 12667 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.696041 12687 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:55.693111 12413 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.696621 12687 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:55.697793 12687 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.701064 10181 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.702004 12683 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.702514 12683 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:55.709858 12664 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.965s	user 0.002s	sys 0.000s
I20260709 13:16:55.710999 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.712484 10713 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 4.
I20260709 13:16:55.710750 12673 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.713205 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1434) took 1274 ms. Trace:
W20260709 13:16:55.713902 12662 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.968s	user 0.001s	sys 0.000s
I20260709 13:16:55.714594 12652 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.715173 12652 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:55.710929 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.716313 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:55.714890 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.716918 10181 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.716325 10709 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:55.717186 10183 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.719051 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:55.719415 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.712402 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.720811 10716 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:55.722914 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.717783 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.723984 10184 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.725494 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1257) took 1058 ms. Trace:
I20260709 13:16:55.725862 10679 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:55.660979 10189 raft_consensus.cc:2410] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:55.725898 10114 rpcz_store.cc:276] 0709 13:16:54.666763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.273831 (+607068us) service_pool.cc:224] Handling call
0709 13:16:55.274069 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.293511 (+ 19442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.293539 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.293993 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.578262 (+284269us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:55.578303 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.578559 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.725224 (+146665us) raft_consensus.cc:1685] finished
0709 13:16:55.725255 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.725412 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53286,"raft.queue_time_us":20072,"raft.run_cpu_time_us":881,"raft.run_wall_time_us":12532,"thread_start_us":254227,"threads_started":1,"wal-append.queue_time_us":413019}
I20260709 13:16:55.713604 10182 rpcz_store.cc:276] 0709 13:16:54.439013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.439141 (+   128us) service_pool.cc:224] Handling call
0709 13:16:54.439467 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.439879 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.439908 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.505547 (+ 65639us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.595019 (+ 89472us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:54.611025 (+ 16006us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.611209 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.611282 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.709319 (+1098037us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:55.712919 (+  3600us) raft_consensus.cc:1685] finished
0709 13:16:55.713010 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.713132 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16468,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":25398,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":45947,"spinlock_wait_cycles":36017024,"thread_start_us":75173,"threads_started":1,"wal-append.queue_time_us":184345}
I20260709 13:16:55.714607 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.728261 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.729653 10188 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:55.722302 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.719215 10181 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.730809 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.731184 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.723212 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:55.736405 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.737006 10188 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:55.736443 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.737845 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.739948 12401 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:55.740227 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.740381 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.740928 10182 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:55.741665 10187 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:55.742921 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.713459 12651 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.744443 12647 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:55.744730 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.744827 12647 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:55.745252 12647 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.745659 10708 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.746497 12401 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:55.747342 12401 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.749567 12649 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.750001 12649 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:55.588032 10112 rpcz_store.cc:276] 0709 13:16:53.867896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.869955 (+  2059us) service_pool.cc:224] Handling call
0709 13:16:53.892501 (+ 22546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.892718 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:53.911341 (+ 18623us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.347573 (+1436232us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18001388e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf 00007f3c6f502038
0709 13:16:55.532115 (+184542us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:55.565673 (+ 33558us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.565917 (+   244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.565970 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:55.566015 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.566078 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.566186 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140328,"prepare.queue_time_us":983853,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":5028,"raft.queue_time_us":34039,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":49416,"spinlock_wait_cycles":50200192,"thread_start_us":696230,"threads_started":2,"wal-append.queue_time_us":487336}
I20260709 13:16:55.663324 12575 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.745496 12543 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.751058 12543 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.751443 12543 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.751965 12580 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:55.752483 12580 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:55.752911 12405 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.753307 12580 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.755000 12405 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.756399 12665 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.750348 12649 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.738405 10188 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:55.762554 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.764706 10715 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:55.756413 10037 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:55.768141 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:55.765492 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.768697 10716 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.759132 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.769452 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:55.770928 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:55.772178 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49059.3us
I20260709 13:16:55.795676 10035 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:55.800009 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.768819 10181 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.770660 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.777613 10184 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:55.783151 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.783535 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.785210 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:55.785696 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:55.787487 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:55.721149 12673 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.787482 10183 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:55.721370 12690 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.788715 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:55.789022 12575 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.789422 12522 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:55.792243 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.793071 12515 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.758064 12262 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:55.813788 12675 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.757778 12686 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.787106 12665 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:16:55.823144 12252 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:55.804911 10037 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:55.774982 12304 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:55.812747 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.835139 12310 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.816201 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.856122 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:16:55.781626 12651 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:55.818331 10039 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:16:55.859409 10182 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:55.828397 10188 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:16:55.830454 10187 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:55.831554 10035 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:55.832034 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.861366 10112 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.834275 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.841158 10181 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:16:55.815729 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:16:55.800519 10716 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:55.835345 12575 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.872006 10714 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.812072 12699 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:16:55.878773 12686 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:55.765612 12391 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.854245 10037 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:55.854569 10155 connection.cc:256] RPC call timeout handler was delayed by -1.1071202580001227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:16:55.859105 10110 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:55.845466 12405 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.847489 12262 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:55.846855 12675 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.903563 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.874449 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.875150 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.906131 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1253) took 2000 ms. Trace:
I20260709 13:16:55.851838 12252 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:55.877454 12665 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:55.919889 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.877185 10713 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:55.881350 12575 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.919248 12650 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.904130 12413 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.936054 12413 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.938228 12413 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.929267 12252 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.919083 12675 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:55.940377 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58776.8us
I20260709 13:16:55.927342 12699 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.917300 12405 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.929003 12665 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:55.941143 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:55.942235 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.941960 12665 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.942715 12405 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:55.943125 12665 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.946024 12699 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.946712 12699 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.947068 12252 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.868430 12304 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:55.949407 12304 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.950781 12543 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.952876 12675 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:55.954802 12675 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.957840 12675 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.960675 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.961190 10708 raft_consensus.cc:606] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:55.967003 10708 raft_consensus.cc:614] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:55.967053 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:55.870782 12510 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.967752 12510 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.968146 12510 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.879487 12391 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:55.971134 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.972249 12391 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.943332 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:55.975164 12682 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.972366 12252 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.976258 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.976521 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.977376 12582 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.977933 12703 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.978544 10107 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.978701 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.978971 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:55.979444 10108 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:55.980189 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:55.981169 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.981951 10108 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:55.982999 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:16:55.983999 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.985447 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.972251 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:55.987517 10108 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.998453 10107 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:55.999117 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1256) took 1341 ms. Trace:
W20260709 13:16:56.006894 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50683.1us
I20260709 13:16:56.008178 10109 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:16:56.009089 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:55.872118 12683 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:55.931727 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.009092 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:56.009678 10109 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:16:56.015184 10112 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:16:56.019837 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:56.020195 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:56.020821 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:56.022930 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:56.025151 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:55.917135 12262 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.886471 10113 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:16:56.051528 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:56.052474 10113 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 9 because replica has last-logged OpId of term: 7 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:56.055462 10108 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:55.999408 10107 rpcz_store.cc:276] 0709 13:16:54.657593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.270800 (+613207us) service_pool.cc:224] Handling call
0709 13:16:55.271077 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.887310 (+616233us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b58004286d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4440aa 00007f3c6f4c6447 00007f3c6f4defe7 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4
0709 13:16:55.998873 (+111563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.999064 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411882368}
I20260709 13:16:55.887156 12686 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:56.058305 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:56.022141 12675 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.059578 12675 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:56.060572 12675 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:56.055923 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 201487us
I20260709 13:16:56.036355 12706 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:56.062680 12706 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:56.062891 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:56.063436 12609 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:56.063659 12706 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:56.064507 10003 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:56.065279 12609 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:56.065686 12609 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:56.066205 12536 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.067075 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:16:56.025244 12542 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:56.068785 10107 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:16:56.006232 12682 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:56.071512 10107 pending_rounds.cc:85] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 1
I20260709 13:16:56.077885 10107 pending_rounds.cc:107] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 7.2
I20260709 13:16:56.078166 10107 raft_consensus.cc:2889] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:56.066516 12609 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:56.080364 12609 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.075431 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.017539 12699 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.025434 12646 raft_consensus.cc:2764] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:56.104717 10112 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:56.107868 10036 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:56.109037 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.110311 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.086575 10108 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:56.085678 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:16:56.111375 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44366.1us
I20260709 13:16:56.111976 10035 raft_consensus.cc:2368] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:16:56.091816 12329 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.112468 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:56.093152 12510 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:56.036657 12578 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.036842 12252 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.084398 12401 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:55.868434 12310 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:56.036209 12687 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:16:56.078378 12515 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:56.124953 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:56.161545 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.065524 12683 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:56.069633 12693 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:56.121909 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.164505 10036 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.056275 12651 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:56.167245 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:56.069350 12686 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:56.076841 12660 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:56.183279 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:56.171633 10035 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:56.193348 10186 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:56.117024 12645 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:56.154090 12401 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:56.163825 12560 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:56.105854 12647 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:56.167945 12405 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:56.184566 12582 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:56.251797 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.118680 12578 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:56.262202 10036 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:16:56.263898 10715 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:56.200489 12515 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.517554 10031 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:56.913833 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:56.914109 12310 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:56.214290 12645 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.915123 12690 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.462385 10185 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.292169 12647 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:56.376348 12710 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:16:56.600449 10106 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:56.249141 12405 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:56.915303 12515 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:56.313774 12510 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:56.918519 12405 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:56.675725 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:56.785693 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 492) took 1059 ms. Trace:
I20260709 13:16:56.919672 12405 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.685556 12326 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:56.921406 12326 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:56.338441 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 315592us
W20260709 13:16:56.355822 12712 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:16:56.404342 12711 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:16:56.410072 12543 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:56.265391 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.927284 10035 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:16:56.924093 12645 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:56.930325 12515 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:56.674203 12699 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:55.906549 10115 rpcz_store.cc:276] 0709 13:16:53.906031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.920270 (+ 14239us) service_pool.cc:224] Handling call
0709 13:16:53.944043 (+ 23773us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:54.402121 (+458078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.402155 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:54.402773 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 13:16:54.495786 (+ 93013us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:55.276285 (+780499us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:16:55.888258 (+611973us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800319f00. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf
0709 13:16:55.888396 (+   138us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.888617 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.888695 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.888734 (+    39us) raft_consensus.cc:1685] finished
0709 13:16:55.888746 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.906069 (+ 17323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":859151,"prepare.queue_time_us":919182,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":17896,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":28725,"spinlock_wait_cycles":305987712,"thread_start_us":569094,"threads_started":3,"wal-append.queue_time_us":170685}
I20260709 13:16:56.790524 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:56.215106 12660 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:56.924782 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:56.494880 12684 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:56.705655  9935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 183) took 9986 ms. Trace:
I20260709 13:16:56.691516 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 349) took 1056 ms. Trace:
I20260709 13:16:56.962039 10039 rpcz_store.cc:276] 0709 13:16:55.634865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.866631 (+231766us) service_pool.cc:224] Handling call
0709 13:16:55.866877 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.514918 (+648041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.514948 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.514985 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.515023 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.691249 (+176226us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54002765d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:56.691313 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.691454 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489995136}
W20260709 13:16:56.468863 12649 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.001s
W20260709 13:16:56.686997 10110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2513) took 2124 ms (client timeout 1588 ms). Trace:
W20260709 13:16:56.963384 10110 rpcz_store.cc:269] 0709 13:16:54.562526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.562640 (+   114us) service_pool.cc:224] Handling call
0709 13:16:56.686662 (+2124022us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001c9654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:56.686823 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973241600}
I20260709 13:16:56.964706 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:56.618131 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.600167 10111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 379) took 1900 ms (client timeout 2231 ms). Trace:
W20260709 13:16:56.966709 10111 rpcz_store.cc:269] 0709 13:16:54.699572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.734446 (+ 34874us) service_pool.cc:224] Handling call
0709 13:16:56.599952 (+1865506us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54002b7d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:56.600095 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169184512}
I20260709 13:16:56.967932 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:56.968601 10111 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 2.
I20260709 13:16:56.969849 10111 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:56.970439 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2521) took 1258 ms. Trace:
I20260709 13:16:56.970768 10111 rpcz_store.cc:276] 0709 13:16:55.716225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.969361 (+1253136us) service_pool.cc:224] Handling call
0709 13:16:56.969657 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.970199 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.970384 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.516088 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:56.972250 10114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2519) took 1262 ms (client timeout 1502 ms). Trace:
W20260709 13:16:56.972604 10114 rpcz_store.cc:269] 0709 13:16:55.710245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.515807 (+805562us) service_pool.cc:224] Handling call
0709 13:16:56.972189 (+456382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.462225 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.914325 10036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39406
I20260709 13:16:56.910168  9938 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 4 to 6, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 6 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:56.974958 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.975557 10039 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:56.831851 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 368141us
I20260709 13:16:56.977365 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:56.833298 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:56.925508 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 201983us
I20260709 13:16:56.871552 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 693) took 2264 ms. Trace:
W20260709 13:16:56.288892 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.985594 10714 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:56.358078 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.987138 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1469) took 1116 ms. Trace:
I20260709 13:16:56.987496 10034 rpcz_store.cc:276] 0709 13:16:55.870589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.357790 (+487201us) service_pool.cc:224] Handling call
0709 13:16:56.987071 (+629281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.988643 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.763978 10109 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:56.989563 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2520) took 1279 ms. Trace:
I20260709 13:16:56.989899 10109 rpcz_store.cc:276] 0709 13:16:55.711437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.763358 (+1051921us) service_pool.cc:224] Handling call
0709 13:16:56.763722 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.989324 (+225602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.989503 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.990998 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:56.914417 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 355) took 1044 ms. Trace:
I20260709 13:16:56.925390 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 447) took 1215 ms. Trace:
I20260709 13:16:56.919927 10713 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:16:56.948226 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.010s	sys 0.026s
W20260709 13:16:56.465258 12667 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
I20260709 13:16:57.003412 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:57.004182 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.022s	sys 0.014s
I20260709 13:16:56.989778 10039 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
W20260709 13:16:56.512367 12669 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.751s	user 0.003s	sys 0.000s
W20260709 13:16:56.327390 12685 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:16:56.772915 12252 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.000s
W20260709 13:16:56.558923 12575 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.623s	user 0.002s	sys 0.007s
W20260709 13:16:56.788376 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.947831 12695 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.009s	sys 0.028s
I20260709 13:16:56.708305 12536 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:56.923497 12690 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:56.485204 12329 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.925351 12578 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:57.025192 10108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.010s	sys 0.009s
I20260709 13:16:56.687620 12516 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.787495 12672 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.783665 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:16:57.029029 12516 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.029109 12672 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.031620 12516 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:57.031797 12672 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:56.956738 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 701) took 1051 ms. Trace:
I20260709 13:16:56.376570 12561 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.919998 10182 rpcz_store.cc:276] 0709 13:16:55.726465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.741403 (+ 14938us) service_pool.cc:224] Handling call
0709 13:16:55.741618 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.859887 (+118269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.785400 (+925513us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001883d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:56.785624 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270448384}
I20260709 13:16:56.975138  9938 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 4 to 5, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.979321 10114 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:56.959156 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:56.992018 10707 rpcz_store.cc:276] 0709 13:16:55.709547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.711238 (+  1691us) service_pool.cc:224] Handling call
0709 13:16:55.711732 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.750833 (+ 39101us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:55.750864 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.751410 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.167968 (+416558us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.168005 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.168091 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.925169 (+757078us) raft_consensus.cc:1685] finished
0709 13:16:56.925187 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.925328 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38585,"raft.queue_time_us":43363,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":416194,"threads_started":1,"wal-append.queue_time_us":598419}
W20260709 13:16:56.992818 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.011s	sys 0.026s
I20260709 13:16:56.994127 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 401) took 1077 ms. Trace:
I20260709 13:16:56.994884 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.996595 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:57.004419 10185 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:56.810460 12609 consensus_meta.cc:287] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.730s	user 0.005s	sys 0.004s
W20260709 13:16:57.003455 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 170250us
I20260709 13:16:57.005540 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 516) took 1117 ms. Trace:
W20260709 13:16:56.950825 10153 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.017s	sys 0.039s
W20260709 13:16:57.006423 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.022s	sys 0.014s
I20260709 13:16:56.980966 10711 rpcz_store.cc:276] 0709 13:16:54.606902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.607107 (+   205us) service_pool.cc:224] Handling call
0709 13:16:56.871349 (+2264242us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54005dff54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:56.871484 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809252224}
I20260709 13:16:56.991892 10031 rpcz_store.cc:276] 0709 13:16:55.869569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.517066 (+647497us) service_pool.cc:224] Handling call
0709 13:16:56.517388 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.914148 (+396760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.914356 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.008314 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:56.952942 12686 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:16:56.957762 12262 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.000s
I20260709 13:16:56.978852 12515 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.019963 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 391) took 2202 ms. Trace:
I20260709 13:16:56.952790 12560 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:57.023968 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:16:56.955257 12683 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:56.349655 12580 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:57.033726 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 403) took 1088 ms. Trace:
I20260709 13:16:57.034402 10716 rpcz_store.cc:276] 0709 13:16:55.905635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.905782 (+   147us) service_pool.cc:224] Handling call
0709 13:16:56.790342 (+884560us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:56.956551 (+166209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69640064}
I20260709 13:16:56.923609 12326 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:56.955482 12699 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:56.439705 12651 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:56.401086 12401 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.011385 12652 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:57.223917 10709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.021s	sys 0.028s
I20260709 13:16:57.016639 12510 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.110109 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:57.038848  9938 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 3 to 4, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:57.388438 10182 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.389109  9938 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:16:57.320742 10713 rpcz_store.cc:276] 0709 13:16:55.888126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.935178 (+ 47052us) service_pool.cc:224] Handling call
0709 13:16:56.675538 (+740360us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:16:57.005474 (+329936us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60783360}
I20260709 13:16:57.317613 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2522) took 1595 ms. Trace:
I20260709 13:16:57.391917 10114 rpcz_store.cc:276] 0709 13:16:55.721971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.973239 (+1251268us) service_pool.cc:224] Handling call
0709 13:16:56.973526 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.317307 (+343781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.317545 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.393015 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:57.315492 10106 rpcz_store.cc:276] 0709 13:16:54.817727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.357021 (+539294us) service_pool.cc:224] Handling call
0709 13:16:56.600090 (+1243069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.917320 (+317230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.019681 (+102361us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002b7d50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:57.019886 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2858290048}
I20260709 13:16:57.394143 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:57.315567 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 319038us
W20260709 13:16:57.397509 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.320204 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1467) took 1128 ms. Trace:
W20260709 13:16:57.322635 10153 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.020s	sys 0.045s
W20260709 13:16:57.404307 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 1.26675e+06us
I20260709 13:16:57.027829 12536 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:16:57.039894 10108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.010s	sys 0.009s
I20260709 13:16:57.316201 10115 rpcz_store.cc:276] 0709 13:16:55.945770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.004455 (+1058685us) service_pool.cc:224] Handling call
0709 13:16:57.033200 (+ 28745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.033383 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.033408 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.033462 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.033502 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.033551 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.033663 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.316399 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 1.14918e+06us
W20260709 13:16:57.317142 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 358043us
W20260709 13:16:57.108963 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.281680 10078 leader_election.cc:336] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.595s (SENT)
I20260709 13:16:57.016353 12646 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.002882 12703 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:57.383824 10110 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
W20260709 13:16:57.384778 10709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.025s	sys 0.033s
W20260709 13:16:57.025720 12695 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.009s	sys 0.028s
I20260709 13:16:57.028133 12252 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:56.960204  9935 rpcz_store.cc:276] 0709 13:16:46.719555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.727010 (+  7455us) service_pool.cc:224] Handling call
0709 13:16:56.705564 (+9978554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:51.761474 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:51.762109 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:51.762156 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:16:51.762175 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:51.861267 (+ 99092us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:51.889176 (+ 27909us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:51.889208 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:16:51.890379 (+  1171us) tablet.cc:701] Row locks acquired
0709 13:16:51.890431 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:16:51.890593 (+   162us) write_op.cc:270] Start()
0709 13:16:51.890738 (+   145us) write_op.cc:276] Timestamp: P: 1783603011890530 usec, L: 0
0709 13:16:51.890756 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:51.891528 (+   772us) log.cc:844] Serialized 5962 byte log entry
0709 13:16:52.139389 (+247861us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b18002ef660. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c72f1d16c 00007f3c72eddc18 00007f3c753de2d1
0709 13:16:52.276317 (+136928us) op_driver.cc:464] REPLICATION: finished
0709 13:16:52.430307 (+153990us) write_op.cc:301] APPLY: starting
0709 13:16:52.440095 (+  9788us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:52.485784 (+ 45689us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:52.485826 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:52.526613 (+ 40787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:52.526986 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:16:52.527028 (+    42us) write_op.cc:312] APPLY: finished
0709 13:16:52.527418 (+   390us) log.cc:844] Serialized 107 byte log entry
0709 13:16:52.527638 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.534001 (+  6363us) write_op.cc:454] Released schema lock
0709 13:16:52.550698 (+ 16697us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:52.573515 (+ 22817us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.573547 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1144312,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":95191,"apply.run_cpu_time_us":6053,"apply.run_wall_time_us":191885,"num_ops":15,"prepare.queue_time_us":117927,"prepare.run_cpu_time_us":10041,"prepare.run_wall_time_us":230006,"raft.queue_time_us":152294,"raft.run_cpu_time_us":5745,"raft.run_wall_time_us":31410,"replication_time_us":385367,"spinlock_wait_cycles":17468672,"thread_start_us":261521,"threads_started":4,"wal-append.queue_time_us":144478,"wal-append.run_cpu_time_us":91939,"wal-append.run_wall_time_us":1565658}]]}
I20260709 13:16:57.321844 10109 rpcz_store.cc:276] 0709 13:16:55.916398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.993312 (+1076914us) service_pool.cc:224] Handling call
0709 13:16:56.993625 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.993811 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.993837 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.993881 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:56.993919 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.993969 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.994070 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.401119 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:16:57.403689 10185 rpcz_store.cc:276] 0709 13:16:56.192046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.461954 (+269908us) service_pool.cc:224] Handling call
0709 13:16:56.462264 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.319917 (+857653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.320138 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.395327 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:57.408142 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.409350 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.391052  9938 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 4 to 5, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.415143 10040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.010s	sys 0.068s
I20260709 13:16:57.172636 12542 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:57.159924 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:16:57.008785 12649 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.034073 12647 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.452s
I20260709 13:16:57.028512 12684 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.450s
I20260709 13:16:57.385433 12515 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.035952 12575 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.063195 12329 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:57.768903 10040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.023s	sys 0.087s
W20260709 13:16:57.581894 10032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.043s	sys 0.023s
W20260709 13:16:57.732216 10186 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.001s	sys 0.036s
W20260709 13:16:57.581708 10180 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.007s	sys 0.057s
I20260709 13:16:57.623219 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1276) took 1917 ms. Trace:
W20260709 13:16:57.648324 10037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.004s	sys 0.030s
W20260709 13:16:57.484441 10188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.024s	sys 0.035s
I20260709 13:16:57.168356 12690 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.648116 10181 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.017s	sys 0.017s
W20260709 13:16:57.770473 10032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.046s	sys 0.038s
I20260709 13:16:57.768682 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:16:57.771510 10188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.035s	sys 0.048s
W20260709 13:16:57.520911 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.793643 10183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.006s	sys 0.012s
W20260709 13:16:57.797773 10183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.006s	sys 0.013s
W20260709 13:16:57.795933 10181 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.021s	sys 0.019s
W20260709 13:16:57.732438 10113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.017s	sys 0.037s
I20260709 13:16:57.798604 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1469) took 1384 ms. Trace:
I20260709 13:16:57.773152 10106 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:57.774895 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:16:57.771185 10180 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.015s	sys 0.068s
W20260709 13:16:57.771431 10186 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.003s	sys 0.037s
W20260709 13:16:57.772342 10037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.006s	sys 0.034s
I20260709 13:16:57.775249  9938 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 3 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:16:57.771111 10107 rpcz_store.cc:276] 0709 13:16:55.705380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.070956 (+365576us) service_pool.cc:224] Handling call
0709 13:16:56.071308 (+   352us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:56.078817 (+  7509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.078858 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:56.079475 (+   617us) log.cc:844] Serialized 78 byte log entry
0709 13:16:56.913031 (+833556us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:56.913084 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.913158 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.622968 (+709810us) raft_consensus.cc:1685] finished
0709 13:16:57.622988 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.623149 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":323513,"threads_started":1,"wal-append.queue_time_us":1541812}
I20260709 13:16:57.806933 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1476) took 1873 ms. Trace:
I20260709 13:16:57.807502 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:57.808151 10107 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.807281 10037 rpcz_store.cc:276] 0709 13:16:55.933825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.765728 (+831903us) service_pool.cc:224] Handling call
0709 13:16:56.766007 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.932710 (+166703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.932742 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.933166 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.806606 (+873440us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:57.806644 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.806708 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.806749 (+    41us) raft_consensus.cc:1685] finished
0709 13:16:57.806760 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.806875 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166277,"raft.queue_time_us":166408,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":867906,"threads_started":1,"wal-append.queue_time_us":824681}
I20260709 13:16:57.808350  9938 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 3 to 5, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.809973 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:57.810603 10037 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:16:57.810500  9938 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.494124 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:16:57.811945 10037 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:57.776130 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 702) took 1870 ms. Trace:
I20260709 13:16:57.774310 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1277) took 2068 ms. Trace:
I20260709 13:16:57.812397  9938 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 2, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.814985  9938 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.429131 10182 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:16:57.805557 10183 rpcz_store.cc:276] 0709 13:16:56.414047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.697086 (+283039us) service_pool.cc:224] Handling call
0709 13:16:56.697469 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.697850 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.697879 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.862655 (+164776us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.798275 (+935620us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.798319 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.798379 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.798424 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:57.798435 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.798549 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1354,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":884915,"threads_started":1,"wal-append.queue_time_us":894069}
I20260709 13:16:57.820667 10183 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:57.381024 12578 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.063405 12644 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.386010 12665 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.008s	sys 0.018s
I20260709 13:16:57.280853 12310 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.793588 12623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.414s	user 0.000s	sys 0.021s
I20260709 13:16:57.794900 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:57.798916 10113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.018s	sys 0.038s
W20260709 13:16:57.732674 10152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.008s	sys 0.016s
I20260709 13:16:57.831507 10187 raft_consensus.cc:2410] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:57.831629 10152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.008s	sys 0.016s
I20260709 13:16:57.796736 10109 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
W20260709 13:16:57.832777 10112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.015s	sys 0.030s
W20260709 13:16:57.833349 10112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.016s	sys 0.030s
I20260709 13:16:57.800310 12730 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:57.773032 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:16:57.793689 12654 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.006s	sys 0.013s
I20260709 13:16:57.208578 12660 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:57.813443 10108 rpcz_store.cc:276] 0709 13:16:55.705679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.113381 (+407702us) service_pool.cc:224] Handling call
0709 13:16:56.113702 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.165016 (+ 51314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.165051 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.165577 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.774002 (+1608425us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:57.774040 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.774103 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.774143 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:57.774154 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.774257 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53179,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3299,"thread_start_us":1574008,"threads_started":1,"wal-append.queue_time_us":1304087}
W20260709 13:16:57.793274 10184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.003s	sys 0.015s
I20260709 13:16:57.386961 12663 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.190861 12621 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.822369 10111 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:57.822885 10106 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.826287 10714 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:57.613329 12405 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.000s
W20260709 13:16:57.740175 12567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.001s	sys 0.005s
I20260709 13:16:57.108104 12672 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:57.402309 12686 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:57.590051 12719 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:57.829479 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:57.812805 10709 rpcz_store.cc:276] 0709 13:16:55.905899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.906309 (+   410us) service_pool.cc:224] Handling call
0709 13:16:55.906664 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.242132 (+335468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.242166 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.242686 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.775718 (+1533032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:57.775773 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.775900 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.775943 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:57.775955 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.776076 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37361,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":1867772,"threads_started":2,"wal-append.queue_time_us":1267233}
I20260709 13:16:57.833226 10109 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:57.799827 12716 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.833702 10716 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:57.586848 12519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.009s	sys 0.025s
W20260709 13:16:57.834195 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 552535us
I20260709 13:16:57.834247 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:57.603010 12645 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.000s
I20260709 13:16:57.834877 10107 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:16:57.403339 12580 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:57.757983 12401 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:57.836357 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 64335.4us
I20260709 13:16:57.512346 12582 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:57.618337 12722 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.406319 12652 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:16:57.469772 12667 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:57.756953 12727 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:57.389298 12262 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.385875 12683 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.821341 12609 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:57.833670 12665 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.013s	sys 0.028s
W20260709 13:16:57.833945 12623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.455s	user 0.000s	sys 0.021s
I20260709 13:16:57.763200 12749 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.955394 12519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.013s	sys 0.030s
W20260709 13:16:57.903409 10081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.007s	sys 0.032s
I20260709 13:16:57.949707 10109 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:57.983127 10081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.008s	sys 0.033s
I20260709 13:16:57.950788 10185 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:16:57.951318 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 404) took 1981 ms. Trace:
I20260709 13:16:57.985849 10106 rpcz_store.cc:276] 0709 13:16:55.970055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.822455 (+1852400us) service_pool.cc:224] Handling call
0709 13:16:57.822723 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.951078 (+128355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.951258 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.803875 12675 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:57.832242 12734 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
W20260709 13:16:57.952021 10184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.004s	sys 0.017s
I20260709 13:16:57.404762 12510 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:58.009891 10708 raft_consensus.cc:606] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:57.386018 12560 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:57.962497 10004 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.008s
W20260709 13:16:58.075028 10004 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.020s	sys 0.008s
W20260709 13:16:58.075352 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 775357us
W20260709 13:16:57.948266 12654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.006s	sys 0.014s
I20260709 13:16:57.836514 10033 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:57.896775 12646 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.974606 10108 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:57.962615 12621 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.802778 12542 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.952965 12582 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.948946 12686 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:58.047098 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 139428us
W20260709 13:16:58.047786 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 98491.5us
I20260709 13:16:57.907702 12754 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:16:57.957350 12660 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.498378 12699 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.952507 12663 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:57.822324 12690 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:58.063843 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.866298 12644 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.969357 12609 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:16:57.835829 12310 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.947791 12684 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:16:57.960314 12722 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:58.179375 12723 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:16:58.070103 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 271494us
I20260709 13:16:57.837044 12578 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:57.827847 12543 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.062181 12748 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:16:58.099756 10078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.501s (SENT) [suppressed 25 similar messages]
I20260709 13:16:57.960408 12672 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.959766 12645 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.064011 12623 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.211548 12767 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.235957 12621 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:58.236135 12767 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.236209 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1275) took 2531 ms. Trace:
I20260709 13:16:58.223901 12543 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:58.061012 12703 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:58.238026 12560 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.237231 10113 rpcz_store.cc:276] 0709 13:16:55.704800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.068389 (+363589us) service_pool.cc:224] Handling call
0709 13:16:56.086609 (+ 18220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.086980 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.087009 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.107172 (+ 20163us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.951141 (+843969us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18003d8700. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:16:57.831319 (+880178us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:57.831359 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.831434 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.235911 (+404477us) raft_consensus.cc:1685] finished
0709 13:16:58.235931 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.236143 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48207,"raft.queue_time_us":16880,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":3099,"spinlock_wait_cycles":9367424,"thread_start_us":879966,"threads_started":1,"wal-append.queue_time_us":1691935}
I20260709 13:16:57.975776 12405 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:16:57.947480 12730 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:57.959986 12727 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.149184 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:16:58.145607 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1465) took 2021 ms. Trace:
I20260709 13:16:58.074753 10708 raft_consensus.cc:614] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:58.155469 10039 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:16:58.076560 12729 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:58.163139 12622 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.164359 10035 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.176504 12660 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:58.165222 12329 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:58.166110 12737 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:16:58.173148 12510 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:58.159328 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:16:58.181411 10114 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:58.136875 12647 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.195595 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.201216 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 428231us
I20260709 13:16:58.012034 10189 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:16:57.970451 12716 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.157287 12686 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:58.199868 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 425733us
W20260709 13:16:58.069568 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 85311.7us
I20260709 13:16:58.135874 12695 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:58.143014 12764 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.213729 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.055644 12749 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.221516 10109 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:58.176697 12663 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:58.223963 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 124272us
I20260709 13:16:58.203109 12646 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.232290 12756 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:58.233194 12672 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.234496 12644 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.235164 12645 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.058398 12651 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.235755 12623 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.236630 12621 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.951311 12567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.486s	user 0.005s	sys 0.005s
I20260709 13:16:57.960182 12667 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.239542 10038 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:16:58.242133 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93035.4us
I20260709 13:16:58.256191 12575 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:58.242070 10186 rpcz_store.cc:276] 0709 13:16:56.124359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.194039 (+ 69680us) service_pool.cc:224] Handling call
0709 13:16:56.249863 (+ 55824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.250078 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:57.806172 (+1556094us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.145179 (+339007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.145241 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:58.145310 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.145382 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.145536 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627086,"prepare.queue_time_us":660911,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"thread_start_us":1264153,"threads_started":2,"wal-append.queue_time_us":423267}
I20260709 13:16:58.176270 12754 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:58.184767 12771 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:16:58.247964 12722 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.217898 12699 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.219664 12519 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.138525 12580 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.154938 12652 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.237346 12515 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.254119 12609 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.486431 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1473) took 2614 ms. Trace:
W20260709 13:16:58.701151 10180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.011s	sys 0.018s
W20260709 13:16:58.711058 10180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.018s
I20260709 13:16:58.709928 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:58.709914 10040 rpcz_store.cc:276] 0709 13:16:55.871630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.517997 (+646367us) service_pool.cc:224] Handling call
0709 13:16:56.518317 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.518747 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:56.519075 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.803452 (+1284377us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:57.803998 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.804145 (+   147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.804369 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.137383 (+333014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.137519 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.486170 (+348651us) raft_consensus.cc:1685] finished
0709 13:16:58.486192 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.486339 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39378,"raft.queue_time_us":194111,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":43381,"spinlock_wait_cycles":30887168,"thread_start_us":1583301,"threads_started":2,"wal-append.queue_time_us":1243769}
I20260709 13:16:58.715858 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:58.497435 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 227002us
I20260709 13:16:58.647517 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 513) took 2771 ms. Trace:
I20260709 13:16:58.718060 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:16:58.643379 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1474) took 2769 ms. Trace:
W20260709 13:16:59.342465 10078 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.195s (SENT)
I20260709 13:16:59.345248 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:58.718977 10032 rpcz_store.cc:276] 0709 13:16:55.873466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.699762 (+826296us) service_pool.cc:224] Handling call
0709 13:16:56.700138 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:56.931975 (+231837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.932011 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:56.932616 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:16:57.796222 (+863606us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.796270 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.642798 (+846528us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540031c9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:58.642867 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.642934 (+    67us) raft_consensus.cc:1685] finished
0709 13:16:58.642952 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.643282 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8694,"raft.queue_time_us":9003,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":511846144,"thread_start_us":863166,"threads_started":1,"wal-append.queue_time_us":867498,"wal-append.run_cpu_time_us":1755,"wal-append.run_wall_time_us":1002950}
I20260709 13:16:58.529498 10035 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
W20260709 13:16:59.337206  9938 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.494s	user 0.003s	sys 0.018s
W20260709 13:16:59.348464  9938 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.516s	user 0.005s	sys 0.018s
I20260709 13:16:59.083863 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 392) took 3365 ms. Trace:
I20260709 13:16:59.349218 10111 rpcz_store.cc:276] 0709 13:16:55.718150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.971487 (+1253337us) service_pool.cc:224] Handling call
0709 13:16:56.990694 (+ 19207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.954688 (+963994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.081692 (+1127004us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400362754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:59.083776 (+  2084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912258304}
W20260709 13:16:59.046717 10152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.011s	sys 0.059s
W20260709 13:16:59.352597 10152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.015s	sys 0.066s
W20260709 13:16:59.354288 10039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 359) took 2395 ms (client timeout 2107 ms). Trace:
W20260709 13:16:59.356045 10080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.285s	user 0.002s	sys 0.016s
W20260709 13:16:59.356590 10080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.002s	sys 0.016s
W20260709 13:16:58.763482 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45495.8us
W20260709 13:16:58.293191 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 133951us
W20260709 13:16:59.358232 10035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1480) took 2404 ms (client timeout 2083 ms). Trace:
W20260709 13:16:59.358801 10035 rpcz_store.cc:269] 0709 13:16:56.953600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.955018 (+  1418us) service_pool.cc:224] Handling call
0709 13:16:59.357722 (+2402704us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54003bd3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:59.358003 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933379840}
W20260709 13:16:59.344448 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.129s	user 0.007s	sys 0.004s
W20260709 13:16:59.354979 10039 rpcz_store.cc:269] 0709 13:16:56.958191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.008021 (+ 49830us) service_pool.cc:224] Handling call
0709 13:16:59.353558 (+2345537us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400277ed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:59.353961 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928439552}
W20260709 13:16:58.701581 10682 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.015s
W20260709 13:16:59.362247 10682 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.015s	sys 0.043s
W20260709 13:16:58.910125 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 190882us
I20260709 13:16:58.764019 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:16:59.345124 10005 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.010s	sys 0.000s
W20260709 13:16:59.009289 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.009s	sys 0.021s
W20260709 13:16:59.081228 12654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.029s	sys 0.043s
I20260709 13:16:59.374567 12567 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:16:59.375270 12654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.215s	user 0.049s	sys 0.065s
I20260709 13:16:58.720191 12651 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:59.213500 12774 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
I20260709 13:16:59.379067 12651 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:58.310968 12405 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 1.069s
I20260709 13:16:58.767565 12751 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.083712 12329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.026s	sys 0.036s
I20260709 13:16:58.720047 12621 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:59.287931 12754 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:59.381431 12775 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.382298 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.383558 10189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 491) took 3657 ms (client timeout 1546 ms). Trace:
I20260709 13:16:58.498229 12730 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:59.362908 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 1.23131e+06us
W20260709 13:16:59.086877 10184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.004s	sys 0.054s
W20260709 13:16:59.334470  8944 debug-util.cc:398] Leaking SignalData structure 0x7b080039d520 after lost signal to thread 9938
W20260709 13:16:59.385380 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.008s	sys 0.004s
W20260709 13:16:59.387111 10005 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.011s	sys 0.000s
I20260709 13:16:59.380875 12515 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:58.279672 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51490 (request call id 1) took 1548 ms. Trace:
W20260709 13:16:58.823196 10181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.007s	sys 0.015s
I20260709 13:16:59.371385 10081 leader_election.cc:400] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:16:58.330304 12683 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:59.412352 12667 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:59.413300 12667 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:59.414321 12623 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.667220 12310 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.502779 12543 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:58.507756 12690 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:59.416131 12543 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.720443 12519 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.501886 12727 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.291100 12716 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:59.417062 12543 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:58.794536 12772 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.639s
I20260709 13:16:59.418835 10708 rpcz_store.cc:276] 0709 13:16:56.712651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.761685 (+ 49034us) service_pool.cc:224] Handling call
0709 13:16:57.968834 (+1207149us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c4c40 00007f3c744b0bb9 00007f3c744b047c 00007f3c6da367d4
0709 13:16:58.261143 (+292309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9277184}
W20260709 13:16:59.419972 10184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.007s	sys 0.060s
I20260709 13:16:59.420657 12621 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:59.421458 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1468) took 3170 ms. Trace:
W20260709 13:16:58.515110 12401 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.004s
I20260709 13:16:59.421965 10184 rpcz_store.cc:276] 0709 13:16:56.250626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.496166 (+245540us) service_pool.cc:224] Handling call
0709 13:16:56.496524 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.496748 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:58.068619 (+1571871us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.420726 (+1352107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.420838 (+   112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:59.420989 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.421107 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.421358 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372581,"prepare.queue_time_us":414612,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1572,"thread_start_us":2550504,"threads_started":2,"wal-append.queue_time_us":1163038}
I20260709 13:16:58.516568 12755 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:58.266256 12729 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:59.424582 12755 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:59.425153 12755 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.426451 12729 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:59.183812 12695 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.427906 12754 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.428515 12695 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:58.780340 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:58.279162 12649 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:59.431914 10038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 356) took 3539 ms (client timeout 2868 ms). Trace:
W20260709 13:16:59.432468 10038 rpcz_store.cc:269] 0709 13:16:55.869822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.461971 (+592149us) service_pool.cc:224] Handling call
0709 13:16:59.389203 (+2927232us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400276ad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:59.408792 (+ 19589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909753088}
W20260709 13:16:59.403980 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 1.18867e+06us
I20260709 13:16:59.435031 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:16:58.729440 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1463) took 2588 ms. Trace:
I20260709 13:16:59.382320 12775 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:16:59.437816 12695 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:59.438705 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:59.440789 12782 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.441115 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 406) took 2122 ms. Trace:
I20260709 13:16:58.513054 12542 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:58.494586 12703 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:59.443564 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 679456us
I20260709 13:16:59.190122 12749 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:16:59.448024 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.009s	sys 0.030s
I20260709 13:16:59.441784 12772 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:59.384526 10189 rpcz_store.cc:269] 0709 13:16:55.726224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.730599 (+  4375us) service_pool.cc:224] Handling call
0709 13:16:59.382735 (+3652136us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54003f1bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:59.383123 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5242478848}
W20260709 13:16:59.448596 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 1.22933e+06us
I20260709 13:16:58.292011 12647 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:16:59.436268 12753 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.523s	user 0.010s	sys 0.006s
I20260709 13:16:59.449050 12772 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:16:58.717900 10715 rpcz_store.cc:276] 0709 13:16:55.875829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.876270 (+   441us) service_pool.cc:224] Handling call
0709 13:16:55.915119 (+ 38849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.915690 (+1000571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.647178 (+1731488us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400640354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:58.647442 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801441536}
W20260709 13:16:59.486652 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49034.7us
I20260709 13:16:59.488346 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 351) took 3767 ms. Trace:
I20260709 13:16:58.779093 12575 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:58.703711 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 521) took 1719 ms. Trace:
I20260709 13:16:58.500674 12767 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.761972 12764 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:58.503192 12262 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:58.493809 12765 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.717002 12771 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:16:59.490554 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.380268 12787 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.375900 12567 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:58.632992 12582 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:16:59.484438 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:16:58.499228 12758 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
W20260709 13:16:59.085031 12724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.008s	sys 0.025s
I20260709 13:16:58.514348 12660 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:16:59.503139 10181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.012s	sys 0.029s
W20260709 13:16:59.493625 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58894.3us
I20260709 13:16:59.505748 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:59.439546 12775 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:16:59.503935 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:59.428874 12754 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:59.503301 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:16:58.260877 12622 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:16:59.501266 10110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2523) took 2560 ms (client timeout 2150 ms). Trace:
I20260709 13:16:59.522320 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1485) took 2193 ms. Trace:
I20260709 13:16:59.441612 10109 rpcz_store.cc:276] 0709 13:16:57.318975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.985151 (+666176us) service_pool.cc:224] Handling call
0709 13:16:57.985470 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.717574 (+732104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.440471 (+722897us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400420c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:59.440852 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542006656}
W20260709 13:16:59.807914 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.447921 12749 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:59.918406 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 140663us
W20260709 13:16:59.514798 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 155558us
W20260709 13:16:59.502923 12329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.032s	sys 0.055s
W20260709 13:16:59.668641 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 280284us
I20260709 13:16:59.827387 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:16:59.739152 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1479) took 1021 ms. Trace:
W20260709 13:16:59.966948 10107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.000s	sys 0.016s
I20260709 13:16:58.719651 12759 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:16:59.500139 12695 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.520143 12543 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:16:59.491701 12326 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:16:59.515134 12716 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.700572 10078 leader_election.cc:336] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.601s (SENT)
I20260709 13:16:59.834232 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:16:59.528131 10189 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:16:59.972842 10031 rpcz_store.cc:276] 0709 13:16:57.328454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.812367 (+483913us) service_pool.cc:224] Handling call
0709 13:16:59.406403 (+1594036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.413081 (+  6678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.413111 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.413202 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:59.413239 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.413316 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.521957 (+108641us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400277ed0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:59.522098 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3558834944}
W20260709 13:16:59.974268 10110 rpcz_store.cc:269] 0709 13:16:56.941029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.964417 (+ 23388us) service_pool.cc:224] Handling call
0709 13:16:59.500804 (+2536387us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000b4d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:16:59.501018 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962103040}
I20260709 13:16:59.492908 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:16:59.989037 10187 rpcz_store.cc:276] 0709 13:16:58.717417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.717625 (+   208us) service_pool.cc:224] Handling call
0709 13:16:58.717900 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.792710 (+ 74810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.792753 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.792797 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:58.792841 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.738544 (+945703us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b5400002dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:59.738627 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.738930 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171478400}
I20260709 13:16:59.511530 12764 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:16:59.517710 12567 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:16:59.505287 10033 rpcz_store.cc:276] 0709 13:16:55.635334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.514156 (+878822us) service_pool.cc:224] Handling call
0709 13:16:56.514433 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.134505 (+1620072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.365312 (+1230807us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000654d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:59.402660 (+ 37348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039918848}
I20260709 13:16:59.739529 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:16:59.524479 12752 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.615s	user 0.014s	sys 0.004s
I20260709 13:16:59.494000 12727 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:59.527558 12582 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:00.001312 10107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.514s	user 0.002s	sys 0.016s
I20260709 13:16:59.700999 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:16:59.992870 12755 consensus_meta.cc:287] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.004s
I20260709 13:16:59.521020 12647 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.003810 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1484) took 1204 ms. Trace:
I20260709 13:16:59.503656 12401 consensus_queue.cc:1059] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.504s
I20260709 13:16:59.510598 12765 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:59.493108 12781 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:16:59.977422 12749 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:16:59.706635 12787 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.006574 12782 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:00.014375 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:16:59.441663 12751 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:16:59.436388 10180 rpcz_store.cc:276] 0709 13:16:56.123886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.162397 (+ 38511us) service_pool.cc:224] Handling call
0709 13:16:56.190560 (+ 28163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.190778 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:57.805864 (+1615086us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.711776 (+905912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.711844 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:58.711898 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.711965 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.712091 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29047,"prepare.queue_time_us":719998,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":147512,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9582,"thread_start_us":1839838,"threads_started":3,"wal-append.queue_time_us":529661,"wal-append.run_cpu_time_us":1622,"wal-append.run_wall_time_us":1162336}
I20260709 13:16:59.488865 12515 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:00.008095 12724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.523s	user 0.009s	sys 0.032s
I20260709 13:17:00.016768 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:00.003050 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.018924 10189 rpcz_store.cc:276] 0709 13:16:58.793708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.483838 (+690130us) service_pool.cc:224] Handling call
0709 13:16:59.998027 (+514189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:00.022159 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 426036us
I20260709 13:16:59.112509 12722 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.901s
I20260709 13:16:59.502799 12772 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.026273 10113 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:16:58.768100 12646 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.025579 10108 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:16:59.994867 12621 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:59.527233 10715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:16:59.416067 12310 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.613s
W20260709 13:17:00.035550 10155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.004s	sys 0.010s
W20260709 13:17:00.044050 10155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.005s	sys 0.011s
W20260709 13:17:00.044381 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 679232us
I20260709 13:17:00.028600 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.027895 12765 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.499634 12536 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:00.045076 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.020171 12755 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.050310 12769 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.508240 10712 rpcz_store.cc:276] 0709 13:16:56.984499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.003868 (+ 19369us) service_pool.cc:224] Handling call
0709 13:16:58.644581 (+1640713us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:16:58.669728 (+ 25147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.678473 (+  8745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.683446 (+  4973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.700612 (+ 17166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:58.702517 (+  1905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.703474 (+   957us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.703636 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103989120}
I20260709 13:17:00.046800 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:00.057855 12513 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.058760 12513 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.052853 12769 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.062647 12769 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:00.057868 12739 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 2.110s	user 0.013s	sys 0.015s
W20260709 13:17:00.076977 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62863.3us
I20260709 13:17:00.027297 12716 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.049005 10715 raft_consensus.cc:606] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.088006 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.090009 10715 raft_consensus.cc:614] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.030695 12326 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.063953 12647 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:00.092053 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:00.046591 12405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.003s	sys 0.012s
W20260709 13:17:00.079392 12790 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.014s
W20260709 13:17:00.050267 12703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.017s
W20260709 13:17:00.100777 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 641410us
I20260709 13:17:00.101289 10187 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.101203 10110 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.101539 12326 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.102766 12660 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.103633 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1461) took 3980 ms. Trace:
W20260709 13:17:00.107412 12763 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.814s	user 0.014s	sys 0.016s
I20260709 13:17:00.108613 12515 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.109138 12751 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:00.091362 12580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.021s
I20260709 13:17:00.094693 10708 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:17:00.109141 12791 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.371s	user 0.000s	sys 0.014s
W20260709 13:17:00.151835 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72285.2us
W20260709 13:17:00.111063 12405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.003s	sys 0.015s
W20260709 13:17:00.127638 12790 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.013s	sys 0.015s
W20260709 13:17:00.150318 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 149918us
W20260709 13:17:00.150441 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55142.8us
I20260709 13:17:00.109730 12519 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.051474 12781 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.132393 12623 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.168416 12623 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:00.169687 12623 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:00.131140 12703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.012s	sys 0.020s
I20260709 13:17:00.172858 12759 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:00.152294 12580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.001s	sys 0.021s
I20260709 13:17:00.161888 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1282) took 4416 ms. Trace:
W20260709 13:17:00.162460 10114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2529) took 3124 ms (client timeout 1507 ms). Trace:
I20260709 13:17:00.163162 12622 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.164034 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 704) took 2343 ms. Trace:
I20260709 13:17:00.164072 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:17:00.161299 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68611.2us
I20260709 13:17:00.084136 12787 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:00.178210 10114 rpcz_store.cc:269] 0709 13:16:57.034844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.392722 (+357878us) service_pool.cc:224] Handling call
0709 13:17:00.123854 (+2731132us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54000b5754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:00.158725 (+ 34871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1811201792}
I20260709 13:17:00.180788 10713 rpcz_store.cc:276] 0709 13:16:57.806210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.806358 (+   148us) service_pool.cc:224] Handling call
0709 13:16:57.806728 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.250195 (+443467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.250230 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.250287 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:58.250330 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.093540 (+1843210us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540049cd54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:00.099184 (+  5644us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.149479 (+ 50295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019361536}
I20260709 13:17:00.159142 12536 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.094916 12329 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:17:00.205312 10184 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
W20260709 13:17:00.208506 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44698.4us
I20260709 13:17:00.202939 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.206156 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.132285 10188 rpcz_store.cc:276] 0709 13:16:56.123326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.123468 (+   142us) service_pool.cc:224] Handling call
0709 13:16:56.123818 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.221026 (+ 97208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.221058 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.831796 (+610738us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.797007 (+965211us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.797047 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.403318 (+1606271us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b540019c3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:16:59.495110 (+ 91792us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.056948 (+561838us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:00.103224 (+ 46276us) raft_consensus.cc:1685] finished
0709 13:17:00.103244 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.103456 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17786,"raft.queue_time_us":17902,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10419,"spinlock_wait_cycles":379354752,"thread_start_us":964893,"threads_started":1,"wal-append.queue_time_us":965316}
I20260709 13:17:00.209663 10115 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:00.225077 12755 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.225378 12716 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.226668 12580 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.227346 12580 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.229931 12580 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.230545 12580 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:00.232285 12405 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.232896 12405 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.201258 12660 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:00.234237 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:00.238095 10078 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.977s (SENT)
I20260709 13:17:00.178056 10112 rpcz_store.cc:276] 0709 13:16:55.707041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.701041 (+994000us) service_pool.cc:224] Handling call
0709 13:16:56.701374 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:56.701758 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.701785 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:56.861095 (+159310us) log.cc:844] Serialized 52 byte log entry
0709 13:16:57.833923 (+972828us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:57.833964 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.834029 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.499060 (+1665031us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:00.109747 (+610687us) raft_consensus.cc:1685] finished
0709 13:17:00.109767 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.123871 (+ 14104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9007,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":89,"spinlock_wait_cycles":341337344,"thread_start_us":920328,"threads_started":1,"wal-append.queue_time_us":1048050}
W20260709 13:17:00.236752 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 731230us
I20260709 13:17:00.206573 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:00.246435 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:00.246726 12663 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.479s	user 0.007s	sys 0.014s
W20260709 13:17:00.247924 12686 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.486s	user 0.011s	sys 0.009s
W20260709 13:17:00.251896 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.208524 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.219261 12754 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.218601 12751 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.215714 12749 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.247044 12802 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.137485 12782 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.255420 10187 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:00.255780 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.239686 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2531) took 3001 ms. Trace:
I20260709 13:17:00.259039 12660 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.260886 10106 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:00.261863 12663 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.262310 12513 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.273645 10110 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:00.275947 12623 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:00.281471 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.293633 10033 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:00.281984 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.284765 10188 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:00.282456 10112 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:00.283573 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.265575 12686 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.277488 12329 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:00.284729 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 105389us
I20260709 13:17:00.285447 12646 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:00.285794 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 86034.6us
W20260709 13:17:00.286371 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 75032.1us
I20260709 13:17:00.286728 12772 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.292626 12749 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.293396 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:00.274446 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.297627 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1480) took 1548 ms. Trace:
W20260709 13:17:00.263587 10679 connection.cc:256] RPC call timeout handler was delayed by -2.4378505919999043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:17:00.301002 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 60989.5us
I20260709 13:17:00.306361 10186 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:00.306150 10187 rpcz_store.cc:276] 0709 13:16:58.720001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.024487 (+1304486us) service_pool.cc:224] Handling call
0709 13:17:00.268329 (+243842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.308161 10185 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:00.268003 10107 rpcz_store.cc:276] 0709 13:16:57.238388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.950023 (+711635us) service_pool.cc:224] Handling call
0709 13:16:57.950282 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.950472 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:58.394374 (+443902us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.108360 (+1713986us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:00.153614 (+ 45254us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.153971 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.175119 (+ 21148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.180326 (+  5207us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.198354 (+ 18028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.208147 (+  9793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.239613 (+ 31466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2696,"prepare.queue_time_us":1496470,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":132,"raft.queue_time_us":5520,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"spinlock_wait_cycles":3732224,"thread_start_us":2021269,"threads_started":3,"wal-append.queue_time_us":1302636}
I20260709 13:17:00.303310 12329 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:00.310226 12329 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.310729 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.311581 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.312376 10039 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:00.313515 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.311929 12751 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:00.314997 12751 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:00.316303 12751 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.320160 12686 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.321734 10034 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:00.311481 10712 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:00.322970 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.301864 12663 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:00.326936 12575 consensus_meta.cc:287] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.003s
I20260709 13:17:00.327471 12781 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.328307 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1482) took 1549 ms. Trace:
I20260709 13:17:00.328867 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:00.329231 10078 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.041s (SENT)
I20260709 13:17:00.325687 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.333024 10189 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:17:00.333657 12699 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.583s	user 0.007s	sys 0.009s
I20260709 13:17:00.334452 12759 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.338279 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.339385 12623 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:00.341197 10036 raft_consensus.cc:606] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:17:00.349778 10036 raft_consensus.cc:614] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.342192 12720 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:00.299805 12765 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.344442 12651 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.351091 10108 raft_consensus.cc:2410] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:00.346091 10180 rpcz_store.cc:276] 0709 13:16:58.778866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.035994 (+1257128us) service_pool.cc:224] Handling call
0709 13:17:00.052285 (+ 16291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.092377 (+ 40092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.092409 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.131848 (+ 39439us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.234865 (+103017us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:00.234931 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.235013 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.328005 (+ 92992us) raft_consensus.cc:1685] finished
0709 13:17:00.328030 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.328202 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10786,"raft.queue_time_us":36933,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":15427,"thread_start_us":85262,"threads_started":1,"wal-append.queue_time_us":162054}
I20260709 13:17:00.352910 10188 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:00.320380 12787 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.356259 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.364884 12720 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.368255 10033 raft_consensus.cc:2410] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:00.368422 10183 raft_consensus.cc:2410] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:00.369489 12776 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.369942 12720 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.370097 12776 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.360234 10038 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:00.373246 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.374234 12762 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.374025 12810 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:00.374639 12762 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:00.375072 12762 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.362457 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.377734 12765 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.378461 12405 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.380905 12578 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:00.355332 12575 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:00.373050 12654 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.385046 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:00.385401 12803 raft_consensus.cc:3055] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:00.386015 12803 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:00.386806 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.387626 10186 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
W20260709 13:17:00.397953 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 56199.5us
I20260709 13:17:00.399353 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.401949 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:00.394295 12803 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.362744 12651 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.406365 12803 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.406783 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39406 (request call id 77) took 4770 ms. Trace:
I20260709 13:17:00.407173 10036 rpcz_store.cc:276] 0709 13:16:55.636320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.914143 (+1277823us) service_pool.cc:224] Handling call
0709 13:17:00.406554 (+3492411us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b5400042254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e2853 00007f3c744b060a 00007f3c6da367d4 00007f3c6da36762 00007f3c6da36691 00007f3c6da3660c 00007f3c6da358c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:00.406690 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7742941568}
I20260709 13:17:00.408331 12651 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.405022 10185 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.408450 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.408788 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1478) took 1694 ms. Trace:
I20260709 13:17:00.412449 10183 rpcz_store.cc:276] 0709 13:16:58.714279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.715598 (+  1319us) service_pool.cc:224] Handling call
0709 13:17:00.408538 (+1692940us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54002d41d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:00.408693 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3762109184}
I20260709 13:17:00.415652 10180 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
W20260709 13:17:00.420431 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 317351us
I20260709 13:17:00.422267 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.425666 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.425714 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.426703 12776 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.429394 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1476) took 2671 ms. Trace:
I20260709 13:17:00.419459 12762 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.444002 10038 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:00.442440 10182 rpcz_store.cc:276] 0709 13:16:57.757669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.820201 (+ 62532us) service_pool.cc:224] Handling call
0709 13:16:57.820406 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.061904 (+241498us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:58.133098 (+ 71194us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.997478 (+1864380us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b180024c5e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:17:00.207952 (+210474us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.428746 (+220794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.428817 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:00.428905 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.429006 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.429198 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217535,"prepare.queue_time_us":117212,"prepare.run_cpu_time_us":164,"prepare.run_wall_time_us":14370,"raft.queue_time_us":462056,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":1844,"spinlock_wait_cycles":72546560,"thread_start_us":426900,"threads_started":3,"wal-append.queue_time_us":2133477}
I20260709 13:17:00.445672 12762 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:00.435242 12796 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:17:00.445983 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.437336 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1466) took 4312 ms. Trace:
I20260709 13:17:00.429503 10183 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:00.440133 10189 raft_consensus.cc:2410] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:00.423316 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:00.445216 10184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1483) took 1653 ms (client timeout 1769 ms). Trace:
I20260709 13:17:00.441021 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.399264 12405 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:17:00.442550 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 119481us
W20260709 13:17:00.448644 10184 rpcz_store.cc:269] 0709 13:16:58.791528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.698736 (+907208us) service_pool.cc:224] Handling call
0709 13:17:00.445040 (+746304us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54002ad0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:00.445157 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497500032}
I20260709 13:17:00.457715 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.458022 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.458781 10183 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:00.459693 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.437886 12768 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:00.458026 12806 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
I20260709 13:17:00.472218 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.439175 12722 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:00.473779 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:00.442691 12810 consensus_queue.cc:1243] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:00.474952 10106 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:00.475803 12787 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:00.476272 12787 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:00.477387 12787 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.478824 12787 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.480208 12690 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:00.480662 12690 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:00.481690 12690 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.385332 12654 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.462859 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.463927 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:00.468091 12706 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:00.496177 12776 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:00.469696 10109 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:17:00.497278 12580 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:00.497566 10109 pending_rounds.cc:85] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:17:00.497776 12580 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:00.471235 12759 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:00.498309 12580 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.497915 10109 pending_rounds.cc:107] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:17:00.498950 10109 raft_consensus.cc:2889] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.500494 10183 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:00.500569 10038 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:00.489809 10031 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
W20260709 13:17:00.488932 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 77305.1us
I20260709 13:17:00.486107 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:00.491639 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.492311 12810 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:00.463835 12652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.004s	sys 0.016s
W20260709 13:17:00.461225 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49379.9us
I20260709 13:17:00.496798 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.512038 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.513137 10184 raft_consensus.cc:2410] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:00.511336 10185 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:00.452023 12796 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:00.446702 10181 rpcz_store.cc:276] 0709 13:16:56.124575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.222479 (+ 97904us) service_pool.cc:224] Handling call
0709 13:16:56.258962 (+ 36483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.259167 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:57.798647 (+1539480us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.030820 (+2232173us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.076818 (+ 45998us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.411901 (+335083us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b1800197fe0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:17:00.415477 (+  3576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.418409 (+  2932us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:00.423370 (+  4961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.437018 (+ 13648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.437255 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":968621,"prepare.queue_time_us":1402789,"prepare.run_cpu_time_us":2947,"prepare.run_wall_time_us":20840,"raft.queue_time_us":509904,"raft.run_cpu_time_us":654,"raft.run_wall_time_us":60462,"spinlock_wait_cycles":13509504,"thread_start_us":2928781,"threads_started":4,"wal-append.queue_time_us":351180}
I20260709 13:17:00.514842 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.516412 10189 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:00.514703 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:00.520721 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.521507 10186 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:17:00.522040 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.523069 12795 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:17:00.513643 12652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.004s	sys 0.017s
W20260709 13:17:00.527894 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 71708.4us
I20260709 13:17:00.528746 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.529414 10188 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:00.511495 12810 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:00.511266 12759 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:00.531919 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.532104 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.529870 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.517530 12796 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:00.518992 12768 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.537552 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:00.540570 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.537765 10078 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.560s (SENT)
W20260709 13:17:00.541229 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.541802 12675 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:00.541966 12513 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:00.542146 10182 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:00.543324 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:00.545145 10184 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:00.546036 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.546474 10184 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:00.547314 12722 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:00.547861 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.548420 12706 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:00.549122 12802 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.549678 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.519275 12809 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:00.550635 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.550486 12802 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.547178 12808 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.544200 12646 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.557060 12722 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.557375 12646 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.552202 12749 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.557873 12646 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.558216 10715 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.558468 12722 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:00.534237 12810 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.559418 12722 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.560732 12722 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.547106 12675 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.562721 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:00.547243 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50541.8us
I20260709 13:17:00.559478 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.563611 10714 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 3.
I20260709 13:17:00.552384 12808 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.564229 12808 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.561820 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.565168 10713 raft_consensus.cc:2410] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:00.558120 12749 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:00.562714 10708 raft_consensus.cc:606] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.566241 10708 raft_consensus.cc:614] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.567467 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:00.553431 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:00.555533 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.548055 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.568050 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.554008 12759 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.553858 12796 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.551654 12802 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:00.574151 12802 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.574575 12796 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.577694 10188 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2.
I20260709 13:17:00.584121 10180 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:00.580148 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49132.2us
I20260709 13:17:00.580971 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.581956 10713 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.582717 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.588091 10715 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:00.588728 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:00.590356 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:00.593870 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.592276 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:00.592548 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.551717 12580 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.594126 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.596616 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.597750 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.607281 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.538753 12768 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:00.600449 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 57301.1us
I20260709 13:17:00.600955 12776 raft_consensus.cc:2764] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:17:00.607084 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62947.3us
I20260709 13:17:00.601682 12802 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.602104 12810 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.596619 10109 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:00.614387 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.614804 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.615638 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.616086 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:00.616287 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.616690 10110 raft_consensus.cc:2376] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6. Re-sending same reply.
I20260709 13:17:00.616783 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.617018 10111 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:00.617614 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.617892 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:00.604893 10715 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:00.618984 10114 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:00.612783 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.609475 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.617786 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:00.624891 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.566849 12749 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.628203 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.626611 10110 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:00.626348 10111 raft_consensus.cc:2376] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8. Re-sending same reply.
I20260709 13:17:00.609632 12575 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.612932 12782 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.636452 10715 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:00.633949 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.637936 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.638538 10184 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:00.633323 10712 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:00.639180 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 88634.2us
I20260709 13:17:00.643270 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.643560 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:00.644651 10078 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.501s (SENT)
I20260709 13:17:00.646384 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.649863 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:00.651453 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.652379 10711 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:00.653230 12768 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:00.651422 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.653153 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.654704 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.655709 10188 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:00.656810 10185 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:00.655879 10111 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:00.612478 12803 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:00.663013 12663 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.663560 12663 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.664016 12663 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.669323 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.670619 12776 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.671183 12776 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:00.671687 12776 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.672379 12405 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.673269 12405 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.673870 12609 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.678591 10114 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:00.643414 12329 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.679442 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.680898 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.681524 10186 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:00.679564 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.685976 10114 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:00.688427 10115 raft_consensus.cc:2376] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7. Re-sending same reply.
I20260709 13:17:00.609077 12646 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.603415 12808 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.703004 10180 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
W20260709 13:17:00.790165 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 146689us
I20260709 13:17:00.635413 12729 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:17:00.753551 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.788815 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.706524 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:00.790416 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 156556us
I20260709 13:17:00.789227 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:00.791239 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 146629us
I20260709 13:17:00.793457 10186 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:00.728375 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:00.739182 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.790177 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:00.793942 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:00.689141 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.795581 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:00.798617 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 126952us
I20260709 13:17:00.801009 10184 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:00.801524 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.803526 12792 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.803797 10714 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:00.804179 12792 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.805612 12808 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.780624 12802 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.806064 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:00.806903 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.808112 12796 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:00.808593 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.809513 10186 raft_consensus.cc:2410] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:00.810351 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.812343 12810 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.812709 12519 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.817185 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 161528us
I20260709 13:17:00.818756 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.819545 10182 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:00.817265 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:00.824963 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 118547us
I20260709 13:17:00.779898 12724 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:00.794243 12768 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.753088 12329 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.806301 12792 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.827944 10183 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:00.829097 12513 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.829667 12810 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:00.830379 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.813208 12519 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.846670 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.863862 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.864750 10180 raft_consensus.cc:2410] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:00.865092 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:00.847289 10184 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:00.827484 12809 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.859874 12706 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.720870 12575 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:00.831050 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.859086 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:00.875173 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 63039.7us
I20260709 13:17:00.860831 12513 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.878211 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:00.878520 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:00.883924 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:00.884521 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:00.860561 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.867439 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:00.857321 12724 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:00.937657 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.196945 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 365983us
I20260709 13:17:01.198175 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.199074 10188 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:01.200075 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.200201 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:00.885653 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.207078 10184 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:00.953629 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:01.201225 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 323791us
I20260709 13:17:01.197134 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:01.133953 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.936985 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52556.6us
W20260709 13:17:01.132510 10078 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.868s (SENT)
I20260709 13:17:00.873934 12809 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.873657 12776 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:01.351593 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1144) took 1096 ms. Trace:
I20260709 13:17:01.350421 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:01.366236 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.345218 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.247543 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.341270 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:01.338805 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 206316us
W20260709 13:17:01.346810 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.156204 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:01.247855 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:00.981248 12827 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
W20260709 13:17:01.399845 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.248466  9986 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9a67604b91f54791b1316fd327793337 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:00.878237 12810 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:01.247021 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:01.391345 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.355798 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:00.957546 12329 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:01.356948 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.259299 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:01.334578 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.291244 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 91115.6us
I20260709 13:17:01.252610 10712 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:01.349522 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.409030 10182 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.395489 10187 rpcz_store.cc:276] 0709 13:17:00.255075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.317963 (+ 62888us) service_pool.cc:224] Handling call
0709 13:17:00.445531 (+127568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.445824 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:00.446180 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.529163 (+ 82983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.529214 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.529841 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.529910 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.350899 (+820989us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18001e2e60. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4
0709 13:17:01.351417 (+   518us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002ad0d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:01.351526 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6233,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":83,"raft.queue_time_us":95,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7530,"spinlock_wait_cycles":298744448,"thread_start_us":82585,"threads_started":1,"wal-append.queue_time_us":101359}
I20260709 13:17:00.898488 12513 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:01.272578 12836 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:00.957706 12684 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.251180 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:01.026492 12831 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:17:01.410810  9986 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:17:01.352576 12660 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.406037 10112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.026s
W20260709 13:17:01.265906 12833 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:17:01.255630 12835 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:17:01.253015 12834 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:17:01.413707 10109 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
W20260709 13:17:01.394508 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47216.9us
W20260709 13:17:01.207363 12722 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
I20260709 13:17:01.397447 12776 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:01.416978 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:01.285096 12609 consensus_meta.cc:287] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.611s	user 0.014s	sys 0.000s
I20260709 13:17:00.958766 12515 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.419662 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:01.388027 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 139892us
I20260709 13:17:01.368777 12690 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:01.423353 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.437680 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:01.438221 10187 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:01.391149 12802 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.970283 12654 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:01.254478 12724 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.896528 12804 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:01.426736 10112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.012s	sys 0.026s
I20260709 13:17:01.288885 12519 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:01.408066 12809 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.437350 12515 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:01.445698 12515 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.396371 12575 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:00.883100 12811 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.554s
I20260709 13:17:00.952581 12729 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.460s
I20260709 13:17:01.258705 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:01.429823 10078 leader_election.cc:336] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.939s (SENT)
I20260709 13:17:01.364034 12646 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:01.340620 12792 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:00.981853 12675 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.352890 12751 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:01.247001 12622 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:01.421267  9986 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:17:01.435387 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:01.436561 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:01.437060 10186 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:01.437207 10189 raft_consensus.cc:2410] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:01.003193 12663 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:00.883155 12706 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.438972 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.409690 12730 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.421887 12684 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.435286 12810 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:01.443342 12804 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.425743 10181 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:01.412345 12329 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:01.348623 12560 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:17:01.454512 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.441421 12766 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.461218 10112 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:01.448128 12802 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:01.478106 12782 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.794s	user 0.006s	sys 0.004s
I20260709 13:17:01.452598 12660 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:01.532254 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 109416us
I20260709 13:17:01.478336 10182 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:01.456779 12776 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.486395 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:01.540670 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:01.488744 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 56180.4us
I20260709 13:17:01.487587 10187 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2.
W20260709 13:17:01.497237 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60767.1us
I20260709 13:17:01.542253 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:01.486523 12768 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.005s
I20260709 13:17:01.536168 10188 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:01.542595 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.541234 10186 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:01.546903 10181 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:01.547278 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.544695 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:01.488348 12684 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.548056 10186 raft_consensus.cc:2410] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:01.499624 12519 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:01.499830 12804 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.558539 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.548725 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.503314 12329 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.499485 12724 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:01.580649 12724 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:01.581075 12724 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:01.582715 12515 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:01.584704 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:01.585350 10180 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.585757 12675 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:01.562788 10183 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:01.588174 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.588946 10185 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:01.589769 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:01.589839 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.591023 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.591190 10188 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.591873 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1149) took 1152 ms. Trace:
I20260709 13:17:01.592268 10188 rpcz_store.cc:276] 0709 13:17:00.439593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.559794 (+1120201us) service_pool.cc:224] Handling call
0709 13:17:01.574622 (+ 14828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.591595 (+ 16973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.591810 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.592707 12580 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:01.594982 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:01.595893 12652 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.595820 10036 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:01.596424 12652 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.597571 12802 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:01.598099 12802 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:01.598541 12802 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:01.599195 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:01.546633 12766 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.544309 12776 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:01.567438 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:01.572252 10078 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.986s (SENT)
I20260709 13:17:01.561667 12654 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.606539 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.542037 12782 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:01.576025 12560 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:01.572433 12519 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:01.488044 12751 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:01.580009 10187 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:01.605026 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:01.604753 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:01.605858 10181 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:01.628582 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:01.606150 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:01.591029 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:01.606701 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.598433 12652 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:01.488088 12622 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.528242 12792 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:01.625521 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:01.604472 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:01.591492 10184 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:01.633344 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1491) took 1155 ms. Trace:
I20260709 13:17:01.633914 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.642690 10187 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:01.631103 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:01.643261 10035 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.623502 10110 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:17:01.584638 12706 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:01.596378 12663 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:01.646255 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.638695 10112 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.647011 10181 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:01.631155 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:01.606349 12776 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:01.604128 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:01.636350 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:01.648391 10185 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:01.648795 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:01.651073 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:01.647933 12560 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:01.603430 12809 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.628283 12519 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:01.720404 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.793567 10110 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:17:01.724699 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.635085 12536 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.798070 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1492) took 1303 ms. Trace:
I20260709 13:17:01.648236 12646 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.599493 12802 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:01.739207 10712 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:01.747550 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:01.748832 10180 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:01.755950 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 118595us
I20260709 13:17:01.651840 10033 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:01.781320 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 369832us
I20260709 13:17:01.805488 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.806214 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:01.782050 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 209848us
I20260709 13:17:01.794996 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:01.797546 10184 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:01.798471 10185 rpcz_store.cc:276] 0709 13:17:00.477734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.636229 (+1158495us) service_pool.cc:224] Handling call
0709 13:17:01.648175 (+ 11946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.781031 (+132856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.781211 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.840435 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:01.840833 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:01.806493 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:01.840014 10032 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:01.882443 10032 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:01.850682 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.852010 10707 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:01.778900 12652 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:17:01.796756 12536 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.887042 10033 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:01.888427 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1155) took 1390 ms. Trace:
I20260709 13:17:01.842207 12675 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.808568 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 88897.1us
I20260709 13:17:01.898695 10184 rpcz_store.cc:276] 0709 13:17:00.498367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.778484 (+1280117us) service_pool.cc:224] Handling call
0709 13:17:01.797363 (+ 18879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.888189 (+ 90826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.888372 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.900483 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.840402 12515 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:01.840556 12776 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.900350 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.912407 10106 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:01.848143 12818 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:01.912432 10113 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:01.848948 12654 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.935328 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:01.936268 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:01.930570 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.915306 10185 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:17:01.969388 10184 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:01.969408 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1158) took 1470 ms. Trace:
I20260709 13:17:01.970155 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1163) took 1417 ms. Trace:
I20260709 13:17:01.970063 10185 rpcz_store.cc:276] 0709 13:17:00.499270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.896446 (+1397176us) service_pool.cc:224] Handling call
0709 13:17:01.915064 (+ 18618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.969149 (+ 54085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.969352 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.970618 10184 rpcz_store.cc:276] 0709 13:17:00.552791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.937161 (+1384370us) service_pool.cc:224] Handling call
0709 13:17:01.969229 (+ 32068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.969921 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.970101 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.972316 10036 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.952275 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:01.980345 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:01.903426 12536 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.902015 12580 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:01.984320 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.986245 10106 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:01.984459 10715 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:01.937636 12818 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:01.985401 10033 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:01.884577 12663 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:17:01.989619 10184 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.987208 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:01.991889 12749 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:01.992192 12792 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:01.992992 12848 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:02.004669 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1164) took 1451 ms. Trace:
I20260709 13:17:02.035907 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:02.036602 10110 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:02.033250 10184 rpcz_store.cc:276] 0709 13:17:00.553110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.971321 (+1418211us) service_pool.cc:224] Handling call
0709 13:17:01.989459 (+ 18138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.004259 (+ 14800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.004444 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.996630 12811 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:01.997784 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:01.998498 12623 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:01.988198 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:17:02.042042 10040 raft_consensus.cc:606] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.042445 10040 raft_consensus.cc:614] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:02.000054 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:02.000268 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:01.935014 12652 consensus_queue.cc:1243] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:02.002873 10035 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:01.852202 12513 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:01.952509 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 54900.7us
I20260709 13:17:02.039315 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:01.935806 12776 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.039930 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:02.049290 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:02.001889 12787 consensus_meta.cc:287] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.523s	user 0.012s	sys 0.003s
I20260709 13:17:01.910521 12675 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:02.005934 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.032677 12853 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:02.005244 12660 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:02.052858 10185 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:02.051712 10181 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:02.049328 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:02.005661 12580 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:02.060681 10110 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:02.061429 12749 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.029031 12646 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:02.084611 10107 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:17:02.064270 10038 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.052518 10710 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.047154 12623 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:02.088639 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 98491.2us
I20260709 13:17:02.099275 10187 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:17:02.065462 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 111767us
I20260709 13:17:01.991933 12622 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:02.031955 12654 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:17:02.121500 12818 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.122579 12818 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.125768 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:02.126133 12849 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:02.126854 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.127991 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.129004 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.129549 10031 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:02.130314 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:02.133910 12513 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:02.128006 12580 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.136132 12675 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:02.136830 12722 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:02.053520 12854 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:02.120342 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:02.048941 12846 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.988945 12560 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:02.093566 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.085533 10714 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:02.063112 12751 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:02.084216 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.093012 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:02.113950 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 109587us
I20260709 13:17:02.115571 10107 pending_rounds.cc:85] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:17:02.197880 10107 pending_rounds.cc:107] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:17:02.198191 10107 raft_consensus.cc:2889] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.066053 12663 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:02.105968 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.141012 10039 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:02.130573 10112 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:02.202495 10112 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:17:02.202821 10112 pending_rounds.cc:85] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 4
I20260709 13:17:02.203023 10112 pending_rounds.cc:107] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:02.203246 10112 raft_consensus.cc:2889] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.152217 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:02.160154 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.162171 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:17:02.172292 10078 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.135s (SENT)
W20260709 13:17:02.194862 12724 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.613s	user 0.004s	sys 0.006s
I20260709 13:17:02.216567 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:02.224512 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:02.226796 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:02.229195 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 67113.6us
I20260709 13:17:02.229758 10112 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:02.231884 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:02.233305 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.207803 12690 consensus_meta.cc:287] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.002s
W20260709 13:17:02.209022 12684 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
I20260709 13:17:02.232609 10181 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:02.159385 12646 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.205979 12622 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:02.239902 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 115004us
W20260709 13:17:02.239967 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.242528 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.246397 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:02.248826 10035 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:17:02.239980 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 67722.5us
W20260709 13:17:02.249668 10078 connection.cc:256] RPC call timeout handler was delayed by -1.0310097119997863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:17:02.250525 10078 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.153s (SENT)
I20260709 13:17:02.250910 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:02.205737 12776 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:02.249046 10184 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:02.245604 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:02.234122 12663 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:02.257391 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1490) took 1780 ms. Trace:
I20260709 13:17:02.257792 10182 rpcz_store.cc:276] 0709 13:17:00.477118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.573673 (+1096555us) service_pool.cc:224] Handling call
0709 13:17:01.627933 (+ 54260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.638650 (+ 10717us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:02.046200 (+407550us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.257078 (+210878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.257127 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:02.257177 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.257237 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.257333 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":379897,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":395318,"threads_started":3}
I20260709 13:17:02.265775 10036 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:02.266794 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:02.267356 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 520) took 1046 ms. Trace:
I20260709 13:17:02.268378 10185 rpcz_store.cc:276] 0709 13:17:01.210546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.256238 (+1045692us) service_pool.cc:224] Handling call
0709 13:17:02.256558 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.256738 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.256761 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.256800 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:02.256849 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.256902 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.257021 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:02.266355 12804 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.002s
I20260709 13:17:02.208719 12724 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.246003 12873 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.272598 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.246493 12706 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.289789 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:02.290398 12804 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.292975 10710 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:02.294924 12646 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:02.295469 12749 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:02.263000 12663 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:02.171401 12854 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.268029 10112 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.290303 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:02.332696 10185 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:02.299965 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49477.4us
W20260709 13:17:02.305568 10189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1151) took 1808 ms (client timeout 1939 ms). Trace:
I20260709 13:17:02.334090 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:02.247293 12684 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.312487 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:02.334420 10189 rpcz_store.cc:269] 0709 13:17:00.496991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.555932 (+ 58941us) service_pool.cc:224] Handling call
0709 13:17:02.302671 (+1746739us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54002d82d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:02.305492 (+  2821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875525376}
I20260709 13:17:02.335125 10036 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.265239 12776 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:02.336107 10037 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:02.334738 10035 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.317617 10184 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:02.338073 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 519) took 1128 ms. Trace:
I20260709 13:17:02.338472 10184 rpcz_store.cc:276] 0709 13:17:01.209712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.262503 (+1052791us) service_pool.cc:224] Handling call
0709 13:17:02.306992 (+ 44489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.337832 (+ 30840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.338018 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.267474 12722 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:02.340231 10711 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:17:02.347797 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58141.5us
I20260709 13:17:02.347986 12684 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:02.348744 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.350859 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:02.354872 12844 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.778s	user 0.000s	sys 0.003s
I20260709 13:17:02.355221 12854 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:02.355734 12875 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:02.356524 12722 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.348896 10031 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:02.358737 12722 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:02.305675 12809 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:02.319023 12866 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:02.360136 12622 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.360426 12684 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.361245 10031 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:02.362193 12861 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:02.375083 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1495) took 1896 ms. Trace:
I20260709 13:17:02.247186 12623 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.375456 10183 rpcz_store.cc:276] 0709 13:17:00.478557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.699395 (+1220838us) service_pool.cc:224] Handling call
0709 13:17:01.792323 (+ 92928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.792710 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.792742 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.805518 (+ 12776us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.056653 (+251135us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:02.056708 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.056776 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.374867 (+318091us) raft_consensus.cc:1685] finished
0709 13:17:02.374889 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.375022 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5051,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":45538,"thread_start_us":144451,"threads_started":1,"wal-append.queue_time_us":318550}
I20260709 13:17:02.378484 10035 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:02.362907 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:02.385797 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.336097 12776 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.364076 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:02.370730 10036 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:02.375423 10112 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:02.362605 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 93888.9us
I20260709 13:17:02.387910 10189 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:02.388338 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.401139 10112 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:17:02.579330 10185 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:02.584247 10110 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:02.316812 12706 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.585570 10110 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.746119 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1508) took 1163 ms. Trace:
I20260709 13:17:02.599331 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:02.746727 10185 rpcz_store.cc:276] 0709 13:17:01.582632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.580382 (+997750us) service_pool.cc:224] Handling call
0709 13:17:02.745346 (+164964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.745768 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.745800 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.745842 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:02.745878 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.745938 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.746047 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.748011 10112 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:02.740115 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 120995us
W20260709 13:17:02.749567 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 363833us
I20260709 13:17:02.750366 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.604794 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1156) took 2106 ms. Trace:
W20260709 13:17:02.754413 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.038s	sys 0.062s
W20260709 13:17:02.754841 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.038s	sys 0.063s
I20260709 13:17:02.751544 10180 rpcz_store.cc:276] 0709 13:17:00.498657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.804471 (+1305814us) service_pool.cc:224] Handling call
0709 13:17:01.804751 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.884361 (+ 79610us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:01.987537 (+103176us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.601852 (+614315us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.604425 (+  2573us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.604472 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:02.604518 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.604586 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.604734 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26543,"prepare.queue_time_us":211983,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":1035,"raft.queue_time_us":127617,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":133076,"thread_start_us":654941,"threads_started":3,"wal-append.queue_time_us":260958}
I20260709 13:17:02.333248 12663 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.315949 12873 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.765033 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1315) took 1157 ms. Trace:
W20260709 13:17:02.584493 12536 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.003s
I20260709 13:17:02.360579 12866 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:02.752560 12833 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:17:02.767400 10713 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:17:02.770344 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:02.390233 12749 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:02.731473 12796 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.028s	sys 0.067s
W20260709 13:17:02.777405 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 170654us
I20260709 13:17:02.765489 10106 rpcz_store.cc:276] 0709 13:17:01.607529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.006027 (+398498us) service_pool.cc:224] Handling call
0709 13:17:02.039152 (+ 33125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.099479 (+ 60327us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:02.117939 (+ 18460us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.764221 (+646282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.764367 (+   146us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:02.764510 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.764726 (+   216us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.764959 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99394,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":554644,"threads_started":1}
I20260709 13:17:02.581032 12809 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.392783 12787 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:02.878400 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1512) took 1294 ms. Trace:
I20260709 13:17:02.883239 10180 rpcz_store.cc:276] 0709 13:17:01.583630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.756650 (+1173020us) service_pool.cc:224] Handling call
0709 13:17:02.770070 (+ 13420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.877993 (+107923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.878025 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.878079 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:02.878115 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.878193 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.878332 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.736248 12864 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:02.883006 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 483473us
I20260709 13:17:02.601900 12722 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.766862 12623 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.617384 12660 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.604729 12622 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:02.766815 12684 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.894398 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.751844 12646 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.128s
W20260709 13:17:02.880697 12796 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.028s	sys 0.068s
W20260709 13:17:02.946664 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49581.1us
I20260709 13:17:02.908625 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1513) took 1295 ms. Trace:
W20260709 13:17:02.950079 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 186987us
I20260709 13:17:02.951692 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:02.791448 12536 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.899827 12878 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:02.951272 10180 rpcz_store.cc:276] 0709 13:17:01.613267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.884263 (+1270996us) service_pool.cc:224] Handling call
0709 13:17:02.900284 (+ 16021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.908229 (+  7945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.908260 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.908314 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:02.908352 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.908415 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.908564 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.987934 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 516) took 2140 ms. Trace:
I20260709 13:17:02.988399 10181 rpcz_store.cc:276] 0709 13:17:00.847341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.241765 (+1394424us) service_pool.cc:224] Handling call
0709 13:17:02.253832 (+ 12067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.301926 (+ 48094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.301957 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:02.304935 (+  2978us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.590558 (+285623us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:02.591453 (+   895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.592768 (+  1315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.987667 (+394899us) raft_consensus.cc:1685] finished
0709 13:17:02.987687 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.987848 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76094,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":59,"thread_start_us":275142,"threads_started":1,"wal-append.queue_time_us":654620}
I20260709 13:17:02.989836 12766 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:02.990198 10181 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.990535 10181 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:02.963770 12684 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.991869 12866 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.994177 12804 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:02.893435 12809 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.899577 12654 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:02.971599 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 77286.5us
I20260709 13:17:02.884872 12749 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:03.004308 10033 raft_consensus.cc:2368] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:02.991338 10181 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:02.898553 12329 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.290s	user 0.007s	sys 0.005s
W20260709 13:17:02.898291 12818 consensus_meta.cc:287] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
W20260709 13:17:03.005681 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 240856us
I20260709 13:17:03.037570 10181 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:03.003798 12519 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.114s	user 0.011s	sys 0.000s
I20260709 13:17:03.041993 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1510) took 1458 ms. Trace:
W20260709 13:17:03.044948 10038 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.905s	user 0.004s	sys 0.004s
W20260709 13:17:03.045845 10035 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.017s	sys 0.025s
I20260709 13:17:02.962781 12792 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:03.040776 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:03.046896 10035 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.017s	sys 0.025s
I20260709 13:17:03.046789 10038 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:03.050287 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1504) took 1056 ms. Trace:
I20260709 13:17:02.967321 12724 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:02.965850 12875 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:03.050958 10038 rpcz_store.cc:276] 0709 13:17:01.994233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.048978 (+ 54745us) service_pool.cc:224] Handling call
0709 13:17:03.050216 (+1001238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.959008 12622 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:02.887795 12722 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:02.904157 12660 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:02.900735 12787 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.065627 12787 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.047256 10185 rpcz_store.cc:276] 0709 13:17:01.583147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.749498 (+1166351us) service_pool.cc:224] Handling call
0709 13:17:02.749777 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.750046 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:02.763247 (+ 13201us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.041629 (+278382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.041693 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:03.041741 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.041808 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.041929 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16638,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":5212,"thread_start_us":277477,"threads_started":1}
W20260709 13:17:03.068698 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 111252us
I20260709 13:17:03.069270 10038 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:03.072791 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:03.049129 12792 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:03.047912 12654 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:03.036504 12329 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:03.004115 12878 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:03.081212 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.093410 10185 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:03.095072 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1208) took 1050 ms. Trace:
I20260709 13:17:03.048621 12519 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.093410 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:03.072517 12868 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:03.095698 10185 rpcz_store.cc:276] 0709 13:17:02.044395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.068809 (+1024414us) service_pool.cc:224] Handling call
0709 13:17:03.093064 (+ 24255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.094771 (+  1707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.095001 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.118028 10004 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.119261 10031 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.120596 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:03.120932 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.117956 10707 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:03.076004 12646 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:17:03.122159 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.126706 12892 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:03.128312 12660 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.098745 12868 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.097592 12894 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:03.136416 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 95743.5us
I20260709 13:17:03.128191 10708 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:17:03.138660 10185 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:03.139436 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.121168 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:03.144107 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:03.129387 12886 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:03.145409 12536 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.145784 12892 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:03.146471 12749 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:03.141955 12560 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.145357 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.144774 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.138734 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:03.135123 12660 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.147195 12891 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.153726 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.154474 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.160617 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1507) took 1578 ms. Trace:
I20260709 13:17:03.160617 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 420) took 2558 ms. Trace:
I20260709 13:17:03.169828 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 419) took 2576 ms. Trace:
I20260709 13:17:03.171686 10107 rpcz_store.cc:276] 0709 13:17:00.602596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.602729 (+   133us) service_pool.cc:224] Handling call
0709 13:17:00.603101 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.245472 (+1642371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.160410 (+914938us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000b5c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.160553 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3406468480}
I20260709 13:17:03.174705 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:03.174520 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 304866us
I20260709 13:17:03.175457 10112 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
W20260709 13:17:03.158007 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.076s (SENT) [suppressed 39 similar messages]
I20260709 13:17:03.171875 10189 rpcz_store.cc:276] 0709 13:17:01.582401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.400140 (+817739us) service_pool.cc:224] Handling call
0709 13:17:02.602367 (+202227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.602610 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.602641 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:02.603150 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.891960 (+288810us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:02.891999 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.892070 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.160395 (+268325us) raft_consensus.cc:1685] finished
0709 13:17:03.160416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.160549 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":288501,"threads_started":1,"wal-append.queue_time_us":446586}
I20260709 13:17:03.138177 12868 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.171890 10108 rpcz_store.cc:276] 0709 13:17:00.593631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.601780 (+  8149us) service_pool.cc:224] Handling call
0709 13:17:00.602112 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.604072 (+1001960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.604100 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.604141 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:01.604198 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.169580 (+1565382us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001bec54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.169628 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.169767 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":370,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":2303687552}
I20260709 13:17:03.145274 12329 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:03.152679 10710 raft_consensus.cc:606] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.184062 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:03.184695 10708 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:03.185181 10708 pending_rounds.cc:85] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 6
I20260709 13:17:03.185396 10708 pending_rounds.cc:107] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:03.185608 10708 raft_consensus.cc:2889] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.186043 12749 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:03.187067 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47695us
I20260709 13:17:03.187918 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.188794  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:03.169687 12891 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.200560 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.189980 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.194836 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:03.199070 12867 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:17:03.132154 12792 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.153545 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1502) took 1159 ms. Trace:
I20260709 13:17:03.170737 12660 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:03.220911 10036 rpcz_store.cc:276] 0709 13:17:01.993698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.599308 (+605610us) service_pool.cc:224] Handling call
0709 13:17:02.599668 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.611266 (+ 11598us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:02.980745 (+369479us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.079163 (+ 98418us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.153197 (+ 74034us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.153248 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:03.153296 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.153365 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.153480 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4895,"prepare.queue_time_us":290928,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":53919,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":16183,"spinlock_wait_cycles":4500864,"thread_start_us":367824,"threads_started":3,"wal-append.queue_time_us":137194}
I20260709 13:17:03.202229 10708 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:17:03.154286 12654 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:03.212390 12891 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.214627 10707 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:17:03.216252 12809 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:03.218195 10712 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:03.219226 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:03.212641 12329 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:03.170215 12622 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:03.187861 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.226533 10181 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:03.241045 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1205) took 1197 ms. Trace:
I20260709 13:17:03.241473 10181 rpcz_store.cc:276] 0709 13:17:02.043704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.989754 (+946050us) service_pool.cc:224] Handling call
0709 13:17:02.990073 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.240751 (+250678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.240980 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.228302 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1501) took 1235 ms. Trace:
I20260709 13:17:03.236577 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.242607 10035 rpcz_store.cc:276] 0709 13:17:01.993384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.385090 (+391706us) service_pool.cc:224] Handling call
0709 13:17:02.385406 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.385756 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:03.058661 (+672905us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.228042 (+169381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.228083 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:03.228121 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.228167 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.228254 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18749,"prepare.queue_time_us":569641,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":25826,"thread_start_us":817904,"threads_started":2,"wal-append.queue_time_us":124153}
I20260709 13:17:03.244078 10112 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.238945 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.244747 10107 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.234829 12720 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.248413 12720 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.250738 12720 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:03.260841 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 382) took 1665 ms. Trace:
I20260709 13:17:03.261344 10034 rpcz_store.cc:276] 0709 13:17:01.595502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.596044 (+   542us) service_pool.cc:224] Handling call
0709 13:17:01.596318 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.748117 (+151799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.748150 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.748188 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:01.748219 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.260548 (+1512329us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400238cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.260595 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.260769 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183540608}
I20260709 13:17:03.262271 12329 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.264678 12329 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.244710 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.266875 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1503) took 1272 ms. Trace:
I20260709 13:17:03.267345 10038 rpcz_store.cc:276] 0709 13:17:01.993983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.057865 (+1063882us) service_pool.cc:224] Handling call
0709 13:17:03.058244 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.069674 (+ 11430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.266619 (+196945us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b540031ced4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.266810 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24898432}
I20260709 13:17:03.267931 12749 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:03.268312 10715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 708) took 2403 ms (client timeout 1620 ms). Trace:
W20260709 13:17:03.268780 10715 rpcz_store.cc:269] 0709 13:17:00.864413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.864583 (+   170us) service_pool.cc:224] Handling call
0709 13:17:03.268072 (+2403489us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003cee54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:03.268201 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732736256}
I20260709 13:17:03.224239 12660 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.269593 10107 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:03.275031 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.277503 10036 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:03.282569 10716 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:03.288802 12519 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.293716 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.294102 12663 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.295053 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.301337 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.295469 12792 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.295842 10112 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
W20260709 13:17:03.297320 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 109559us
I20260709 13:17:03.308409 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.309298 12749 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.309732 12749 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:03.310101 12749 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.316895 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:03.300532 10079 connection.cc:256] RPC call timeout handler was delayed by -1.2210903349998716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:17:03.297456 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 176935us
W20260709 13:17:03.317988 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.318480 12796 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.318998 12796 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.319370 12796 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.322260 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:03.326562 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.327425 10112 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:03.327452 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.328429 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.329054 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.329243 12720 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.295632 12894 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.329447 10710 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:03.329725 12720 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.330212 12720 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.330313 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.306481 12782 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:03.301301 12766 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:03.331975 12766 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.330647 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:03.334062 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.334685 10039 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:03.335727 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.336551 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:03.345408 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51784.6us
I20260709 13:17:03.334908 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.330952 10036 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:03.347607 10715 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:03.334188 12766 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:03.349715 10153 connection.cc:256] RPC call timeout handler was delayed by -1.0576544199998352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:17:03.351205 10153 connection.cc:256] RPC call timeout handler was delayed by -1.0423544199998105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:17:03.350250 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.353528 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.358682 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:03.359423 12810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.774s	user 0.008s	sys 0.078s
W20260709 13:17:03.359946 12810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.774s	user 0.008s	sys 0.078s
I20260709 13:17:03.361312 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.362888 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.363210 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.362942 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.364001 10708 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:17:03.365027 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.366240 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.367064 10710 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:03.371914 12766 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.372321 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:03.373672 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:03.366371 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.365027 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:03.329892 12894 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.374642 10036 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:17:03.374835 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.363824 10115 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:03.307328 12901 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.434605 12906 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:03.431865 12782 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.435494 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.429426 12803 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:03.428925 12766 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.438741 12894 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.339421 12720 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.434372 12810 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.439941 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:03.442924 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 81708.6us
W20260709 13:17:03.486131 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 46287.3us
I20260709 13:17:03.486565 10079 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.486876 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:03.446497 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.488613 10036 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:03.364151 12646 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:03.472983 12749 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:03.371935 12808 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:17:03.364279 12809 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:03.490748 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 125807us
I20260709 13:17:03.494419 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.492964 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:03.363910 12875 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:17:03.495007 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.499964 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.454779 12660 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.507895 12749 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:03.508697 12749 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:03.508919 12660 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.490561 12759 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.493990 12654 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.430052 12881 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:17:03.511686 12749 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:03.512684 12749 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.448072 12901 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.495662 12519 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:03.458912 12782 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.484865 12810 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:03.531874 12766 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:03.532318 10714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 714) took 1932 ms (client timeout 1637 ms). Trace:
W20260709 13:17:03.532765 10714 rpcz_store.cc:269] 0709 13:17:01.599516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.604820 (+  5304us) service_pool.cc:224] Handling call
0709 13:17:03.532060 (+1927240us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54003ce1d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:03.532211 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049799552}
I20260709 13:17:03.499419 12902 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:03.533800 12902 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.534170 12902 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:01.641453 10186 rpcz_store.cc:276] 0709 13:17:00.477436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.574491 (+1097055us) service_pool.cc:224] Handling call
0709 13:17:01.574740 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.632999 (+ 58259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.633031 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.633075 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:01.633123 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.633182 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.633286 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4477,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10732}
I20260709 13:17:03.490854 12646 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.474601 12803 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.504725 10039 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:03.509619 12660 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:03.501085 12809 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:03.498327 12912 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.496129 12911 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:03.532682 12766 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:03.548525 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 51996.5us
I20260709 13:17:03.538571 12901 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.503839 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.568624 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.568883 12891 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.569489 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:03.570096 10714 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.571446 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.572563 10712 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:03.573734 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.574291 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.574905 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:03.552912 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.494907 12894 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:03.576045 12894 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:03.576417 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.501421 12796 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:03.542734 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 220664us
I20260709 13:17:03.535626 12810 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.563413 12912 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.578540 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.578922 10039 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:03.560341 12846 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:03.536197 12646 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.543681 12720 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:03.601748 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.564284 12766 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.603111 12766 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.579906 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.580148 12663 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.576967 12894 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.604833 12891 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:03.561573 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 75071.2us
I20260709 13:17:03.608230 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.608840 12796 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:03.609396 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.610575 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.551923 12660 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.611109 10110 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 2.
I20260709 13:17:03.611514 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.612109 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.612721 10110 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.584867 10709 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.613803 10106 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:03.603058 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 240231us
I20260709 13:17:03.615209 10106 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:17:03.615551 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.616086 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.575990 10107 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.618479 12660 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.620450 12749 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.621168 12749 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:03.621641 12749 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:03.620795 10709 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 4.
I20260709 13:17:03.622519 12749 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.623095 12766 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:03.560237 12868 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:03.609467 12796 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:03.570176 12809 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.625905 12902 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.626852 12846 consensus_queue.cc:1243] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:03.612464 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.650049 10115 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.597172 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.612870 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.651448 10109 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:03.591352 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 91361.1us
W20260709 13:17:03.631886 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 50258.1us
W20260709 13:17:03.652896 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.632939 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.633693 10110 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:03.647370 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:03.644541 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.627934 12842 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:03.650946 10039 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:03.601115 12912 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:03.688724 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 72063.3us
I20260709 13:17:03.687656 10036 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:03.690878 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.691593 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.692077 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.692704 10039 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:03.629456 10712 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 3.
I20260709 13:17:03.693964 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.691843 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.701063 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:03.702389 12875 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:03.703121 12720 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:03.702956 12875 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.703419 12766 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:03.705018 12875 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.708412 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.709645 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.710224 10712 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:03.710508 12776 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:03.648106 12796 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:03.941290 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.771644 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1497) took 1979 ms. Trace:
I20260709 13:17:03.930271 10714 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:03.956223 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:03.736059 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 156222us
I20260709 13:17:03.733385 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:03.686756 12891 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.767644 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:03.932678 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 297442us
I20260709 13:17:03.958773 10109 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:03.943109 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.959949 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:03.764406 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 521) took 2349 ms. Trace:
I20260709 13:17:03.746536 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.888378 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.972323 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 515) took 3139 ms. Trace:
I20260709 13:17:03.955368 10031 rpcz_store.cc:276] 0709 13:17:01.795483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.371956 (+576473us) service_pool.cc:224] Handling call
0709 13:17:02.372282 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.119814 (+747532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.771408 (+651594us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400165654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.771579 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717481344}
I20260709 13:17:03.972939 10187 rpcz_store.cc:276] 0709 13:17:00.832536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.001251 (+1168715us) service_pool.cc:224] Handling call
0709 13:17:02.001511 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.121124 (+119613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.972101 (+1850977us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b54003f0cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.972262 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224034048}
I20260709 13:17:03.686908 12842 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:03.972293 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.978039 10182 rpcz_store.cc:276] 0709 13:17:01.415135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.296316 (+881181us) service_pool.cc:224] Handling call
0709 13:17:02.296667 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.758243 (+461576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.758296 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.758361 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:02.758425 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.764109 (+1005684us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b540019bed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:03.764163 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.764303 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738443008}
I20260709 13:17:03.980635 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:03.981618 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:03.982002 10714 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:03.982471 10039 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:03.982893 10036 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7.
I20260709 13:17:03.970947 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:03.803483 10032 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:03.975454 10040 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:03.827629 12915 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:03.713860 12690 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.280s
I20260709 13:17:03.982817 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.984110 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.746057 12919 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.754861 12890 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.691s	user 0.002s	sys 0.000s
I20260709 13:17:03.711022 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:03.716902 12772 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:03.990823 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:03.990866 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:03.768923 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:03.990335 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.987039 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:03.994834 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.969470 12609 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:03.686535 12917 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.332s
I20260709 13:17:03.969940 12875 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.993443 12818 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:03.996539 10032 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.774039 12868 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:03.694368 12804 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.296s
I20260709 13:17:04.001241 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.999962 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.004328 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.741609 12803 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:03.976517 12911 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:03.991773 10109 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.000636 12609 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:03.990497 12766 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.018009 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:03.713451 12663 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.285s
I20260709 13:17:03.996116 12891 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.026633 12766 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.034932 12766 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.026404 12609 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:04.026268 10036 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.023772 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:04.029057 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58223.6us
I20260709 13:17:04.010922 12902 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.012526 12772 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:04.037672 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.039124 10040 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:03.996248 12912 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:04.023252 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:03.995824 12810 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.000689 12660 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.048949 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.045881 10039 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:04.050292 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1508) took 2055 ms. Trace:
I20260709 13:17:03.993760 12915 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.050985 10031 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:04.056696 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1505) took 2062 ms. Trace:
I20260709 13:17:04.031813 12868 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.032366 12818 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:04.053730 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 387) took 2419 ms. Trace:
I20260709 13:17:04.051970 10036 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.054405 10039 rpcz_store.cc:276] 0709 13:17:01.995210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.043911 (+2048701us) service_pool.cc:224] Handling call
0709 13:17:04.044222 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.050004 (+  5782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.050226 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.017287 12646 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.016114 12796 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.017163 12875 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.057045 10031 rpcz_store.cc:276] 0709 13:17:01.994480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.040716 (+2046236us) service_pool.cc:224] Handling call
0709 13:17:04.046635 (+  5919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.056442 (+  9807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.056638 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.057817 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:04.058055 10040 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:03.997255 12919 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:04.050954 12924 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:17:04.072135 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 90581.9us
I20260709 13:17:04.072391 10112 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:04.062054 10037 rpcz_store.cc:276] 0709 13:17:01.634243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.705525 (+ 71282us) service_pool.cc:224] Handling call
0709 13:17:01.750092 (+ 44567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.345230 (+595138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.053502 (+1708272us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002765d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:04.053670 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308935040}
I20260709 13:17:04.018887 12901 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:04.073995 10107 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.076764 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1507) took 2081 ms. Trace:
W20260709 13:17:04.077581 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65487.4us
I20260709 13:17:04.086196 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:04.081732 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:04.055461 12923 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.030223 12911 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.087265 10036 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:04.086782 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:04.085106 10040 rpcz_store.cc:276] 0709 13:17:01.994982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.041289 (+2046307us) service_pool.cc:224] Handling call
0709 13:17:04.057867 (+ 16578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.076504 (+ 18637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.076703 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.053089 12894 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:17:04.097841 10115 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:04.076982 12891 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.102674 12891 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.103458 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 395) took 1022 ms. Trace:
I20260709 13:17:04.103864 10036 rpcz_store.cc:276] 0709 13:17:03.080879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.078898 (+998019us) service_pool.cc:224] Handling call
0709 13:17:04.087092 (+  8194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.103197 (+ 16105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.103396 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.105288 10036 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:04.105890 12894 consensus_queue.cc:1243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:04.106319 10036 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.059641 12868 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.107611 10037 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:04.111377 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:04.113664 10107 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
W20260709 13:17:04.119498 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.116945 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.122565 10038 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.123811 10038 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.125200 10038 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:04.126688 10036 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:04.128448 10037 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [4.4-8.6]
W20260709 13:17:04.128888 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.129478 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.129966 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.131659 10040 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:04.056074 12842 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.137969 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:04.138993 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:17:04.133057 12925 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:17:04.084345 12772 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.149708 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1314) took 2542 ms. Trace:
I20260709 13:17:04.142580 12923 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:04.154510 12926 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:17:04.168622 12766 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:04.155074 12920 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:17:04.160269 12928 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:04.165611 12722 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:04.165609 10032 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:04.116779 12929 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:17:04.170472 12915 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:04.152105 12933 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:04.152275 12842 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.172261 12690 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.150116 12818 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:04.166405 10713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 463) took 3570 ms (client timeout 2218 ms). Trace:
I20260709 13:17:04.150113 10114 rpcz_store.cc:276] 0709 13:17:01.607231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.608342 (+  1111us) service_pool.cc:224] Handling call
0709 13:17:01.608615 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.750449 (+141834us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:01.796676 (+ 46227us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.988861 (+192185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.989168 (+   307us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:01.989372 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.756874 (+1767502us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b18003fbfe0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:04.149435 (+392561us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54001bdfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:04.149490 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.149632 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46585,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1938,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"spinlock_wait_cycles":98528000,"thread_start_us":90989,"threads_started":1,"wal-append.queue_time_us":211537,"wal-append.run_cpu_time_us":1306,"wal-append.run_wall_time_us":1063858}
W20260709 13:17:04.168540 12927 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:04.171499 12646 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:04.185747 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 386) took 2575 ms. Trace:
I20260709 13:17:04.191058 12912 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
W20260709 13:17:04.193997 10713 rpcz_store.cc:269] 0709 13:17:00.596207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.596353 (+   146us) service_pool.cc:224] Handling call
0709 13:17:04.166199 (+3569846us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54006103d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:04.166327 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4965582208}
I20260709 13:17:04.198840 10032 rpcz_store.cc:276] 0709 13:17:01.610412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.624965 (+ 14553us) service_pool.cc:224] Handling call
0709 13:17:01.640808 (+ 15843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.803087 (+2162279us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003bd1a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f46606f 00007f3c6f4def60 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62
0709 13:17:04.185427 (+382340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.185674 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379001216}
I20260709 13:17:04.200177 12875 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.203881 12919 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.204749 12868 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:04.226337 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 139610us
I20260709 13:17:04.206311 12911 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.206673 12915 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.207574 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:04.208220 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:04.209810 12729 raft_consensus.cc:993] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:17:04.194193 12810 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:04.210258 12787 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.195143 12933 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:04.210897 12881 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:04.212090 12405 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:04.212702 12766 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.212917 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.215615 12901 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.216178 12929 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.217505 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:04.236548 10715 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.238991 12891 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.239427 12891 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:04.242597 12660 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.243021 12720 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.243284 12660 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.243461 12720 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.243940 12901 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.244442 12901 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:04.245229 12901 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.246502 12901 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.247238 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:04.234153 12690 raft_consensus.cc:1081] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:17:04.218379 12878 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:04.248674 12875 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.249681 12646 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:04.250137 10711 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.217432 12803 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.255934 12803 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:04.256884 12803 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.257879 12803 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.258526 12810 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.250274 12609 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.260118 12810 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.260505 12810 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:04.260634 10033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1491) took 2475 ms (client timeout 1833 ms). Trace:
W20260709 13:17:04.261102 10033 rpcz_store.cc:269] 0709 13:17:01.785645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.083946 (+298301us) service_pool.cc:224] Handling call
0709 13:17:04.260381 (+2176435us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400066dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:04.260546 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846833024}
I20260709 13:17:04.261996 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:04.262822 12912 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.263213 12912 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:04.263566 12912 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.263940 12782 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:04.266957 12929 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.268415 12882 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:04.269340 12878 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:04.269692 12878 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:04.270663 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1514) took 2644 ms. Trace:
I20260709 13:17:04.270429 12878 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.271060 10180 rpcz_store.cc:276] 0709 13:17:01.626172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.985442 (+1359270us) service_pool.cc:224] Handling call
0709 13:17:03.036399 (+ 50957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.051030 (+ 14631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.051061 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.053916 (+  2855us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:03.053961 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.270429 (+1216468us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5400097754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:04.270474 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.270599 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33174272}
I20260709 13:17:04.273061 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:04.261340 12609 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.219856 12931 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.243884 10715 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:04.190537 12722 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.248975 12405 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:04.274952 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:04.231253 12919 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:04.288211 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 118915us
I20260709 13:17:04.276059 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:04.232836 10713 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:04.243319 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:04.224506 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 108225us
I20260709 13:17:04.234186 12881 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:04.290832 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47599.1us
I20260709 13:17:04.300534 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:04.277249 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:04.302718 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.303617 10038 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:04.302803 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 392) took 2162 ms. Trace:
I20260709 13:17:04.303514 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 390) took 2163 ms. Trace:
I20260709 13:17:04.304998 10031 rpcz_store.cc:276] 0709 13:17:02.140409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.079935 (+1939526us) service_pool.cc:224] Handling call
0709 13:17:04.086684 (+  6749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.092602 (+  5918us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:04.135950 (+ 43348us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.302486 (+166536us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.302536 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:04.302579 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.302640 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.302747 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5038,"prepare.queue_time_us":76405,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":5535,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":189343,"threads_started":2}
I20260709 13:17:04.298310 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1311) took 3653 ms. Trace:
I20260709 13:17:04.250105 12646 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:04.298990 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:04.309412 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:04.316193 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.317056 10107 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.317426 10033 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:17:04.319051 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:04.279383 12929 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:04.296526 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.296738 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.297185 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.231911 12787 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:04.326632 10037 raft_consensus.cc:2376] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7. Re-sending same reply.
I20260709 13:17:04.321909 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.329137 10036 raft_consensus.cc:2368] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:04.305958 10039 rpcz_store.cc:276] 0709 13:17:02.139854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.077545 (+1937691us) service_pool.cc:224] Handling call
0709 13:17:04.077873 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.078049 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:04.130483 (+ 52434us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.303214 (+172731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.303262 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:04.303301 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.303362 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.303462 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5586,"prepare.queue_time_us":90755,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":43,"raft.queue_time_us":6205,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":213118,"threads_started":2}
I20260709 13:17:04.308040 12609 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.333063 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.324199 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.322583 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.327165 10032 raft_consensus.cc:2376] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9. Re-sending same reply.
W20260709 13:17:04.334458 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 195531us
I20260709 13:17:04.325212 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.334584 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.335271 10038 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.335415 10031 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:04.321012 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:04.335327 10040 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:04.308264 12766 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.333214 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.338418 10035 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.337412 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.321517 12690 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.344980 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:04.345297 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.360183 10115 raft_consensus.cc:2410] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:04.336126 10040 pending_rounds.cc:85] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 6
I20260709 13:17:04.332353 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.321648 12768 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.308269 12751 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.269960 12891 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.321420 12722 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.335242 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:04.342326 10032 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 4: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.307307 10111 rpcz_store.cc:276] 0709 13:17:00.644380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.754638 (+110258us) service_pool.cc:224] Handling call
0709 13:17:00.787995 (+ 33357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.873416 (+ 85421us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:01.289954 (+416538us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.007602 (+717648us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.029743 (+ 22141us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.770064 (+1740321us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18000a0d20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:04.144026 (+373962us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18000a0d20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:17:04.297943 (+153917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.298004 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:04.298053 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.298122 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.298237 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42391,"prepare.queue_time_us":192502,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":147,"raft.queue_time_us":77496,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":36381,"spinlock_wait_cycles":13623808,"thread_start_us":1039655,"threads_started":4,"wal-append.queue_time_us":521955,"wal-append.run_cpu_time_us":2677,"wal-append.run_wall_time_us":1196190}
W20260709 13:17:04.344280 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.344461 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.349140 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:04.356940 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.325973 12802 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.298084 12915 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:04.315131 12729 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:04.291304 10711 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:04.325527 12911 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:04.336772 12609 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:04.382331 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.369350 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.394179 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.336155 12939 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.315843 12894 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:04.387784 10039 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:04.281766 12931 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.393448 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.508925 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.395073 10188 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:04.369760 10040 pending_rounds.cc:107] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:04.510782 10040 raft_consensus.cc:2889] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.361495 10114 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:04.511708 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.364856 10115 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:17:04.405145 10182 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:04.403684 10035 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:04.325965 12935 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:17:04.370003 12768 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:04.369530 12690 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:04.454985 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.519924 10185 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:04.358678 10108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:53672
I20260709 13:17:04.520527 10108 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.405289 12933 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.358170 12947 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:17:04.459709 12720 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.525821 12720 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:04.526443 12931 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:04.514930 12939 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:04.527209 12939 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.527725 12947 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:04.528187 12947 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:04.528976 12947 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.530253 12947 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:04.461002 12945 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:04.468525 12787 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.469465 12902 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:17:04.474010 12912 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.415992 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.384826 12929 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.414585 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.455149 10112 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:04.485823 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 150661us
I20260709 13:17:04.503566 10106 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:04.504493 10107 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:04.510422 10180 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.510290 10187 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:04.412168 12663 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.345307 12810 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.521849 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.522294 10108 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.521150 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.561257 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:04.369707 12405 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:04.514506 12942 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:17:04.516124 12944 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:17:04.484278 12868 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.526604 10714 raft_consensus.cc:2368] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:17:04.467808 12803 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.462103 12938 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.574990 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:04.466794 12923 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.510912 12609 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.531431 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.531757 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.589632 10186 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:04.589895 10115 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:04.537147 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.537232 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.590947 10185 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 3.
I20260709 13:17:04.438558 12749 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:17:04.540870 10081 leader_election.cc:400] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:04.592653 10081 leader_election.cc:403] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.518956 12768 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.552086 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:04.553543 10713 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.521688 12917 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.558028 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:04.558581 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.601933 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:04.523423 12891 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:04.531787 12885 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.554s	user 0.008s	sys 0.007s
I20260709 13:17:04.483402 12802 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.527916 12941 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.570484 12929 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:04.568616 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 269701us
I20260709 13:17:04.416389 12646 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.569993 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:04.571172 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 242241us
W20260709 13:17:04.581516 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 267324us
I20260709 13:17:04.584115 10180 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:04.586313 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:04.575182 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 158907us
I20260709 13:17:04.361093 12881 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:04.668725 10034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2335) took 1420 ms (client timeout 1661 ms). Trace:
I20260709 13:17:04.597461 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.575616 12902 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:04.606338 10707 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:04.591149 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.667474 10185 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:17:04.587306 12405 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:04.627307 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.612035 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71326.8us
I20260709 13:17:04.675454 10184 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.679206 10180 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:04.680195 10034 rpcz_store.cc:269] 0709 13:17:03.248415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.556316 (+1307901us) service_pool.cc:224] Handling call
0709 13:17:04.668613 (+112297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.681928 10115 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:17:04.684094 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:04.677762 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.687100 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.568851 12663 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.599069 12787 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:04.703145 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93851.5us
I20260709 13:17:04.687036 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.723043 10112 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:04.722956 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:04.723522 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 532) took 2970 ms. Trace:
I20260709 13:17:04.704665 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:04.725512 10114 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.730854 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.703521  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:04.588819 12803 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.608349 12946 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:04.734822 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 148563us
I20260709 13:17:04.723980 10716 rpcz_store.cc:276] 0709 13:17:01.752768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.881906 (+129138us) service_pool.cc:224] Handling call
0709 13:17:03.157224 (+1275318us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b54003ceca8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c7448cebc 00007f3c744c208c 00007f3c744ac93b 00007f3c744ac3d2 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c
0709 13:17:03.274726 (+117502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.298521 (+ 23795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.723300 (+1424779us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003cee50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:04.723452 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273928832}
I20260709 13:17:04.741101 12955 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:04.744594 12804 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.745061 12935 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:04.746779 12935 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.614473 12923 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.609318 12917 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.752895 12962 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.608505 12690 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.721113 12938 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:04.610378 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:04.757863 12938 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:04.759198 10712 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:04.754558 12956 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:04.739181 10182 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:04.686571 12902 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:04.770556 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.775620 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:04.767132 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.755926 12929 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.776948 10180 raft_consensus.cc:2410] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:04.753396 12962 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.770045 10184 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:17:04.785373 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.786125 10184 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:04.704012 12922 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.790136 10110 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.787614 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:04.779034 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.791399 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:04.791633 10180 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:04.668063 12941 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:04.669968 12868 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:17:04.738059 12720 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.739966 12946 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.745079 12804 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:04.789860 12962 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.826784 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.611505 12802 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:04.797612 12722 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.796849 12873 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:04.797775 12882 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.840297 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:04.842038 12958 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:04.807893 12720 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.857991 10114 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:17:04.877715 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.879225 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:04.879480 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 174920us
I20260709 13:17:04.848999 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:04.846617 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.790671 12818 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:17:04.880246 10184 raft_consensus.cc:2368] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:17:04.884429 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.885202 10181 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:04.887349 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.888334 10184 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.880297 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:04.818925 12946 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.820971 12804 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.669570 12911 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:04.793792 12949 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:17:04.852221 12722 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.897655 10081 leader_election.cc:400] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:04.879042 12720 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:04.901629 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.929376 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.928889 10081 leader_election.cc:403] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.906834 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.930642 10181 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.860356 12663 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:04.929844 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.929576 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:04.817368 12948 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:17:04.862030 12882 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:04.886255 12818 consensus_queue.cc:1243] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:04.808485 12922 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:04.946208 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 126815us
W20260709 13:17:04.947345 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 250522us
I20260709 13:17:04.953433 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:04.901196 12722 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.900696 12912 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:04.993248 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.967428 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:05.009868 10189 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:04.843029 12939 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:04.967234 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69700.7us
I20260709 13:17:04.843604 12933 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:17:04.980232 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 204698us
I20260709 13:17:04.985105 10184 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:05.011555 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:04.939468 12882 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.013993 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:05.015965 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:04.881413 12902 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.023357 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:05.015842 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62054.6us
I20260709 13:17:05.031093 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:05.031929 12609 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:05.078459 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55197.6us
I20260709 13:17:05.080533 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:05.081537 10078 leader_election.cc:400] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:17:05.081771 10078 leader_election.cc:403] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:17:05.032284 12970 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.945678 12706 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:05.036885 12941 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:04.945667 12911 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:05.038103 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:05.039285 12922 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:05.071792 12901 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.002s
I20260709 13:17:05.016927 12914 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:05.043949 12927 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:05.047309 12923 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:05.049877 12947 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 13:17:05.052197 12933 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.055015 12720 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:05.073202 10108 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.002s
I20260709 13:17:04.980420 10186 raft_consensus.cc:2410] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:04.990582 10181 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
W20260709 13:17:05.091861 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 78834.3us
I20260709 13:17:05.098599 12894 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:05.040457 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:05.043124 10715 raft_consensus.cc:2410] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:04.935839 12961 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.134976 12977 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:05.136369 12768 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:17:05.137454 12901 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:05.144062 12970 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
I20260709 13:17:05.144397 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:05.149523 12609 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:05.151901 12971 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:05.059531 12962 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:05.320791 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 239370us
I20260709 13:17:05.474924 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:05.214818 12923 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.261s
I20260709 13:17:05.476162 10108 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.477070 12912 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:05.478549 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.214416 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:05.479125 10111 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.214654 10712 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.479576 12922 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.479961 12894 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:05.480871 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 464968us
I20260709 13:17:05.392675 12804 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:05.353005 10005 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.015s	sys 0.031s
I20260709 13:17:05.481447 10111 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:05.481750 10005 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.020s	sys 0.036s
I20260709 13:17:05.481040 12894 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.482875 12804 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:05.484048 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:05.160369 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.486698 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.486728 12894 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:05.441025 12787 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.706s	user 0.002s	sys 0.008s
I20260709 13:17:05.491168 10113 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:05.491536 12962 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:05.168138 12919 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.002s
I20260709 13:17:05.492683 12919 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:05.480506 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 266176us
I20260709 13:17:05.481317 12977 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:05.493741 12796 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.485683 12923 consensus_queue.cc:1243] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:05.493656 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:05.495080 10114 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:05.475071 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.496829 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:05.498061 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:05.498865 12660 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.500491 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:05.492486 12931 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:05.499562 12902 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.499679 12803 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:05.366743 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:05.478652 10108 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:05.475659 10181 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.501559 10187 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:05.242821 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.501227 12660 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.373009 10716 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:05.507167 10115 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:05.507917 10189 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:05.508031 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.472292 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:05.509191 10182 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.510895 10110 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.494059 12977 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.511925 10114 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:17:05.215133 12891 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
I20260709 13:17:05.508605 10714 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:17:05.481600 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.512907 10110 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:17:05.513505 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.472128 12939 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:05.527920 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:05.527398 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:05.120980 12802 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.388s
I20260709 13:17:05.532477 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53672 (request call id 447) took 1211 ms. Trace:
I20260709 13:17:05.503657 12970 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.528093 10113 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:05.528573 10109 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:05.128188 12914 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.532867 10108 rpcz_store.cc:276] 0709 13:17:04.315720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.325764 (+ 10044us) service_pool.cc:224] Handling call
0709 13:17:05.505075 (+1179311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.533476 10106 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:05.536038 10708 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:05.504182 12933 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:05.541926 10078 leader_election.cc:400] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:05.482688 12901 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:05.512226 12962 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:05.479043 12961 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.557317 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.543484 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:05.558192 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:05.549644 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:05.521936 12660 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.508571 12923 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:17:05.554687 10181 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:05.558773 10709 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:05.565907 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:05.505281 12949 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:17:05.542738 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:05.554792 10182 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:05.569905 10709 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:05.548487 12970 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:05.507625 12768 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:05.588476 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45823.4us
W20260709 13:17:05.613727 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 134946us
I20260709 13:17:05.593766 12405 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:05.614794 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.616065 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 530) took 1204 ms. Trace:
I20260709 13:17:05.616495 10187 rpcz_store.cc:276] 0709 13:17:04.411202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.558335 (+147133us) service_pool.cc:224] Handling call
0709 13:17:05.615877 (+1057542us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54002d41d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:05.615999 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052006272}
I20260709 13:17:05.617918 12405 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:05.618978 12405 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.598220 12917 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:05.600929 12720 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:05.620834 12720 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:05.621413 12646 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.625782 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:05.626418 10181 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:05.627645 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 70434.3us
I20260709 13:17:05.628319 10079 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:05.628769 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 537) took 1066 ms. Trace:
I20260709 13:17:05.629065 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:05.560763 12947 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.604951 10186 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:05.557602 12901 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.568325 12787 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:05.612262 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 536) took 1090 ms. Trace:
I20260709 13:17:05.565328 12962 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.594146 10709 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.601570 12961 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.611938 10180 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.564648 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:05.619324 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:05.650120 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:05.578236 12923 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:05.625948 12964 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.697090 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.669832 10181 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:05.588761 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:05.662355 10709 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.625275 12663 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.610965 12970 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.652477 12982 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.707587 10035 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.709595 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:05.710258 10035 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
W20260709 13:17:05.692752 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 211215us
I20260709 13:17:05.672830 10716 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.652626 10185 rpcz_store.cc:276] 0709 13:17:04.521706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.688227 (+166521us) service_pool.cc:224] Handling call
0709 13:17:04.731516 (+ 43289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:04.731913 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.731942 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:04.794422 (+ 62480us) log.cc:844] Serialized 52 byte log entry
0709 13:17:05.082957 (+288535us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.082999 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.083073 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.612035 (+528962us) raft_consensus.cc:1685] finished
0709 13:17:05.612056 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.612202 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2334,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":23892,"thread_start_us":232640,"threads_started":1,"wal-append.queue_time_us":742356}
I20260709 13:17:05.700644 10181 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.643682 12609 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:05.702217 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87489.2us
I20260709 13:17:05.712158 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:05.712258 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:05.674170 12787 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.714286 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:05.697435 12818 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.714382 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:05.736737 10709 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:05.697297 12803 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.715447 10183 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:05.716849 12986 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:05.717767 10710 raft_consensus.cc:2368] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9.
I20260709 13:17:05.701856 12964 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.719907 10712 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:05.723982 12962 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.711362 12660 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:05.725979 12722 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:17:05.726344 12878 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.729441 12977 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.709234 12663 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.731714 12768 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:05.740342 10716 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
W20260709 13:17:05.738128 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 172302us
I20260709 13:17:05.672933 12891 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:05.742034 10037 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:05.757637 10035 pending_rounds.cc:85] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 5
I20260709 13:17:05.760267 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:05.704471 12985 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:05.715078 12967 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.831281 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 119269us
W20260709 13:17:05.836470 12984 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:17:05.837185 12989 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:05.644287 12933 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.670889 12952 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
W20260709 13:17:05.765517 12946 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.846s	user 0.008s	sys 0.002s
I20260709 13:17:05.841737 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:05.841310 10035 pending_rounds.cc:107] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:17:05.851392 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.742058 12979 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.764106 12609 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.764063 12847 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.854687 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 240945us
I20260709 13:17:05.763963 12971 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:05.829417 12796 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.859216 10035 raft_consensus.cc:2889] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:05.772496 12706 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.661413 12914 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.852553 12891 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:05.878450 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:05.768046 12970 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.832266 12722 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.860153 12985 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:05.768162 12818 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.891942 12979 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:05.874626 12847 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.884282 12996 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:05.897435 10039 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.855904 12967 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:05.901624 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:05.905045 10031 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:05.908548 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:05.909142 10038 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:17:05.909318 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.907015 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:05.884158 12947 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.963339 10034 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:05.876858 12803 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:05.876973 12796 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.955263 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:05.879204 12987 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:05.914812 10032 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:05.861011 12946 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:05.977083 10038 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:05.980607 12986 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:05.981578 12986 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:05.986670 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.980461 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 352186us
I20260709 13:17:05.898047 12914 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.910717 12922 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:05.991168 10079 leader_election.cc:400] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 3 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 3. Current term is 4.
W20260709 13:17:05.995291 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.954422 12949 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:05.952347 12768 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:05.997366 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.001535 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:06.005630 10112 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:05.671999 12802 consensus_queue.cc:1175] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:05.861562 12989 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.007324 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:05.990243 12776 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:05.989982 12646 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.008441 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.992285 12882 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.908s	user 0.008s	sys 0.002s
I20260709 13:17:05.977088 12951 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.989519 12580 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:17:06.007840 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.008196 10189 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.020112 10115 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:06.018893 12931 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.884945 12787 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.009181 12987 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:06.057310 10031 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.897933 12985 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.016348 12405 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:06.064738 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.064616 10112 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:06.015437 13009 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.063087 13001 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:06.075264 12818 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.051271 12998 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.076289 12998 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.078980 12998 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.017225 12766 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.032748 12988 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:06.017661 12776 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:06.011579 12768 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.066769 12962 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.966034 12609 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.031791 12979 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:06.102948 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.032936 12646 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.076309 12881 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:06.080358 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.079818 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1215) took 1380 ms. Trace:
W20260709 13:17:06.137889 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 84939.7us
I20260709 13:17:06.137239 10182 rpcz_store.cc:276] 0709 13:17:04.699174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.579582 (+880408us) service_pool.cc:224] Handling call
0709 13:17:05.594762 (+ 15180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.595217 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:05.739275 (+144058us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.964431 (+225156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.997755 (+ 33324us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.997946 (+   191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:06.008656 (+ 10710us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.011923 (+  3267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.011991 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.079591 (+ 67600us) raft_consensus.cc:1685] finished
0709 13:17:06.079610 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.079758 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33101,"prepare.queue_time_us":280642,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":2066,"raft.queue_time_us":8822,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":7118,"thread_start_us":272398,"threads_started":2,"wal-append.queue_time_us":215010}
I20260709 13:17:06.139441 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:06.139602 10707 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.139991 10182 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.032392 12951 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.144106 12951 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.145852 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.032320 12882 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.072600 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.070657 12405 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.021334 12891 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.067140 12931 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.112593 12977 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.168272 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.129359 12663 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.120453 12979 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.125407 12776 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:06.126187 12991 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:17:06.206136 12970 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.127782 12985 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.206944 12768 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.128369 12897 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:06.010797 12949 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.207605 12897 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:06.208508 12995 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:06.162223 12803 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:17:06.209432 12949 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.134066 10031 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:06.209700 12995 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:06.210107 12995 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:06.199019 12951 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:06.210654 12951 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.021552 12580 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:06.149197 10033 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.151029 10182 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:06.216030 10033 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:06.169040 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.108680 12964 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.107704 13009 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.112283 12766 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:06.165867 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 93376.9us
W20260709 13:17:06.109269 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.197623 10707 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:06.201313 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.001322 12922 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.165345 12405 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.158953 10034 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:06.219300 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.197913 12996 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.220917 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:06.229591 10182 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.128487 12987 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:06.135653 12962 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:06.218473 10033 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.240388 10033 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.224848 10032 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:06.149748 12722 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.204542 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:06.235658 12951 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.238430 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.211768 12977 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.159478 12809 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.230551 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62381.1us
I20260709 13:17:06.220103 12776 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.257407 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.228552 12964 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.271770 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.278646 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1216) took 1579 ms. Trace:
I20260709 13:17:06.281854 10189 rpcz_store.cc:276] 0709 13:17:04.699441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.591778 (+892337us) service_pool.cc:224] Handling call
0709 13:17:05.592113 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.022567 (+430454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.278306 (+255739us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54001009d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:06.278563 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956516224}
I20260709 13:17:06.282577 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.116557 12988 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.285074 12989 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.285969 12962 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.286744 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1233) took 1231 ms. Trace:
I20260709 13:17:06.288115 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:06.288720 10189 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:06.287119 10181 rpcz_store.cc:276] 0709 13:17:05.055715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.077909 (+1022194us) service_pool.cc:224] Handling call
0709 13:17:06.078287 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.078644 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.078671 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.079189 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.214971 (+135782us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:06.216928 (+  1957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.219522 (+  2594us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.286523 (+ 67001us) raft_consensus.cc:1685] finished
0709 13:17:06.286544 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.286681 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2344,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4584,"thread_start_us":135381,"threads_started":1,"wal-append.queue_time_us":163387}
I20260709 13:17:06.210899 12995 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.291502 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.242043 12938 raft_consensus.cc:2764] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:06.242986 12796 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.289546 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:06.294975 10182 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:06.242832 12967 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.170749 12901 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.292927 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.243289 12996 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:06.266924 12986 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.300998 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:06.303670 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:06.290146 12946 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.326526 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.333395 10039 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
W20260709 13:17:06.298043 12894 consensus_meta.cc:287] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.811s	user 0.001s	sys 0.010s
I20260709 13:17:06.208607 12897 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.330313 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.349588 10036 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:06.336865 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.280448 12977 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.337670 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:06.347635 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.272598 12809 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.354365 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:06.355654 10037 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7.
I20260709 13:17:06.356475 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.298110 12818 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:06.289599 12964 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.367398 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.368079 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:06.370651 10036 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:06.371568 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:06.289490 12580 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.374807 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:06.375051 12580 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:06.376140 10111 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:06.376664 10113 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:06.377162 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.379808 10710 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:17:06.380257 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.381008 10032 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:06.347895 12938 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:06.359095 12996 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.332842 12939 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.359829 13002 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.356339 13004 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.389674 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.390323 10032 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:06.379882 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.391445 10037 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:06.383569 10707 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.384361 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.386031 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:06.353188 12952 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.325487 12986 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.393365 10181 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.394274 10109 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:06.395491 10181 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:17:06.395692 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:06.390736 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87150.2us
I20260709 13:17:06.396781 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:06.398202 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.358253 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.352744 12847 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.400010 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.400823 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:06.409261 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.404244 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:06.386919 12646 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.417178 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.413968 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.400593 12722 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.401315 12952 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.420921 10713 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:06.424017 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:06.410362 13027 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:06.424032 12766 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.401723 12897 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.386559 12923 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:06.427227 10039 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:06.403136 12938 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.456875 10033 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:06.457336 10033 pending_rounds.cc:85] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 6
I20260709 13:17:06.458673 10033 pending_rounds.cc:107] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:06.459132 10033 raft_consensus.cc:2889] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.460322 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.460978 12810 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:06.430420 12952 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.389891 12939 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.464730 10182 raft_consensus.cc:2410] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:17:06.439374 12809 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:05.631175 10184 rpcz_store.cc:276] 0709 13:17:04.562432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.486665 (+924233us) service_pool.cc:224] Handling call
0709 13:17:05.486962 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.487163 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:05.612487 (+125324us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.628385 (+ 15898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.628441 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.628490 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.628559 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.628707 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11093,"raft.queue_time_us":11959,"thread_start_us":129382,"threads_started":2}
I20260709 13:17:06.443009 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.430732 12722 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.444104 12922 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:06.446141 13011 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.202s	user 0.002s	sys 0.000s
I20260709 13:17:06.409268 12882 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.449266 12405 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.450119 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 539) took 1684 ms. Trace:
I20260709 13:17:06.470991 10186 rpcz_store.cc:276] 0709 13:17:04.765727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.483803 (+718076us) service_pool.cc:224] Handling call
0709 13:17:06.449865 (+966062us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400052154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:06.450046 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272042880}
I20260709 13:17:06.451516 10187 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:17:06.471884 10187 pending_rounds.cc:85] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 5
I20260709 13:17:06.472131 10187 pending_rounds.cc:107] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:17:06.399492 13004 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.472343 10187 raft_consensus.cc:2889] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.439412 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.473748 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.474910 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.475436 12722 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.470486 12809 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.476487 12809 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.454133 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.456235 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:06.439395 12873 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:06.457774 12878 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:06.458037 12938 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:06.438819 13009 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.460964 10033 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:06.400875 13002 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.463240 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.468060 10115 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:06.451264 12515 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:06.478689 10707 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:06.496474 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:06.480222 12977 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.480554 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.497138 10184 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:06.472922 12766 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:06.483139 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:06.483880 10106 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:06.500192 10038 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:06.500607 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.492777 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.501153 10033 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:06.501999 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.502370 10037 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:06.503007 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.503813 10033 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:06.504617 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.505543 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.506837 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.508116 10033 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.509187 10038 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:06.512897 10037 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:17:06.437395 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:06.496394 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.514766 10115 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:06.515621 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.517777 10034 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
W20260709 13:17:06.518404 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 81263.1us
I20260709 13:17:06.483170 12873 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:06.519034 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:06.606812 13028 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:17:06.608589 13025 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:17:06.569700 12989 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.610649 12989 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:06.611922 12989 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:06.598891 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.613047 10715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 723) took 2053 ms (client timeout 1665 ms). Trace:
W20260709 13:17:06.616735 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.617090 10715 rpcz_store.cc:269] 0709 13:17:04.560591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.560987 (+   396us) service_pool.cc:224] Handling call
0709 13:17:06.612852 (+2051865us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54005942d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:06.612979 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105799424}
I20260709 13:17:06.577925 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.571725 10184 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:17:06.630297 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 71924.2us
W20260709 13:17:06.542011 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.632345 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.572014 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45283.7us
I20260709 13:17:06.511828 12515 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:06.552954 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.527470 10037 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:06.633302 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:06.637017 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.625293 12982 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.907s	user 0.000s	sys 0.012s
I20260709 13:17:06.616581 12964 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.637316 12998 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.595023 12706 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:06.581372 12809 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.636874 12911 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.653750 10184 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:06.644404 12722 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.656070 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.654395 12706 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.520190 12766 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.668787 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.650723 12982 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.675402 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.666617 12722 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:06.669721 12967 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.681425 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:06.676759 12914 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.008s
I20260709 13:17:06.656684 12998 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.679651 12847 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:06.696414 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.696843 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.697873 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.699615 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:06.705494 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.705231 12996 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:06.706190 12996 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:06.706547 12996 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:06.706625 12609 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:06.707228 12609 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.678195 12964 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.691928 12663 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:06.666499 12911 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.635233 12515 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.649355 12938 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.694380 13002 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.695501 12998 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.714700 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.684619 12722 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.727711 12818 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:06.729984 12766 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.707544 12996 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.758148 12996 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.757402 12912 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:17:06.760654 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1225) took 2058 ms. Trace:
W20260709 13:17:06.751713 13011 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:06.761029 10187 rpcz_store.cc:276] 0709 13:17:04.701928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.617400 (+915472us) service_pool.cc:224] Handling call
0709 13:17:06.451182 (+833782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.481114 (+ 29932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.760455 (+279341us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400052150. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:06.760590 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1916794752}
I20260709 13:17:06.762151 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 543) took 1815 ms. Trace:
I20260709 13:17:06.757436 12967 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:06.695367 12881 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.004s
I20260709 13:17:06.733912 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.673348 12873 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.764951 12933 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.765295 12873 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.767216 12751 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.767706 12751 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.769398 10188 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:17:06.741837 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1530) took 1004 ms. Trace:
I20260709 13:17:06.745086 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 450) took 2062 ms. Trace:
I20260709 13:17:06.745169 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:06.747206 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.762905 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1534) took 1024 ms. Trace:
I20260709 13:17:06.771528 10031 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:06.771157 10187 rpcz_store.cc:276] 0709 13:17:05.738894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.762138 (+1023244us) service_pool.cc:224] Handling call
0709 13:17:06.762440 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.762618 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.762642 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.762680 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:06.762718 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.762767 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.762855 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.749365 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:06.770145 10181 rpcz_store.cc:276] 0709 13:17:05.737461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.404521 (+667060us) service_pool.cc:224] Handling call
0709 13:17:06.437589 (+ 33068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.456978 (+ 19389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.457007 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.464442 (+  7435us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.650091 (+185649us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:06.650144 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.650210 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.741615 (+ 91405us) raft_consensus.cc:1685] finished
0709 13:17:06.741635 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.741773 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24511,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6552,"thread_start_us":151080,"threads_started":1,"wal-append.queue_time_us":236062}
I20260709 13:17:06.748682 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.762472 10185 rpcz_store.cc:276] 0709 13:17:04.947142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.723979 (+776837us) service_pool.cc:224] Handling call
0709 13:17:05.724388 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:05.724861 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:05.899170 (+174309us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.150952 (+251782us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:06.162300 (+ 11348us) log.cc:844] Serialized 52 byte log entry
0709 13:17:06.162468 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:06.162723 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.163032 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.163183 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.163266 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.445599 (+282333us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:06.477751 (+ 32152us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180016e1c0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:06.761965 (+284214us) raft_consensus.cc:1685] finished
0709 13:17:06.761987 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.762099 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24311,"prepare.queue_time_us":483861,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":134,"raft.queue_time_us":33705,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":62805,"spinlock_wait_cycles":25820544,"thread_start_us":322896,"threads_started":3,"wal-append.queue_time_us":213697}
I20260709 13:17:06.737661 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:06.774679 10187 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:06.738453 12580 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:06.775693 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1535) took 1036 ms. Trace:
I20260709 13:17:06.776026 10187 rpcz_store.cc:276] 0709 13:17:05.739129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.774213 (+1035084us) service_pool.cc:224] Handling call
0709 13:17:06.774515 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.775476 (+   961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.775640 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.770527 10107 rpcz_store.cc:276] 0709 13:17:04.682961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.683072 (+   111us) service_pool.cc:224] Handling call
0709 13:17:04.722526 (+ 39454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.722734 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:04.936917 (+214183us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.744567 (+1807650us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b18001a8180. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287
0709 13:17:06.744683 (+   116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.744736 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.744789 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.744883 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.745018 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7935,"prepare.queue_time_us":370070,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":31086,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":22770,"spinlock_wait_cycles":29185280,"thread_start_us":345144,"threads_started":2}
W20260709 13:17:06.781435 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47613.2us
I20260709 13:17:06.782295 10079 leader_election.cc:400] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9.
I20260709 13:17:06.782629 10079 leader_election.cc:403] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.782992 13017 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.747499 12935 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.783768 12818 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.780783 12946 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.786720 12946 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.780623 12967 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.788678 12967 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:06.789448 12911 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:06.789736 10185 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:06.789575 12967 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:06.790387 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1536) took 1051 ms. Trace:
I20260709 13:17:06.790707 10185 rpcz_store.cc:276] 0709 13:17:05.739351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.774482 (+1035131us) service_pool.cc:224] Handling call
0709 13:17:06.789555 (+ 15073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.790126 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.790332 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:06.787031 13034 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:06.792012 12961 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9.
I20260709 13:17:06.785542 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:06.796149 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47551.6us
I20260709 13:17:06.812562 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:06.814523 10107 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:06.816574 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.819437 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:06.837831 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.820281 12847 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.839850 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:06.786265 12818 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.838658 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.839658 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:06.783598 13017 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:06.804916 12982 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:06.856456 10181 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.858322 10107 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:06.783772 12996 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:17:06.841354 12911 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.875289 10107 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:06.794718 12951 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:17:06.856038 12787 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.861933 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:06.820168 12964 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.882365 10181 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.862025 12818 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.862571 12580 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.830271 12706 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.891486 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.866087 12766 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.876834 12911 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.906628 12706 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.909145 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.906495 10037 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:06.883864 12787 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.883512 12804 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.910137 12911 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.882956 12982 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:06.876664 12809 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:06.895351 12891 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:06.912678 13031 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:17:06.921779 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:06.896564 12766 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.887262 12802 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:06.948109 12609 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.916651 12787 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.919925 12804 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:06.925333 12891 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.963022 12891 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:06.920954 13037 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:06.927191 12998 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:17:06.992807 12804 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:06.993144 12405 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:06.927450 13017 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:06.994055 12952 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.003s
I20260709 13:17:05.873924  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:06.968461 12982 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.027690 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:07.020710 13039 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:07.024108 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1234) took 1968 ms. Trace:
I20260709 13:17:06.929258 12766 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.028436 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:07.039692 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:07.022733 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 143873us
W20260709 13:17:07.048275 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.021301 12609 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:07.022092 12951 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:07.025075 13009 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.065752 13009 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.067714 13009 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.040763 10189 rpcz_store.cc:276] 0709 13:17:05.056030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.299966 (+1243936us) service_pool.cc:224] Handling call
0709 13:17:06.300333 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.305410 (+  5077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.305441 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.337839 (+ 32398us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.483969 (+146130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:06.484009 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.484075 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.023862 (+539787us) raft_consensus.cc:1685] finished
0709 13:17:07.023884 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.024036 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4676,"raft.queue_time_us":24480,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":20727,"thread_start_us":106182,"threads_started":1,"wal-append.queue_time_us":287055}
I20260709 13:17:07.072847 12891 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.076117 12891 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.073293 12951 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.078646 12515 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:17:07.079605 12515 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.072702 12911 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.080111 12515 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:07.081018 12515 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:07.081856 12911 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.087307 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.093794 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.093909 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.021617 12722 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.096845 10709 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:07.098649 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.098649 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.072566 12985 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:17:07.029413 12952 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:07.102937 10004 connection.cc:256] RPC call timeout handler was delayed by -1.4351142619998427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 13:17:07.085839 12515 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.079605 12951 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.084020 12609 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.125598 12609 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:07.127321 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.127691 10716 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.159951 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:07.160602 10115 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.117102 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.157835 12951 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.156669 12609 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:07.170107 12609 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.170701 12939 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:07.172307 12609 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.169502 12951 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.176060 10712 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:07.169799 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.178144 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.197634 10107 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 4.
I20260709 13:17:07.207257 10115 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:07.208016 10107 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:07.211125 13047 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:07.211784 13054 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.212263 12897 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.003s
I20260709 13:17:07.213346 12952 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.218850 12722 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:07.219879 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.245772 10183 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.246764 12988 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.222504 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1236) took 1143 ms. Trace:
I20260709 13:17:07.255445 10182 rpcz_store.cc:276] 0709 13:17:06.079367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.304760 (+225393us) service_pool.cc:224] Handling call
0709 13:17:07.222306 (+917546us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000b4fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:07.222447 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255611776}
I20260709 13:17:07.223627 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.224720 10033 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:07.225059 12951 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:07.223634 10180 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:07.216912 12818 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.227280 10712 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:07.227901 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:07.228609 10155 connection.cc:256] RPC call timeout handler was delayed by -1.0201067030000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:17:07.260291 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.230293 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 551) took 1031 ms. Trace:
I20260709 13:17:07.260787 10185 rpcz_store.cc:276] 0709 13:17:06.198635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.229523 (+1030888us) service_pool.cc:224] Handling call
0709 13:17:07.229820 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.229986 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.230008 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.230045 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.230088 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.230142 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.230235 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:07.262614 12818 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.263499 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.264135 10715 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:07.214362 12787 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.234699 12766 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.235155 12751 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.236312 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:07.241120 13054 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.266537 12766 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.267194 13054 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:07.221091 10181 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:17:07.267831 10181 pending_rounds.cc:85] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 5
I20260709 13:17:07.268110 10181 pending_rounds.cc:107] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:17:07.268356 10181 raft_consensus.cc:2889] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.268894 12787 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.248529 12995 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:07.251106 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.253147 13008 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.262s	user 0.003s	sys 0.001s
I20260709 13:17:07.277284 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 405) took 1520 ms. Trace:
I20260709 13:17:07.277689 12952 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.278178 12952 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.278533 12952 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.277667 10035 rpcz_store.cc:276] 0709 13:17:05.756854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.756998 (+   144us) service_pool.cc:224] Handling call
0709 13:17:05.757404 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:05.870780 (+113376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.870813 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:05.874935 (+  4122us) log.cc:844] Serialized 52 byte log entry
0709 13:17:05.991988 (+117053us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.992026 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.992102 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.252634 (+1260532us) spinlock_profiling.cc:243] Waited 979 us on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:07.276958 (+ 24324us) raft_consensus.cc:1685] finished
0709 13:17:07.276979 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.277219 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111356,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":2252032,"thread_start_us":95671,"threads_started":1,"wal-append.queue_time_us":112129}
I20260709 13:17:07.285758 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:07.286324 10035 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.288502 10031 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:07.289091 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:07.265121 12901 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.290158 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:07.291241 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:07.291620 10711 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:07.292294 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:07.292829 10036 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:07.293777 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.294658 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.295958 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.297684 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.298760 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.299412 12878 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.303998 12878 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.304446 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:07.305085 10715 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:07.306044 12878 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:07.253872 10183 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:07.306881 10713 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:07.299875 12722 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:07.307087 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.300267 12923 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.307504 12722 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.288657 10038 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:07.300920 12881 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.307708 10183 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.310411 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.293852 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.311926 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.312520 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:07.313256 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.313884 10182 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:07.314913 10182 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:07.311537 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.289600 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:07.316813 10187 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:17:07.317291 13046 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:17:07.317432 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:07.317940 10187 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.318604 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:07.308821 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:07.289678 10032 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:07.301533 12897 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.253611 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:07.321789 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68251.3us
I20260709 13:17:07.323149 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:07.257237 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.309913 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:07.324518 10038 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:07.324285 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67123.6us
I20260709 13:17:07.330523 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.319238 10031 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:07.339406 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:07.340075 10031 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.341377 10183 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:07.342916 10183 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.344511 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.351666 10187 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:17:07.353854 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 117633us
I20260709 13:17:07.354933 10711 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:07.355271 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:07.353132 10187 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:07.346728 10038 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
W20260709 13:17:07.357172 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.357508 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:07.358352 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58627.6us
I20260709 13:17:07.349326 10036 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:07.359340 10155 leader_election.cc:400] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7.
I20260709 13:17:07.360491 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.363119 10038 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:17:07.362509 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 253089us
I20260709 13:17:07.364203 12766 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:07.364761 12951 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:07.365474 12951 consensus_queue.cc:1243] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:07.366164 12804 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:07.367000 12967 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.367931 12961 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.368054 12935 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:07.368341 12961 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:07.368434 12967 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:07.369220 12961 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.370702 12663 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.371248 10111 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:07.367208 12878 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.371587 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:07.371440 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 62978.8us
I20260709 13:17:07.390391 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.391410 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.392174 10107 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:07.392105 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:07.392856 10112 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:07.374958 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1489142619998347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260709 13:17:07.394012 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.394901 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:07.309808 12722 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:07.404395 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 95655.4us
W20260709 13:17:07.455725 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 61852.2us
I20260709 13:17:07.345220 12881 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:07.344122 12995 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:07.436163 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.345534 12919 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.370371 12961 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:07.456164 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 100966us
I20260709 13:17:07.456715 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.351462 10035 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:07.370450 12515 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:17:07.467541 10031 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:07.460810 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.470579 10112 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:07.461318 10108 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:07.502925 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.371917 12663 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:07.504710 10035 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.507092 10110 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:07.370918 13051 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:17:07.370596 12964 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:17:07.434926 12988 raft_consensus.cc:2764] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:07.372072 13002 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
W20260709 13:17:07.502081 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 141633us
W20260709 13:17:07.465590 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 75285.8us
I20260709 13:17:07.308203 12923 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.436647 13053 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.370520 12960 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:17:07.521487 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.460569 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:07.528487 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 68345.1us
I20260709 13:17:07.522921 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.458562 12929 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.465137 12881 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.533445 10035 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:07.503276 12919 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:07.509099 12766 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:07.542513 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2594) took 1177 ms. Trace:
I20260709 13:17:07.546173 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.547106 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.548190 12787 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.548923 12911 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:07.548614 12663 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.549321 12911 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.549678 12911 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.550011 12663 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.397037 12935 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.552112 12919 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.552294 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.494727 12998 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:17:07.554574 12998 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:07.554978 12998 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.555300 12998 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.555508 13054 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:07.555917 13009 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:07.556756 13009 consensus_queue.cc:1243] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:07.556949 12751 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:07.557410 12989 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:07.513186 12995 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:07.559839 12977 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:07.561685 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.544946 10106 rpcz_store.cc:276] 0709 13:17:06.365504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.367599 (+  2095us) service_pool.cc:224] Handling call
0709 13:17:06.377845 (+ 10246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.500534 (+122689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.542276 (+1041742us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000b2cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:07.542453 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243097856}
W20260709 13:17:07.540252 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 79535.3us
I20260709 13:17:07.556080 12970 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:07.531222 12881 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.535889 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.564628 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:07.566242 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.567624 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:07.548581 12787 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.630622 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 63074.4us
W20260709 13:17:07.631254 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 65082.8us
I20260709 13:17:07.632069 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:07.633162 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.634397 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.637342 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.638633 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.644341 10108 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:07.560822 12995 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.562153 12878 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:07.642529 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.555912 13054 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.571306 12796 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.640606 12901 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:07.645043 12873 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.644127 12722 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.642805 12787 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.645287 12897 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.564190 12891 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:17:07.644110 12939 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.642549 12933 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.644790 12609 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:07.671654 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 107424us
I20260709 13:17:07.661932 13054 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.642158 13062 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.661859 12796 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:07.710165 12901 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:07.670533 12878 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.665575 13055 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.746831 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:07.749984 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 107531us
I20260709 13:17:07.765242 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.672453 12914 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:17:07.766695 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.747714 12891 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:17:07.743240 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 248578us
I20260709 13:17:07.755870 12796 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.784358 13059 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 13:17:07.804632 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 235058us
I20260709 13:17:07.804477 12923 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:07.807444 13070 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:17:07.804463 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:07.814241 12923 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.815882 12941 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.757932 12609 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:07.829638 12796 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:07.831699 13067 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
W20260709 13:17:07.817693 12952 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.005s
W20260709 13:17:07.832641 13064 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:07.833036 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.834497 13004 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.835291 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1533) took 2096 ms. Trace:
W20260709 13:17:07.821230 13065 log.cc:927] Time spent T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:07.844784 10184 rpcz_store.cc:276] 0709 13:17:05.738671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.674457 (+935786us) service_pool.cc:224] Handling call
0709 13:17:06.686287 (+ 11830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.686539 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:06.687029 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.540935 (+853906us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b180030d000. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:17:07.806753 (+265818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.806808 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.806867 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.831492 (+ 24625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.835230 (+  3738us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1752,"raft.queue_time_us":78,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":5208448,"thread_start_us":265311,"threads_started":1,"wal-append.queue_time_us":1138174}
I20260709 13:17:07.837309 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:07.832501 13069 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:17:07.747340 12766 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.848663 12901 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.850140 12609 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.787899 12939 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.843897 10187 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:07.853487 12939 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.854530 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:07.855243 12939 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.856138 12796 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:07.863895 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.867071 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.836169 12911 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.869776 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:07.888221 12946 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:07.891439 13068 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:17:07.896844 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 549) took 1732 ms. Trace:
I20260709 13:17:07.897230 10189 rpcz_store.cc:276] 0709 13:17:06.164880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.165145 (+1000265us) service_pool.cc:224] Handling call
0709 13:17:07.165462 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.215793 (+ 50331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.215843 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.217078 (+  1235us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.526611 (+309533us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.526657 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.526731 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.896627 (+369896us) raft_consensus.cc:1685] finished
0709 13:17:07.896650 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.896785 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3773,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":47,"thread_start_us":335804,"threads_started":2,"wal-append.queue_time_us":408615}
W20260709 13:17:07.891867 13066 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:17:07.900061 12911 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.867900 12923 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.900897 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 552) took 1682 ms. Trace:
I20260709 13:17:07.904733 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.894596 12881 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:07.878739 12796 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.893115 12957 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:07.903712 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.909965 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.904618 10185 rpcz_store.cc:276] 0709 13:17:06.218419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.261660 (+1043241us) service_pool.cc:224] Handling call
0709 13:17:07.261991 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.262308 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.262336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.262838 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.375032 (+112194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:07.375073 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.375139 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.900706 (+525567us) raft_consensus.cc:1685] finished
0709 13:17:07.900725 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.900842 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2367,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":78,"thread_start_us":111817,"threads_started":1,"wal-append.queue_time_us":208455}
I20260709 13:17:07.848100 12952 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.908437 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.911907 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.912468 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:07.913226 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.913606 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.915824 10187 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:07.916612 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:07.900862 12971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.010s	user 0.004s	sys 0.014s
I20260709 13:17:07.920603 12952 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:07.906791 12946 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.938123 10189 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:07.927964 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.929399 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.930763 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.940435 10187 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:07.941406 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.909150 12957 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:07.939471 10185 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
W20260709 13:17:07.926769 12971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.040s	user 0.004s	sys 0.015s
I20260709 13:17:07.943295 10187 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:07.939970 10184 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:07.945852 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.946142 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.947336 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.947983 10184 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:07.950071 10183 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:07.954522 12933 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.955439 12957 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:07.957372 12957 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.957980 12935 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:07.928086 12796 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.962581 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.963586 10184 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:07.964676 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.966147 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.971546 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.972182 10185 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.951566 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:07.979940 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57073.5us
I20260709 13:17:07.981216 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:07.982328 10184 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:07.984500 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:07.985126 10184 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.989264 10189 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:07.990595 10189 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.991984 13030 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.993099 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:07.949626 12971 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:07.996721 10189 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:08.001875 12881 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:08.001760 10715 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:08.006950 10185 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:08.008610 10189 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:17:08.009032 10189 pending_rounds.cc:85] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 4
I20260709 13:17:08.009301 10189 pending_rounds.cc:107] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:08.009534 10189 raft_consensus.cc:2889] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.011500 10189 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:07.967917 12796 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.014384 10185 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:08.019985 10184 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:07.997711 12995 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.992589 13030 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.048413 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:08.050200 10114 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:08.026557 12919 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.031031 12804 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.040225 12931 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.046584 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:08.068583 10106 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.068864 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.047724 10112 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:08.070636 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:08.056496 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.058859 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:08.065033 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:07.998309 12802 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:08.073364 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:08.074872 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:08.076140 10114 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:07.997586 13054 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.079901 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:08.023260 12929 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:08.067000 12961 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.003s
I20260709 13:17:08.082562 10709 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:08.082481 10108 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:08.080899 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.085007 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:08.085804 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.081519 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.090224 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:08.096524 10106 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:08.098467 10185 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:08.109714 10187 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:08.068619 12995 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:08.132742 12796 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.120775 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.133745 10712 raft_consensus.cc:2368] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:08.074427 12804 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.138214 10708 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:08.140146 12995 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.133072 12986 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:08.149084 12919 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.147538 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:08.151963 13002 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:08.152465 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 380457us
I20260709 13:17:08.152626 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 546) took 1995 ms. Trace:
I20260709 13:17:08.177590 10181 rpcz_store.cc:276] 0709 13:17:06.157591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.894069 (+736478us) service_pool.cc:224] Handling call
0709 13:17:06.916250 (+ 22181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.268825 (+352575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.152408 (+883583us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001883d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:08.152571 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700302720}
I20260709 13:17:08.153321 13081 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:08.153867 13074 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:08.156996 13082 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:08.177522 12998 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.006s
I20260709 13:17:08.180519 12998 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.182824 12998 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.179212 12951 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:08.208348 10113 raft_consensus.cc:2368] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7.
I20260709 13:17:08.179119 13074 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.080483 12971 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:08.285769 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 108433us
I20260709 13:17:08.288503 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:08.289116 10031 pending_rounds.cc:85] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 3
I20260709 13:17:08.289144 10035 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.289487 10031 pending_rounds.cc:107] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:08.289814 10031 raft_consensus.cc:2889] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.292577 10707 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
W20260709 13:17:08.294292 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 547514us
I20260709 13:17:08.288389 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:08.241460 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.301884 10035 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:08.303330 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:08.304971 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:08.295244 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:08.176998 13002 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:08.232910 13044 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.161s	user 0.000s	sys 0.004s
I20260709 13:17:08.280979 13051 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.179600 12787 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:08.236796 13048 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.122s	user 0.004s	sys 0.000s
I20260709 13:17:08.310702 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:08.318264 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:08.293358 13054 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.311894 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:08.335698 10712 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.217667 12951 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:08.280972 12690 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.314194 10036 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:08.323608 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:08.331102 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:08.345863 10112 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.319430 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:08.348750 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 53569.7us
I20260709 13:17:08.352236 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:08.349474 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:08.353859 10115 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:08.318109 13062 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:08.355677 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.335697 12957 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:08.361642 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:08.322969 13051 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.359637 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:08.350358 12964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.011s	sys 0.009s
I20260709 13:17:08.320123 12941 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:08.355417 13077 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:08.371881 13077 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.372216 13077 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.372869 10038 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:08.373226 10038 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.373908 10038 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.374926 10038 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.375909 12986 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.376509 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 420) took 1598 ms. Trace:
I20260709 13:17:08.351794 12690 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.376879 10040 rpcz_store.cc:276] 0709 13:17:06.778516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.778635 (+   119us) service_pool.cc:224] Handling call
0709 13:17:06.779036 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.787430 (+  8394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.787466 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.787968 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.894074 (+106106us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:06.894112 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.894174 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.217529 (+1323355us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:08.368102 (+150573us) raft_consensus.cc:1685] finished
0709 13:17:08.368127 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.376444 (+  8317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7917,"raft.queue_time_us":11897,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"spinlock_wait_cycles":24068736,"thread_start_us":105774,"threads_started":1,"wal-append.queue_time_us":254736}
I20260709 13:17:08.355460 13074 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.379020 13074 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.379103 10040 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:08.370386 12931 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:08.382906 12931 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:08.383888 12931 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.376061 12951 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.385720 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 464) took 1687 ms. Trace:
I20260709 13:17:08.367149 12917 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.386111 10109 rpcz_store.cc:276] 0709 13:17:06.697803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.700638 (+  2835us) service_pool.cc:224] Handling call
0709 13:17:06.700987 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.701438 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:06.865229 (+163791us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.955003 (+ 89774us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:06.991712 (+ 36709us) log.cc:844] Serialized 52 byte log entry
0709 13:17:06.991893 (+   181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.991926 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.991994 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.236177 (+1244183us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:08.385425 (+149248us) raft_consensus.cc:1685] finished
0709 13:17:08.385520 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.385665 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157960,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":5573,"raft.queue_time_us":53509,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":23698,"spinlock_wait_cycles":8599936,"thread_start_us":234759,"threads_started":2,"wal-append.queue_time_us":243106}
W20260709 13:17:08.388856 10188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 531) took 3975 ms (client timeout 2920 ms). Trace:
I20260709 13:17:08.368697 13062 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:08.369680 12957 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:08.390280 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2406) took 1999 ms. Trace:
I20260709 13:17:08.351675 12796 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:08.326689 12960 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:17:08.393235 10182 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:17:08.397607 10182 pending_rounds.cc:85] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 5
I20260709 13:17:08.397853 10182 pending_rounds.cc:107] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:17:08.398063 10182 raft_consensus.cc:2889] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:08.389292 10188 rpcz_store.cc:269] 0709 13:17:04.412974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.513913 (+100939us) service_pool.cc:224] Handling call
0709 13:17:08.388626 (+3874713us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54002acbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:08.388779 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5078467840}
I20260709 13:17:08.390669 10033 rpcz_store.cc:276] 0709 13:17:06.391118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.508849 (+117731us) service_pool.cc:224] Handling call
0709 13:17:07.224433 (+715584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.256692 (+ 32259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.390108 (+1133416us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400156dd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:08.390226 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645166848}
I20260709 13:17:08.399524 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:08.400208 10033 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:08.401468 10679 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.945s (SENT) [suppressed 29 similar messages]
I20260709 13:17:08.397969 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:08.409488 10112 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:08.363540 13004 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.438478 10033 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:08.395171 12964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.011s	sys 0.009s
W20260709 13:17:08.441651 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 43796.5us
I20260709 13:17:08.442938 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:08.443291 10033 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:17:08.443609 13054 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.443846 10033 pending_rounds.cc:85] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 3
I20260709 13:17:08.444223 10033 pending_rounds.cc:107] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:17:08.444597 10033 raft_consensus.cc:2889] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.445293 10712 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:08.443217 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:08.318537 13082 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:17:08.446637 13054 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.351532 12919 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:08.385248 12787 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:08.461493 10114 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:08.449522 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:08.450451 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:08.448011 10109 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.454087 12690 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:08.469849 12690 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.470340 12690 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.472792 12690 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:08.473295 13103 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:08.473743 13103 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.474588 13103 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.479930 13051 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.481269 12919 consensus_queue.cc:1243] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:08.481966 12919 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.482306 12919 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:08.480532 10038 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:08.488942 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1568) took 1199 ms. Trace:
I20260709 13:17:08.390213 13062 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.367022 12929 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:17:08.368568 12914 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:17:08.397259 12796 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.467341 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:08.489316 10038 rpcz_store.cc:276] 0709 13:17:07.289592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.364003 (+ 74411us) service_pool.cc:224] Handling call
0709 13:17:07.372609 (+  8606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.372771 (+1000162us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400010f20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45fdc0 00007f3c6f4ea1c0 00007f3c6f4eb231 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c
0709 13:17:08.488674 (+115903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.488886 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357423872}
I20260709 13:17:08.433806 13053 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.526113 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:08.527427 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:08.528051 10186 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.516882 10033 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:08.529102 10033 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.490428 13103 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.500288 12766 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:08.535939 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.500932 12891 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.365928 13002 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:08.540449 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 73199.1us
I20260709 13:17:08.542315 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:08.545212 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 240664us
I20260709 13:17:08.521055 12796 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.550894 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:08.557633 10033 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.539358 13004 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.576939 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:08.577535 10712 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.578635 10033 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:08.580035 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.600467 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49648.3us
I20260709 13:17:08.601934 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:08.623699 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:08.526726 13053 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.635174 10032 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:08.636039 13053 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:08.559132 12891 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.644340 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 547) took 2485 ms. Trace:
I20260709 13:17:08.644731 10180 rpcz_store.cc:276] 0709 13:17:06.158501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.041854 (+883353us) service_pool.cc:224] Handling call
0709 13:17:07.223343 (+181489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.257101 (+ 33758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.644156 (+1387055us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000b4fd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:08.644279 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416632576}
I20260709 13:17:08.646056 10180 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:08.576531 12929 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:08.652128 12929 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.654207 12929 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.604981 13004 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:08.656225 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.656587 10107 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:08.629846 12787 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.630906 12914 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:08.660918 10712 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:08.661509 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:08.557633 13075 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:17:08.542304 12957 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.502674 13077 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.656597 10188 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:17:08.657143 13072 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:08.684489 10716 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:08.660095 10186 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:08.662460 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:08.665944 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.685946 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.676753 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:08.663213 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:08.675846 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.685817 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:08.697440 10715 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.662325 12802 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:08.700167 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:08.701305 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:08.704253 13072 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.704654 13072 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.705510 13072 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.713579 10707 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:08.635143 13074 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:08.721724 10033 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:17:08.736323 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.770149 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.663173 12914 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:08.656626 13004 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.779006 13074 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.706624 13075 consensus_queue.cc:1243] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:08.786245 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:08.723097 12941 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.791458 12941 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.789160 10033 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:08.723495 12989 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.676586 12929 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:17:08.723333 12933 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.771849 12803 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.781028 13072 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.756765 12998 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:08.789445 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 346301us
I20260709 13:17:08.786594 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:08.800719 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 348651us
I20260709 13:17:08.781332 12914 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.808079 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:08.809082 10189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.010s
W20260709 13:17:08.809981 10189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.010s
I20260709 13:17:08.811544 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:08.815713 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:08.845511 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:08.806707 12803 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:08.894234 12803 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:08.894837 12803 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:08.895192 12803 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.895499 12803 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:08.900629 13113 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:08.800063 12989 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:08.905071 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.910393 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:08.911099 10033 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:08.912091 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:08.912781 10033 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:08.914733 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:08.806819 12881 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:17:08.810353 12998 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:08.941295 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.914896 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:08.896489 12951 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:08.897101 12515 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:08.897799 12971 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.849474 13103 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:17:08.851352 12970 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:17:08.967514 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:08.950901 13045 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.912s	user 0.000s	sys 0.008s
I20260709 13:17:08.950505 12881 consensus_queue.cc:1243] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:08.951617 12796 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:08.978713 13077 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:08.966646 12515 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:08.990744 10033 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:09.002802 10185 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:08.992368 13077 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:09.015719 10679 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.010s	sys 0.022s
W20260709 13:17:09.016201 10679 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.010s	sys 0.022s
W20260709 13:17:09.016512 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 615042us
W20260709 13:17:09.019624 10040 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.013s	sys 0.007s
W20260709 13:17:09.037474 10040 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.013s	sys 0.007s
I20260709 13:17:09.001163 12891 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.013993 12914 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:09.019676 12690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.013s
W20260709 13:17:09.078589 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.039609 13074 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:09.092537 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 110384us
W20260709 13:17:09.019197 13089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.016s
W20260709 13:17:09.095108 10108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.030s	sys 0.050s
W20260709 13:17:09.102815 10108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.030s	sys 0.051s
W20260709 13:17:09.048892 10181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.010s	sys 0.013s
W20260709 13:17:09.106448 10181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.010s	sys 0.013s
W20260709 13:17:09.085434 12690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.015s	sys 0.014s
I20260709 13:17:09.106007 12935 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:09.111698 12935 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:09.112524 12787 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.118206 12796 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:09.123683 10188 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:09.077844 12847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.001s	sys 0.022s
W20260709 13:17:09.105016 13089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.018s	sys 0.017s
I20260709 13:17:09.057731 12766 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:09.056068 12951 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:17:09.107060 12891 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.148196 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:09.149070 10181 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:09.107442 13112 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.161257 10036 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:09.156814 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1261) took 1238 ms. Trace:
I20260709 13:17:09.156973 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:09.162359 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.156272 13119 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:17:09.152453 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2607) took 1095 ms. Trace:
I20260709 13:17:09.165072 10181 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:09.164463 10187 rpcz_store.cc:276] 0709 13:17:07.918436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.971288 (+ 52852us) service_pool.cc:224] Handling call
0709 13:17:09.156640 (+1185352us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002d8cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:09.156754 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309757312}
I20260709 13:17:09.166599 10187 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:09.137362 12917 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:09.172919 10113 rpcz_store.cc:276] 0709 13:17:08.046727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.048968 (+  2241us) service_pool.cc:224] Handling call
0709 13:17:09.141709 (+1092741us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400362c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:09.141865 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243027200}
I20260709 13:17:09.079828 12515 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:09.172602 10187 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:09.140977 12847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.001s	sys 0.023s
W20260709 13:17:09.175410 12931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.010s
I20260709 13:17:09.159972 13112 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.254334 13112 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.188469 12796 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.183218 10187 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:09.174052 12917 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:09.511646 10080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.016s	sys 0.023s
W20260709 13:17:09.808679 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1572) took 1522 ms (client timeout 1742 ms). Trace:
W20260709 13:17:09.809792 10032 rpcz_store.cc:269] 0709 13:17:08.286114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.286238 (+   124us) service_pool.cc:224] Handling call
0709 13:17:09.808490 (+1522252us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400042c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:09.808612 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659404032}
I20260709 13:17:09.746846 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 556) took 3003 ms. Trace:
I20260709 13:17:09.189007 12989 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:09.718969 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.032s	sys 0.034s
W20260709 13:17:09.282230 10078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.012s	sys 0.040s
W20260709 13:17:09.731786 13128 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.596s	user 0.001s	sys 0.000s
I20260709 13:17:09.812985 12796 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:09.426613 13117 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
W20260709 13:17:09.732175 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.024s	sys 0.040s
W20260709 13:17:09.815771 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.026s	sys 0.042s
I20260709 13:17:09.179168 13054 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.637s
I20260709 13:17:09.816834 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1560) took 1340 ms. Trace:
I20260709 13:17:09.178901 13149 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:09.817250 10187 rpcz_store.cc:276] 0709 13:17:08.476264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.182140 (+705876us) service_pool.cc:224] Handling call
0709 13:17:09.182413 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.816566 (+634153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.816773 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:09.472713 12803 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:17:09.818233 13111 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.714661 10039 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.009s	sys 0.043s
I20260709 13:17:09.818816 13111 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:09.819839 10039 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.016s	sys 0.043s
I20260709 13:17:09.818709 12803 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:09.485427 12914 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:09.638170 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.430117 13107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.011s	sys 0.022s
W20260709 13:17:09.821017 13107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.011s	sys 0.028s
W20260709 13:17:09.313868 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.021s
W20260709 13:17:09.821636 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.029s	sys 0.042s
W20260709 13:17:09.678687 10189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.018s	sys 0.033s
W20260709 13:17:09.486070 10184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.031s	sys 0.030s
W20260709 13:17:09.822706 10189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.018s	sys 0.040s
W20260709 13:17:09.753320 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.011s	sys 0.044s
W20260709 13:17:09.287961 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.822738 10184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.038s	sys 0.040s
W20260709 13:17:09.824587 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.824744 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1269) took 1904 ms. Trace:
W20260709 13:17:09.823401 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.011s	sys 0.049s
I20260709 13:17:09.810992 10182 rpcz_store.cc:276] 0709 13:17:06.743637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.315538 (+571901us) service_pool.cc:224] Handling call
0709 13:17:08.391377 (+1075839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.398547 (+  7170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.719409 (+1320862us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002acbd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:09.746761 (+ 27352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2434041088}
W20260709 13:17:09.811535 10080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.018s	sys 0.041s
W20260709 13:17:09.825991 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.751868 10031 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.027s	sys 0.046s
W20260709 13:17:09.826676 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 1.06773e+06us
W20260709 13:17:09.829690 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.034s	sys 0.037s
W20260709 13:17:09.829427 10078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.015s	sys 0.069s
W20260709 13:17:09.808739 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 993055us
W20260709 13:17:09.831676 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.835094 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:09.826025 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 1.12473e+06us
I20260709 13:17:09.836211 10153 leader_election.cc:400] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:09.825112 10184 rpcz_store.cc:276] 0709 13:17:07.920478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.160087 (+239609us) service_pool.cc:224] Handling call
0709 13:17:08.160378 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.160584 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:08.343803 (+183219us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.824390 (+1480587us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.824439 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.824486 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.824553 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.824688 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292831,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":26,"raft.queue_time_us":11065,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":1661970,"threads_started":3,"wal-append.queue_time_us":444043}
W20260709 13:17:09.825440 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.836118 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 1.2342e+06us
I20260709 13:17:09.836573 10153 leader_election.cc:403] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:09.842901 10031 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.029s	sys 0.048s
I20260709 13:17:09.819193 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1563) took 1157 ms. Trace:
I20260709 13:17:09.843917 10187 rpcz_store.cc:276] 0709 13:17:08.661536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.818390 (+1156854us) service_pool.cc:224] Handling call
0709 13:17:09.818681 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.818860 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.818887 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.818932 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:09.818967 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.819031 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.819140 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.844501 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:09.840917 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:09.427390 13124 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:17:09.253764 12931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.008s	sys 0.010s
W20260709 13:17:09.458353 12802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.015s	sys 0.052s
I20260709 13:17:09.246739 12515 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:09.855988 13108 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260709 13:17:09.855562 12919 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:09.257118 12810 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.856282 13133 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:09.862238 10180 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:09.865715 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43538.2us
W20260709 13:17:09.854831 12802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.022s	sys 0.063s
I20260709 13:17:09.852671 13111 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:09.854414 13062 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.857218 13016 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.858530 12933 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.817756 13149 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:09.869149 12931 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:09.871157 12810 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:09.882915 12919 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.278324 12766 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:09.885560 13111 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:09.938694 13120 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.630s	user 0.001s	sys 0.000s
I20260709 13:17:09.886147 13062 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:09.900130 12933 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:09.878130 12917 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:09.953925 12803 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:09.900535 13016 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.007957 12847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.020s	sys 0.029s
I20260709 13:17:09.940074 12931 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.009003 13135 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
I20260709 13:17:09.965487 12917 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:10.069247 12787 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.005s	sys 0.033s
W20260709 13:17:10.065371 12847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.020s	sys 0.030s
I20260709 13:17:10.055143 13054 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.080600 12957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.012s	sys 0.012s
W20260709 13:17:10.152130 13137 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:17:10.094736 13127 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.341s	user 0.001s	sys 0.001s
I20260709 13:17:10.091140 13144 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.151088 12957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.013s	sys 0.012s
I20260709 13:17:10.150293 13139 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.158031 13118 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:17:10.155175 13142 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:10.178979 13142 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:10.197038 13138 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:10.164785 13144 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.214684 13051 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.176991 13139 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.222139 13139 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:10.222841 13139 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:10.225605 13144 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:10.226464 13062 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:10.228669 13016 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.196290 13142 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.198467 13149 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.148922 13054 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.244773 13054 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.239607 13112 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.271147 13112 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:10.282958 13142 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.285658 13142 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:10.333055 10003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.488s	user 0.013s	sys 0.063s
W20260709 13:17:10.333966 10003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.490s	user 0.013s	sys 0.064s
W20260709 13:17:10.334883 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 499681us
I20260709 13:17:10.339006 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:10.349519 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 441) took 1646 ms. Trace:
I20260709 13:17:10.350075 10034 rpcz_store.cc:276] 0709 13:17:08.702738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.979882 (+277144us) service_pool.cc:224] Handling call
0709 13:17:08.980253 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.986618 (+  6365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.986645 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.987163 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.380368 (+393205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.380418 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.380499 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.348811 (+968312us) raft_consensus.cc:1685] finished
0709 13:17:10.348882 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.349249 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14998,"raft.queue_time_us":54520,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":20548,"thread_start_us":392640,"threads_started":1,"wal-append.queue_time_us":1164442}
I20260709 13:17:10.353562 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:10.395912 10081 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.003s	sys 0.003s
W20260709 13:17:10.398293 10081 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.004s	sys 0.003s
W20260709 13:17:10.400545 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 952773us
W20260709 13:17:10.409952 10039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.003s	sys 0.014s
W20260709 13:17:10.410451 10039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.003s	sys 0.014s
W20260709 13:17:10.420866 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.012s
W20260709 13:17:10.421082 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 73105.9us
W20260709 13:17:10.421402 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.008s	sys 0.012s
W20260709 13:17:10.423218 10078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.010s
W20260709 13:17:10.430361 10078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.011s
W20260709 13:17:10.431075 10040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.012s	sys 0.008s
I20260709 13:17:10.431602 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1578) took 2141 ms. Trace:
I20260709 13:17:10.432165 10035 rpcz_store.cc:276] 0709 13:17:08.290423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.348659 (+ 58236us) service_pool.cc:224] Handling call
0709 13:17:08.348992 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:08.349708 (+   716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.349737 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:08.350239 (+   502us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.787701 (+437462us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:08.787792 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.787869 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.430896 (+1643027us) raft_consensus.cc:1685] finished
0709 13:17:10.430963 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.431340 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2690,"raft.queue_time_us":2311,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":1954,"thread_start_us":415827,"threads_started":1,"wal-append.queue_time_us":1051183}
W20260709 13:17:10.430056 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.435757 12957 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.436271 13054 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.436575 13130 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.438496 12804 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:10.439388 12720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.274s	user 0.008s	sys 0.024s
I20260709 13:17:10.441124 12933 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.441963 12810 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.443315 12931 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:10.444306 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.444857 13140 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:10.074661 12787 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.005s	sys 0.034s
W20260709 13:17:10.444801 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 106074us
W20260709 13:17:10.432296 10080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.001s	sys 0.010s
I20260709 13:17:10.434685 13149 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:10.431634 10040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.393s	user 0.012s	sys 0.008s
I20260709 13:17:10.438450 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2614) took 2045 ms. Trace:
W20260709 13:17:10.454058 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 586757us
W20260709 13:17:10.471174 10080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.001s	sys 0.010s
I20260709 13:17:10.473685 12980 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.474290 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:10.475085 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.004s
W20260709 13:17:10.475476 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.004s
I20260709 13:17:10.464403 13140 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.475942 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 608415us
I20260709 13:17:10.476624 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:10.474923 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:10.477458 10187 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.478042 13165 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:10.480129 12957 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.478099 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:10.488004 13054 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.488798 13112 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:10.489569 13112 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:10.489717 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.009s
W20260709 13:17:10.490103 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.010s	sys 0.009s
W20260709 13:17:10.490451 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 620527us
I20260709 13:17:10.491683 13112 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.496596 13130 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.503842 12720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.369s	user 0.008s	sys 0.025s
I20260709 13:17:10.475395 10184 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:10.517066 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48843.4us
W20260709 13:17:10.518404 10183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1243) took 2614 ms (client timeout 1517 ms). Trace:
W20260709 13:17:10.518862 10183 rpcz_store.cc:269] 0709 13:17:07.903612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.909796 (+  6184us) service_pool.cc:224] Handling call
0709 13:17:10.511844 (+2602048us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54002ad0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:10.518184 (+  6340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91219328}
I20260709 13:17:10.469055 10110 rpcz_store.cc:276] 0709 13:17:08.393097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.402359 (+  9262us) service_pool.cc:224] Handling call
0709 13:17:08.402656 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.648115 (+245459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.648143 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.648588 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.100184 (+451596us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:09.100222 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.437544 (+1337322us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000b2cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:10.437658 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.437742 (+    84us) raft_consensus.cc:1685] finished
0709 13:17:10.437763 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.438222 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10074,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":563696384,"thread_start_us":451259,"threads_started":1,"wal-append.queue_time_us":540182}
I20260709 13:17:10.520468 13166 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:10.521800 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 680939us
I20260709 13:17:10.522367 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 433) took 2225 ms. Trace:
I20260709 13:17:10.490692 13054 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:10.527832 10152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.010s
I20260709 13:17:10.516999 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:10.534993 10152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.000s	sys 0.011s
I20260709 13:17:10.540530 12810 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.541926 13141 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.547950 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1360) took 2069 ms. Trace:
I20260709 13:17:10.546968 12810 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.522936 10040 rpcz_store.cc:276] 0709 13:17:08.296691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.382531 (+ 85840us) service_pool.cc:224] Handling call
0709 13:17:08.395324 (+ 12793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.395518 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:09.038354 (+642836us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.521694 (+1483340us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.521813 (+   119us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.521944 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.522050 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.522278 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":644228,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"thread_start_us":2038880,"threads_started":2,"wal-append.queue_time_us":1117368}
I20260709 13:17:10.553556 13141 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.554415 10712 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:10.555816 12720 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:10.556864 10713 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.558483 12957 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.559279 12957 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.560031 12957 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.548934 13130 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.561393 13130 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.562247 12957 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:10.562065 13130 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.548403 10115 rpcz_store.cc:276] 0709 13:17:08.401353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.401465 (+   112us) service_pool.cc:224] Handling call
0709 13:17:08.401758 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.402088 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.402115 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.402876 (+   761us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.019413 (+616537us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:09.019453 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.019530 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.392608 (+1373078us) raft_consensus.cc:1685] finished
0709 13:17:10.408585 (+ 15977us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.470492 (+ 61907us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":384,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13470,"thread_start_us":498728,"threads_started":1,"wal-append.queue_time_us":904785}
I20260709 13:17:10.553653 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.565599 10040 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:10.566620 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.567504 10040 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:10.568555 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 93855.6us
I20260709 13:17:10.569325 10182 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:17:10.569746 10182 pending_rounds.cc:85] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:17:10.569871 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:10.570045 10182 pending_rounds.cc:107] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:10.570559 10182 raft_consensus.cc:2889] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:10.571297 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72674us
W20260709 13:17:10.572448 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49376.9us
I20260709 13:17:10.573202 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 566) took 1554 ms. Trace:
I20260709 13:17:10.573616 10182 rpcz_store.cc:276] 0709 13:17:09.018286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.831043 (+812757us) service_pool.cc:224] Handling call
0709 13:17:09.831453 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.571104 (+739651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.572853 (+  1749us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54003f1bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:10.573084 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695322880}
I20260709 13:17:10.575178 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.543725 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:10.592044 10184 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:10.593864 10187 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:10.593521 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:10.524147 13149 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.616047 13167 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:10.619195 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44602.5us
I20260709 13:17:10.599362 13130 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.556773 12720 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.623378 10189 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.003s	sys 0.008s
I20260709 13:17:10.617057 13168 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:10.662606 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 119106us
W20260709 13:17:10.664376 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89755.4us
W20260709 13:17:10.666107  9938 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 287) took 21518 ms (client timeout 15000 ms). Trace:
I20260709 13:17:10.666756 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:10.667270 12988 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.623894 10034 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
W20260709 13:17:10.670563 10189 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.004s	sys 0.008s
W20260709 13:17:10.645253 13157 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:10.662806 10187 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:10.672087 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:10.677968 13175 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.678825 13175 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:10.681154 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.007s	sys 0.005s
W20260709 13:17:10.681777 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.007s	sys 0.005s
I20260709 13:17:10.682451 13002 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:10.683049 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 846924us
I20260709 13:17:10.684000 12917 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:10.684758 12917 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.685675 13149 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.686405 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 440) took 1983 ms. Trace:
I20260709 13:17:10.686815 10039 rpcz_store.cc:276] 0709 13:17:08.702493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.959770 (+257277us) service_pool.cc:224] Handling call
0709 13:17:08.960049 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.960262 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:09.820207 (+859945us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.599076 (+778869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.620980 (+ 21904us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:10.655088 (+ 34108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.673182 (+ 18094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.686334 (+ 13152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18967,"prepare.queue_time_us":156841,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":108867,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"thread_start_us":1578229,"threads_started":3,"wal-append.queue_time_us":589922}
I20260709 13:17:10.624289 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:10.690989 13136 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.260s	user 0.003s	sys 0.027s
I20260709 13:17:10.691663 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1270) took 2312 ms. Trace:
I20260709 13:17:10.692484 13141 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:10.693230 13171 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.694370 10079 connection.cc:256] RPC call timeout handler was delayed by -1.1312468710000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:17:10.694078 13171 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.697913 13177 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.698235 13126 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.584s	user 0.010s	sys 0.005s
W20260709 13:17:10.698745 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 109370us
I20260709 13:17:10.689137 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:10.707167 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71911.3us
I20260709 13:17:10.710714 13130 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.711419 13130 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.713361 12988 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.713594 13130 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:10.713866 13006 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:17:10.707543 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:10.716440 10184 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:10.723094 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:10.723366 13177 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.725932 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59302.7us
I20260709 13:17:10.726877 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:10.692119 10189 rpcz_store.cc:276] 0709 13:17:08.378988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.810949 (+431961us) service_pool.cc:224] Handling call
0709 13:17:08.811303 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.811716 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.811763 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.812251 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.823251 (+1011000us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:10.689464 (+866213us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.691209 (+  1745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.691315 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.691400 (+    85us) raft_consensus.cc:1685] finished
0709 13:17:10.691411 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.691569 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":799080,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":2874,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":9304,"thread_start_us":1729820,"threads_started":2,"wal-append.queue_time_us":1297696}
I20260709 13:17:10.705761 13140 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.686952 12935 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:10.718710 12804 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:10.736258 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:10.728022 13161 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.727698 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 434) took 2063 ms. Trace:
I20260709 13:17:10.727867 10034 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.740547 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.719324 12917 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:10.729887 12810 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.746614 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.728838 13171 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.752660 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.754667 10187 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:10.749336 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.759631 13170 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.738937 10038 rpcz_store.cc:276] 0709 13:17:08.663850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.663983 (+   133us) service_pool.cc:224] Handling call
0709 13:17:08.664288 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.664627 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.664656 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.665106 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.099378 (+434272us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.099523 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.099811 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.687592 (+1587781us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:10.696083 (+  8491us) raft_consensus.cc:1685] finished
0709 13:17:10.696104 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.727505 (+ 31401us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":75282304,"thread_start_us":433559,"threads_started":1,"wal-append.queue_time_us":762644}
I20260709 13:17:10.760456 13170 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.761062 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.753755 12804 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:10.765690 12804 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:10.767158 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.767844 12929 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:10.768728 12919 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.007s
I20260709 13:17:10.768537 12929 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.771126 12929 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:10.666579  9938 rpcz_store.cc:269] 0709 13:16:49.150431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.150755 (+   324us) service_pool.cc:224] Handling call
0709 13:17:10.665745 (+21514990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:59.284726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:59.285292 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:59.285335 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:16:59.285353 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:59.286489 (+  1136us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:59.286556 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:59.286586 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:59.291192 (+  4606us) tablet.cc:701] Row locks acquired
0709 13:16:59.291215 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:16:59.291404 (+   189us) write_op.cc:270] Start()
0709 13:16:59.291541 (+   137us) write_op.cc:276] Timestamp: P: 1783603019291335 usec, L: 0
0709 13:16:59.291563 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:59.292408 (+   845us) log.cc:844] Serialized 4024 byte log entry
0709 13:16:59.422099 (+129691us) op_driver.cc:464] REPLICATION: finished
0709 13:17:00.256273 (+834174us) write_op.cc:301] APPLY: starting
0709 13:17:00.265905 (+  9632us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:00.316500 (+ 50595us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:00.316650 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:00.371157 (+ 54507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:00.371610 (+   453us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:17:00.371663 (+    53us) write_op.cc:312] APPLY: finished
0709 13:17:00.372198 (+   535us) log.cc:844] Serialized 77 byte log entry
0709 13:17:00.423807 (+ 51609us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:00.528220 (+104413us) write_op.cc:454] Released schema lock
0709 13:17:00.535909 (+  7689us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:00.573510 (+ 37601us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:00.573558 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":95989,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":773387,"apply.run_cpu_time_us":15680,"apply.run_wall_time_us":355844,"num_ops":10,"prepare.queue_time_us":1461647,"prepare.run_cpu_time_us":11785,"prepare.run_wall_time_us":15623,"raft.queue_time_us":1078,"raft.run_cpu_time_us":29589,"raft.run_wall_time_us":741524,"replication_time_us":130268,"thread_start_us":2303749,"threads_started":5,"wal-append.queue_time_us":92842,"wal-append.run_cpu_time_us":4711,"wal-append.run_wall_time_us":2023346}]]}
I20260709 13:17:10.752504 13149 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.772821 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:10.776082 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.779304 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.786159 12919 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:10.786545 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59832.8us
I20260709 13:17:10.787050 12919 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.789345 13054 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:10.789701 12810 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:10.790593 12810 consensus_queue.cc:1243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:10.790995 13051 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:10.792399 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.797142 13121 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:10.797580 12919 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.791306 12810 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:10.798369 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62516.4us
I20260709 13:17:10.799494 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:10.806102 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.806555 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.798602 13006 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.808974 12995 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:10.800336 12810 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:10.809726 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51382.1us
I20260709 13:17:10.803882 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:10.812367 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.798333 13171 raft_consensus.cc:2764] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:17:10.791180 13054 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:17:10.809851 12952 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:17:10.820933 13081 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.821820 13081 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.810550 13006 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.812655 12988 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.819439 10040 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
W20260709 13:17:10.831393 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 69636.8us
I20260709 13:17:10.831606 13141 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:10.832319 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:10.833894 12720 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:10.823871 13161 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:17:10.835038 13178 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:10.835664 13178 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:10.836071 13161 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.836731 13161 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:10.836833 13178 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.839998 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:10.841531 13149 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.841127  9934 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 7, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:10.842114 13149 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:10.842568 12988 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.809610 12935 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:17:10.847057 12998 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:10.843016  9934 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 4, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.849289 13030 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:10.852553 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1589) took 1750 ms. Trace:
I20260709 13:17:10.849646  9934 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:10.827039 10153 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.852841 13179 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:10.860121 13179 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.818594 13121 raft_consensus.cc:2764] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:10.860422  9934 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 5, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 5 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:10.832479 13141 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.861663 10034 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:10.843338 13149 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:10.885370 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.853029 10035 rpcz_store.cc:276] 0709 13:17:09.102408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.513022 (+1410614us) service_pool.cc:224] Handling call
0709 13:17:10.546864 (+ 33842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.615915 (+ 69051us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:10.615955 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.616729 (+   774us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.743956 (+127227us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:10.744002 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.744078 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.852267 (+108189us) raft_consensus.cc:1685] finished
0709 13:17:10.852292 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.852450 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44032,"raft.queue_time_us":104119,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":12103,"thread_start_us":126720,"threads_started":1,"wal-append.queue_time_us":198443}
I20260709 13:17:10.877599 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:10.877893 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 75042.3us
I20260709 13:17:10.893846 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.894619 10034 raft_consensus.cc:2368] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:10.894603 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.878161 10038 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:10.838020 13161 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:10.913408 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:10.908090 13171 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:10.914656 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.913264 10039 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:17:10.830231 13006 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:10.919936 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 170699us
I20260709 13:17:10.909709 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:10.864061  9934 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.921504 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:10.860634 13179 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.864639 13141 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:10.865413 13116 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.753s	user 0.007s	sys 0.008s
W20260709 13:17:10.863651 13106 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.751s	user 0.016s	sys 0.017s
I20260709 13:17:10.926081 10034 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.925036 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.927093 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:10.932751  9934 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:10.937853 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:10.938084 10714 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:10.938520 10189 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:10.937918  9934 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:10.940340  9934 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.941576 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:10.942139  9934 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 5, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 5 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.932598 12964 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.866727 13053 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:17:10.866329 12998 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:10.935175 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:10.945592 10038 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:10.897857 13172 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.923370 13171 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.952913 13053 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:10.953243 12985 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:10.953689 13053 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:10.953439 13171 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.954357 12985 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.956135 13082 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.953889 13166 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.957633 13166 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.958004 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:10.951860 13172 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:10.962103 13172 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:10.964282 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.964910 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.956720 13082 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.934875 13178 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.967624 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:10.968932 10037 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:17:10.971072 10037 pending_rounds.cc:85] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 3
I20260709 13:17:10.974051 10037 pending_rounds.cc:107] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:17:10.974303 10037 raft_consensus.cc:2889] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:10.969460 10035 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:10.866847 12810 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.973489 12980 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.978238 13167 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.979228 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:10.981820 12964 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:10.983876 10187 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:10.985532 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:10.986337 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:10.950682 13141 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:10.987803 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:10.987994 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:10.992108 10040 raft_consensus.cc:2368] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:10.972455 13178 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.976599 13002 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:11.020643 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50055.6us
I20260709 13:17:10.989590 12980 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.968209 12952 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:11.020008 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:11.022411 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:11.022356 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:11.023072 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 51716.3us
I20260709 13:17:10.976857 13081 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.025969 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.001487 13178 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.031513 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:11.029155 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63835.2us
I20260709 13:17:11.017338 13149 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:11.030836 12961 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:11.026046 12980 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.039572 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:11.040347 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1577) took 2730 ms. Trace:
I20260709 13:17:11.042358 10040 raft_consensus.cc:2376] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7. Re-sending same reply.
I20260709 13:17:11.029472  9934 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 7, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 7 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.043210 10110 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:11.030594 12810 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.069366 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:11.079322 10078 connection.cc:256] RPC call timeout handler was delayed by -1.6788412719999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
I20260709 13:17:11.079355 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:11.042588 12989 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:11.043251 13184 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:11.038102 12919 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:11.037146 13149 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:11.090090 13053 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.073851 13170 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:11.091619 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55464.2us
I20260709 13:17:11.091710 12998 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.092942 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.095847 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:11.091692 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54065.6us
I20260709 13:17:11.030050 13002 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.041149 13121 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:11.113190 10040 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:17:11.042302 12891 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:11.078287 10031 rpcz_store.cc:276] 0709 13:17:08.288440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.288552 (+   112us) service_pool.cc:224] Handling call
0709 13:17:08.288866 (+   314us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:17:08.324941 (+ 36075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.324975 (+    34us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:17:08.325730 (+   755us) log.cc:844] Serialized 104 byte log entry
0709 13:17:08.802989 (+477259us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.852315 (+1049326us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.858897 (+  6582us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.340996 (+482099us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.513195 (+172199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.529230 (+ 16035us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.859672 (+330442us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b1800438e80. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:10.864510 (+  4838us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:11.018829 (+154319us) raft_consensus.cc:1685] finished
0709 13:17:11.018852 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.019061 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132017,"prepare.queue_time_us":333469,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":2451,"raft.queue_time_us":200618,"raft.run_cpu_time_us":666,"raft.run_wall_time_us":46559,"spinlock_wait_cycles":53160064,"thread_start_us":1513442,"threads_started":3,"wal-append.queue_time_us":760795}
W20260709 13:17:11.092056 13187 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:17:11.033932 13141 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.079732 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.121004 10113 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:11.121974 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.122642 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.123188 12515 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.246s	user 0.012s	sys 0.003s
I20260709 13:17:11.124169 13053 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.125422 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:11.130117 13166 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.132078 12985 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.116012 13121 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:11.133180 13121 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:11.135099 13142 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.135769 13142 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.136404 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1561) took 2576 ms. Trace:
I20260709 13:17:11.136772 10181 rpcz_store.cc:276] 0709 13:17:08.559848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.185606 (+625758us) service_pool.cc:224] Handling call
0709 13:17:10.522092 (+1336486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.522903 (+   811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.522937 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.523640 (+   703us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.595519 (+ 71879us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:10.595558 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.598715 (+  3157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.665678 (+ 66963us) raft_consensus.cc:1685] finished
0709 13:17:10.665701 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.136008 (+470307us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002ad0d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:11.136232 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1195,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":207,"spinlock_wait_cycles":2737512192,"thread_start_us":69197,"threads_started":1,"wal-append.queue_time_us":139344}
I20260709 13:17:11.139128 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.139967 10108 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:11.107409 12998 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:11.141788 12998 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.143935 10040 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
W20260709 13:17:11.115697 13188 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:17:11.148798 10033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 435) took 2484 ms (client timeout 2188 ms). Trace:
W20260709 13:17:11.149227 10033 rpcz_store.cc:269] 0709 13:17:08.664502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.913709 (+249207us) service_pool.cc:224] Handling call
0709 13:17:11.148431 (+2234722us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54000654d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:11.148605 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35020672}
I20260709 13:17:11.031098 13167 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.150892 10035 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.152189 13167 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.154228 13141 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.154596 12964 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.154958 12952 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.155405 12952 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:11.108366 13149 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.156845 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1575) took 2869 ms. Trace:
I20260709 13:17:11.157249 10037 rpcz_store.cc:276] 0709 13:17:08.287725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.287873 (+   148us) service_pool.cc:224] Handling call
0709 13:17:08.313265 (+ 25392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.016445 (+2703180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.156556 (+140111us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b540039c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:11.156788 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6094717312}
I20260709 13:17:11.159646 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.089519 12989 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:11.176837 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:11.116897 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.144932 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:11.173591 10035 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:11.185756 10034 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:11.187727 10040 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:11.040472 12961 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.117720 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:11.161219 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:11.131167 13171 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.119374 12919 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:11.218911 12919 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.177680 12952 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.222357 12988 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.224484 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:11.199548 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:11.204012 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 119543us
I20260709 13:17:11.204661 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:11.205336 10109 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.208957 13179 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:11.192139 13116 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:11.183305 12989 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.182107 12891 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.213238 10112 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:11.188858 13082 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.193053 13121 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.215843 13170 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.216609 10108 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.217821 12796 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:11.212195 10106 raft_consensus.cc:2410] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:17:11.230727 10031 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:11.204692 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:11.239833 10184 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:11.228392  9934 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 6, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 6 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:17:11.277624 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.287878 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 83277.4us
I20260709 13:17:11.290555 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.291517 10712 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:11.293596 13121 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.293957 12796 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.294555 12796 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.296751 12796 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:11.298481 13164 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:11.299932 13185 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:11.301385 13109 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 2.187s	user 0.023s	sys 0.008s
I20260709 13:17:11.301569 13185 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:11.301916 12995 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:11.302716 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.303452 10187 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:11.301417 10186 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:11.304774 10714 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.305442 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.306075 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.306668 10181 raft_consensus.cc:2376] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8. Re-sending same reply.
I20260709 13:17:11.306919 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.307999 10037 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.308626 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 445) took 1469 ms. Trace:
I20260709 13:17:11.308926 10037 rpcz_store.cc:276] 0709 13:17:09.839577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.307431 (+1467854us) service_pool.cc:224] Handling call
0709 13:17:11.307808 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.308383 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.308552 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.295048 12804 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.310653 12804 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.311000 12804 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.316294  9934 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.266993 12980 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.320072 10031 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.321269 12980 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.304292 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:11.323895 10712 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.324695 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1555) took 2988 ms. Trace:
I20260709 13:17:11.325084 10180 rpcz_store.cc:276] 0709 13:17:08.336466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.646788 (+310322us) service_pool.cc:224] Handling call
0709 13:17:08.647628 (+   840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.867979 (+1220351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.324230 (+1456251us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400097754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:11.324504 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792963456}
I20260709 13:17:11.329276 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:11.330087 13132 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.900s	user 0.008s	sys 0.018s
I20260709 13:17:11.318856  9934 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 8, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.351900 13171 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.272584 13142 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:11.333520 13116 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:11.371697  9934 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 4, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 4 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.331782 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:11.351900 13179 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:11.384996 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53354.8us
I20260709 13:17:11.385221 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:11.386114 13185 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:11.390491 10034 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:11.399253 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:11.400182 10004 connection.cc:256] RPC call timeout handler was delayed by -1.1463082129998838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 13:17:11.401947 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:11.378614 13082 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:11.419489 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 325227us
I20260709 13:17:11.403916 13002 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.403534 13179 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.421072 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 398737us
W20260709 13:17:11.426205 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.405278 13170 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:11.418452  9934 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:11.430538 10187 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:11.401701 12804 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.457165 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:11.459010  9934 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:17:11.491355 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.502280 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 45199.3us
W20260709 13:17:11.502156 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45111.8us
I20260709 13:17:11.505848 13002 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:11.431401 13179 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.507189 13004 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.430924 13082 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.507094 12720 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:11.509410 12720 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:11.510502 12804 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.510792 13185 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:11.426414 12980 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:17:11.511778 13185 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.512161 13185 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:11.507699 13004 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:11.510444 12720 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.514144 10034 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.514822 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1598) took 1032 ms. Trace:
I20260709 13:17:11.515172 10034 rpcz_store.cc:276] 0709 13:17:10.482654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.513619 (+1030965us) service_pool.cc:224] Handling call
0709 13:17:11.513962 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.514565 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.514763 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.517453 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1550) took 3108 ms. Trace:
I20260709 13:17:11.513242 13185 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.513316 13004 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.521823 13004 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.522490 13185 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.512043 12980 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:17:11.523319 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.525200 12980 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:11.526475 12980 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.527923 13170 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.528347 12980 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:11.517264 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 450) took 1020 ms. Trace:
I20260709 13:17:11.544008 10034 rpcz_store.cc:276] 0709 13:17:10.497354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.516421 (+1019067us) service_pool.cc:224] Handling call
0709 13:17:11.516739 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.516930 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.516956 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.517010 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:11.517041 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.517094 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.517190 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.517846 10185 rpcz_store.cc:276] 0709 13:17:08.335004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.343991 (+  8987us) service_pool.cc:224] Handling call
0709 13:17:08.362881 (+ 18890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.003303 (+640422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.391681 (+2388378us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54001004d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:11.443265 (+ 51584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471062400}
I20260709 13:17:11.513278  9934 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 7, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 7 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.607036 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 446) took 1757 ms. Trace:
W20260709 13:17:11.634706 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 246243us
I20260709 13:17:11.640807 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:11.642120 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 77906.5us
I20260709 13:17:11.635192 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:11.649636 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.655594 10714 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:11.660804 10185 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:11.661155 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.661775 13198 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:11.661211 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 50093.3us
I20260709 13:17:11.664557 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:11.666018 13177 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.668378 12988 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.669188 12988 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:11.670082 12988 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:11.670421 12988 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:11.671352 12988 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.671990  9934 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 3, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.673228 12988 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.676707 13170 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:11.681481 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 444) took 1842 ms. Trace:
I20260709 13:17:11.681917 10031 rpcz_store.cc:276] 0709 13:17:09.839337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.272327 (+1432990us) service_pool.cc:224] Handling call
0709 13:17:11.294692 (+ 22365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.320449 (+ 25757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.681238 (+360789us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b54003507d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:11.681417 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57930496}
I20260709 13:17:11.680526 13175 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.697412 10031 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 7. Ops: []
I20260709 13:17:11.632855 10033 rpcz_store.cc:276] 0709 13:17:09.850164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.308069 (+1457905us) service_pool.cc:224] Handling call
0709 13:17:11.308407 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.308616 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:11.308912 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.606652 (+297740us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.606714 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:11.606767 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.606836 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.606970 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3101,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":47361,"thread_start_us":250007,"threads_started":1}
W20260709 13:17:11.699437 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.700289 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:11.689379 13178 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.013s
I20260709 13:17:11.658421 12995 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.733901 12995 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.733700 13178 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.694512 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.740873 10715 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:17:11.741871 13201 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:17:11.744454 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1590) took 2605 ms. Trace:
I20260709 13:17:11.694794 12804 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.744930 10039 rpcz_store.cc:276] 0709 13:17:09.139190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.225467 (+2086277us) service_pool.cc:224] Handling call
0709 13:17:11.225830 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.226072 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:11.226378 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.744085 (+517707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.744149 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:11.744206 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.744269 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.744389 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40795,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"thread_start_us":476048,"threads_started":1}
I20260709 13:17:11.748275 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:11.750061 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 573293us
I20260709 13:17:11.750823 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:11.752362 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1557) took 3393 ms. Trace:
I20260709 13:17:11.744482 13205 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:11.753623 13053 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.753402 13205 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.754031 13053 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.754395 13053 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:11.758186 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.753435 12951 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.760627 12951 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.761294 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:11.761185 12951 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.762815 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.763625 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:11.762961 10115 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:11.764545 10112 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:11.765163 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.771363 12961 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.771899 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.772505 10185 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:11.773010 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.773396 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:11.773669 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.774174 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.774758 10108 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:11.773630 10115 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:11.775626 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.777683 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.778270 10112 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:11.779031 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.779295 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.779997 10109 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:11.780941 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 443) took 1941 ms. Trace:
I20260709 13:17:11.781307 10040 rpcz_store.cc:276] 0709 13:17:09.839055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.284060 (+1445005us) service_pool.cc:224] Handling call
0709 13:17:11.780157 (+496097us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:11.780341 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.780582 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.780610 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.780650 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:11.780733 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.780790 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.780886 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3195776}
I20260709 13:17:11.782236 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.783885 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.785279 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:11.785842 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.779681 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:11.765300 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.794056 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:11.800261 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.794353 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:11.801750 10038 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:17:11.752760 10188 rpcz_store.cc:276] 0709 13:17:08.359228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.757130 (+397902us) service_pool.cc:224] Handling call
0709 13:17:08.788674 (+ 31544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.130055 (+341381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.751927 (+2621872us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b540019cdd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:11.752185 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769961216}
W20260709 13:17:11.812346 10153 connection.cc:256] RPC call timeout handler was delayed by -1.4588092480000796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:17:11.813249 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:11.813259 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:11.813902 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.823753 10112 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.824543 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.818089 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1607) took 1001 ms. Trace:
I20260709 13:17:11.825534 10038 rpcz_store.cc:276] 0709 13:17:10.801331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.681027 (+879696us) service_pool.cc:224] Handling call
0709 13:17:11.739655 (+ 58628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.802220 (+ 62565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.802414 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:11.825519 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.829345 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.829826 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.758208 13054 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:11.833794 10184 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:11.836681 10716 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.837546 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:11.840837 10114 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.793100 12995 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:11.819171 12952 consensus_meta.cc:287] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.592s	user 0.035s	sys 0.021s
I20260709 13:17:11.798178 13205 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:11.867390 10187 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:11.800472 13178 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.842700 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.837172 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:11.877478 10188 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:11.846796 10712 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.004s
I20260709 13:17:11.848430 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.817116 12919 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.828670 12796 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.855121 10716 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:11.856087 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.860039 12847 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:11.861383 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62676.3us
I20260709 13:17:11.862138 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.863649 10110 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.878662 10712 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:11.879154 10153 leader_election.cc:400] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 6. Current term is 7.
I20260709 13:17:11.853852 12951 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.882210 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.822719 13082 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:11.854162 10155 connection.cc:256] RPC call timeout handler was delayed by -2.7321492829998988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:17:11.885350 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.887413 10185 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
W20260709 13:17:11.896103 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 101845us
I20260709 13:17:11.899374 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.910898 10109 raft_consensus.cc:2368] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9.
I20260709 13:17:11.915702 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:11.912218 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:11.919184 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 278472us
I20260709 13:17:11.922745 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.926784 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:11.928002 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.886454 13164 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:11.928751 10155 connection.cc:256] RPC call timeout handler was delayed by -2.3820492830000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:17:11.930398 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 97040.3us
I20260709 13:17:11.936209 10109 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.927587 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.938149 12787 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:11.940277 12802 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.940599 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:11.943882 12919 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.944542 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:11.936223 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:11.948510 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.949836 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.950951 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.878784 12952 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.952356 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.953586 12952 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:11.955734 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.956817 10715 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.957717 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:11.958282 10109 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:11.953521 10038 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:11.873656 13054 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:11.887416 13053 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.960247 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:11.932296 13172 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.970s	user 0.012s	sys 0.010s
W20260709 13:17:11.959383 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.988298 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:11.952395 13149 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.796s	user 0.025s	sys 0.031s
I20260709 13:17:11.990130 10188 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:11.996331 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:11.930025 13168 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:11.933161 13205 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:11.997726 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:12.002558 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1603) took 1325 ms. Trace:
W20260709 13:17:11.997404 10155 connection.cc:256] RPC call timeout handler was delayed by -2.156149282999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:17:12.003192 10034 rpcz_store.cc:276] 0709 13:17:10.677393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.564841 (+887448us) service_pool.cc:224] Handling call
0709 13:17:11.630894 (+ 66053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.631240 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:11.656690 (+ 25450us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.998907 (+342217us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.002187 (+  3280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:12.002241 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:12.002290 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.002354 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.002486 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32379,"prepare.queue_time_us":25361,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3107,"thread_start_us":291388,"threads_started":1}
I20260709 13:17:11.960376 13178 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:12.005545 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 85663us
W20260709 13:17:12.006356 10155 connection.cc:256] RPC call timeout handler was delayed by -2.144449282999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:17:12.006767 10155 connection.cc:256] RPC call timeout handler was delayed by -1.8624059989997477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:17:12.006385 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:12.007365 10155 connection.cc:256] RPC call timeout handler was delayed by -1.8276492830000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2598s for a response
W20260709 13:17:12.007802 10155 connection.cc:256] RPC call timeout handler was delayed by -1.7724059989998295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:17:12.008098 10155 connection.cc:256] RPC call timeout handler was delayed by -1.7412492829998882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26940000000000003s for a response
W20260709 13:17:12.008355 10155 connection.cc:256] RPC call timeout handler was delayed by -1.6822411599998759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:17:12.008610 10155 connection.cc:256] RPC call timeout handler was delayed by -1.6197492829999192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28290000000000004s for a response
W20260709 13:17:12.008864 10155 connection.cc:256] RPC call timeout handler was delayed by -1.619241159999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:17:12.009306 10155 connection.cc:256] RPC call timeout handler was delayed by -1.2585059989999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24580000000000002s for a response
W20260709 13:17:12.009645 10155 connection.cc:256] RPC call timeout handler was delayed by -1.0127952499999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2634s for a response
W20260709 13:17:12.011267 13202 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:17:12.013358 13171 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.013701 12998 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.871s	user 0.009s	sys 0.001s
I20260709 13:17:12.014513 10184 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:12.015712 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:12.016345 10184 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.014192 12998 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:11.932196 12796 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.021430 12796 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.022291 10113 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.933916 12951 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:17:12.024011 13180 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.177s	user 0.006s	sys 0.001s
I20260709 13:17:12.024744 12998 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:11.926257 12847 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:12.025651 13171 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:12.026827 12847 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:12.027999 13171 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:12.033227 13053 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.034006 10107 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:12.034605 10185 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:12.044560 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:12.047549 13204 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:17:12.049892 13207 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:17:12.051242 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1593) took 1584 ms. Trace:
I20260709 13:17:12.051299 10031 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.051913 13168 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.051703 10035 rpcz_store.cc:276] 0709 13:17:10.467215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.313376 (+846161us) service_pool.cc:224] Handling call
0709 13:17:11.313713 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.383149 (+ 69436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.383181 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.399095 (+ 15914us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.706245 (+307150us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.706286 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.706358 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.050932 (+344574us) raft_consensus.cc:1685] finished
0709 13:17:12.050959 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.051147 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67909,"raft.queue_time_us":69583,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10391,"thread_start_us":288764,"threads_started":1,"wal-append.queue_time_us":462752}
I20260709 13:17:12.053279 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2418) took 1136 ms. Trace:
I20260709 13:17:12.053758 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.053624 10031 rpcz_store.cc:276] 0709 13:17:10.916965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.706527 (+789562us) service_pool.cc:224] Handling call
0709 13:17:12.051121 (+344594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.051847 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.053055 (+  1208us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400165b50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:12.053209 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708650240}
I20260709 13:17:12.054953 13168 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.055089 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.057659 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.058465 10031 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:12.059254 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.055109 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.060597 10031 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:11.985787 13170 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.062861 13170 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:12.063287 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:12.064424 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.065382 13170 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:12.065660 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.066080 13205 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.066423 10034 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:12.066632 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.067313 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.067938 10034 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:12.068104 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:12.070158 10185 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.016201 12919 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:12.073937 10711 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:12.074978 10114 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
W20260709 13:17:12.098742 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.065724 13208 log.cc:927] Time spent T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:11.990439 13172 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:12.004174 13149 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.102528 13168 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.449s
W20260709 13:17:12.102659 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.552407 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 450572us
W20260709 13:17:12.553352 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.115433 10035 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:12.264209 13209 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:12.556949 10040 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.552789 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:12.133091 13030 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.568323 10106 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:12.427724  9934 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.030s	sys 0.022s
W20260709 13:17:12.570298  9934 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.034s	sys 0.022s
W20260709 13:17:12.461720 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.036303 13178 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.107686 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 64099.9us
I20260709 13:17:12.264137 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1588) took 3162 ms. Trace:
I20260709 13:17:12.564710 13030 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.555349 10035 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:17:12.582784 10039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.020s	sys 0.011s
W20260709 13:17:12.585976 10039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.021s	sys 0.011s
W20260709 13:17:12.118158 12810 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.015s	user 0.008s	sys 0.012s
W20260709 13:17:12.540778 12891 consensus_meta.cc:287] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.252s	user 0.016s	sys 0.012s
W20260709 13:17:12.416055 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.305272 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.156132 13006 consensus_meta.cc:287] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.206s	user 0.008s	sys 0.013s
W20260709 13:17:12.151731 12720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.021s	sys 0.052s
I20260709 13:17:12.133265 10184 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:12.581498 10032 rpcz_store.cc:276] 0709 13:17:09.102131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.810933 (+708802us) service_pool.cc:224] Handling call
0709 13:17:09.811293 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.668097 (+856804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.668158 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.668805 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.668986 (+   181us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:10.669017 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.152350 (+1483333us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400412154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:12.152409 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.152460 (+    51us) raft_consensus.cc:1685] finished
0709 13:17:12.152474 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.263955 (+111481us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1134,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":1968766848}
I20260709 13:17:12.447173 12952 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.585296 13178 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.264787 13205 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.606608 12810 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.262269 13054 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:12.631579 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56794.2us
I20260709 13:17:12.299252 13170 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.309s
I20260709 13:17:12.638860 10155 leader_election.cc:400] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:12.607338 12998 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.698364 10184 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:17:12.699877 13163 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.009s	sys 0.029s
W20260709 13:17:12.700253 13163 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.009s	sys 0.030s
W20260709 13:17:12.703943 13004 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.182s	user 0.016s	sys 0.000s
I20260709 13:17:12.704527 13004 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:12.705013 13004 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.707178 13004 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.707937 10038 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:12.708153 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 124540us
I20260709 13:17:12.709710 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:12.711032 10155 leader_election.cc:400] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:12.709725 13149 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.657016 12810 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:12.766222 10185 consensus_meta.cc:287] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.003s
I20260709 13:17:12.766696 10185 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
W20260709 13:17:12.688792 13161 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.010s	sys 0.031s
I20260709 13:17:12.608557 13006 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:12.608004 12891 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:12.769903 12961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.013s	sys 0.035s
W20260709 13:17:12.776152 10187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.021s	sys 0.029s
W20260709 13:17:12.777310 10187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.021s	sys 0.029s
W20260709 13:17:12.769819 13161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.010s	sys 0.031s
I20260709 13:17:12.779696 10184 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:12.777822 10183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.017s	sys 0.032s
I20260709 13:17:12.782327 10037 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:17:12.781241 10183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.017s	sys 0.032s
I20260709 13:17:12.772974 13205 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:12.786180 12810 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.787041 13179 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:12.765498 12998 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:12.777237 12961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.013s	sys 0.036s
I20260709 13:17:12.696652 12952 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:12.791348 10188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.013s	sys 0.022s
W20260709 13:17:12.779807 10710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.004s	sys 0.029s
W20260709 13:17:12.800709 10188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.013s	sys 0.022s
W20260709 13:17:12.800524 10112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.015s	sys 0.019s
W20260709 13:17:12.802268 10112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.016s	sys 0.019s
W20260709 13:17:12.800127 10180 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.014s	sys 0.026s
W20260709 13:17:12.803040 10180 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.014s	sys 0.026s
I20260709 13:17:12.792070 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 574) took 1466 ms. Trace:
W20260709 13:17:12.800295 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.005s	sys 0.039s
W20260709 13:17:12.804400 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.005s	sys 0.039s
W20260709 13:17:12.804733 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 833335us
W20260709 13:17:12.834472 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122704us
W20260709 13:17:12.838373 10182 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.010s	sys 0.029s
W20260709 13:17:12.839988 10182 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.010s	sys 0.029s
I20260709 13:17:12.876418 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:12.877312 10114 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:12.878193 10711 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:12.835440 10710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.004s	sys 0.029s
I20260709 13:17:12.804032 10183 rpcz_store.cc:276] 0709 13:17:11.325367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.326357 (+   990us) service_pool.cc:224] Handling call
0709 13:17:11.326738 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.327119 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.327148 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.327623 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.491970 (+164347us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:11.989542 (+497572us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.784191 (+794649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.784277 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.784322 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:12.784335 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.791998 (+  7663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20453,"prepare.queue_time_us":1058782,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":42610,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":15847,"thread_start_us":1369696,"threads_started":3,"wal-append.queue_time_us":487452}
I20260709 13:17:12.891283 10115 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:12.894623 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:12.897147 10109 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:12.794049 13179 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:17:12.899467 10153 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:12.899417 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:12.902407 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:12.881352 13172 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:12.906724 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:12.908797 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:12.903198 10708 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
W20260709 13:17:12.908829 10713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.007s	sys 0.014s
W20260709 13:17:12.911630 10713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.008s	sys 0.014s
I20260709 13:17:12.898315 13205 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.909037 10189 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.006s	sys 0.016s
W20260709 13:17:12.914549 10189 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.006s	sys 0.016s
I20260709 13:17:12.922479 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 582) took 1272 ms. Trace:
I20260709 13:17:12.921877 12995 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.927630 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:12.924408 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:12.936208 10186 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.024s	sys 0.032s
W20260709 13:17:12.936631 10186 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.024s	sys 0.032s
I20260709 13:17:12.924063 13030 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:12.938755 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 481) took 4483 ms. Trace:
W20260709 13:17:12.926148 13185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.018s	sys 0.027s
I20260709 13:17:12.941128 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 499) took 1843 ms. Trace:
W20260709 13:17:12.939833 12989 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.654s	user 0.014s	sys 0.020s
I20260709 13:17:12.968943 10113 rpcz_store.cc:276] 0709 13:17:11.098144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.123123 (+ 24979us) service_pool.cc:224] Handling call
0709 13:17:11.123409 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.022716 (+899307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.940875 (+918159us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400362754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:12.941065 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066766208}
W20260709 13:17:12.968717 13185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.018s	sys 0.027s
I20260709 13:17:12.970765 13232 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:12.973106 13006 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:12.923018 10713 rpcz_store.cc:276] 0709 13:17:11.640521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.640674 (+   153us) service_pool.cc:224] Handling call
0709 13:17:11.655672 (+ 14998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.705313 (+ 49641us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:11.822939 (+117626us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.912262 (+1089323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:12.912314 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:12.912356 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.912424 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.912545 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78611,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5671,"raft.queue_time_us":94,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":13076,"thread_start_us":986381,"threads_started":1}
I20260709 13:17:12.965088 10111 rpcz_store.cc:276] 0709 13:17:08.310710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.311025 (+   315us) service_pool.cc:224] Handling call
0709 13:17:08.332758 (+ 21733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.341738 (+  8980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.341767 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.342187 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.838048 (+2495861us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18002ffd40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:17:10.996805 (+158757us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:11.013521 (+ 16716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.025981 (+ 12460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.783679 (+1757698us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54000f2920. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45ddbe 00007f3c6f468930 00007f3c6f4688d8 00007f3c6f468858 00007f3c6f468813 00007f3c6f467a9c 00007f3c75353626 00007f3c7534ddd8 00007f3c6f4a47cb 00007f3c6f4a72c0
0709 13:17:12.794324 (+ 10645us) raft_consensus.cc:1685] finished
0709 13:17:12.794347 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.794502 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12012,"raft.queue_time_us":9285,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8540,"spinlock_wait_cycles":36602880,"thread_start_us":84486,"threads_started":1,"wal-append.queue_time_us":2630003}
I20260709 13:17:12.975188 12989 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:12.971789 12891 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:12.980005 10033 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.939319 12919 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:17:12.983848 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:12.979478 12989 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:12.937160 13205 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:12.997756 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 361566us
I20260709 13:17:13.004267 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 452) took 1910 ms. Trace:
I20260709 13:17:13.004719 10039 rpcz_store.cc:276] 0709 13:17:11.093675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.746444 (+652769us) service_pool.cc:224] Handling call
0709 13:17:11.746789 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.747052 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:11.812618 (+ 65566us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.003914 (+1191296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.003969 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:13.004019 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.004086 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.004203 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70703,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":201226,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":1144317,"threads_started":2,"wal-append.queue_time_us":1081481}
W20260709 13:17:13.010161 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.015609 10004 leader_election.cc:400] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9.
I20260709 13:17:13.017879 10004 leader_election.cc:403] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:13.003628 12952 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.035636 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2427) took 1157 ms. Trace:
W20260709 13:17:13.037899 10181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.028s	sys 0.024s
I20260709 13:17:13.029065 12989 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.043648 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.051128 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1373) took 1192 ms. Trace:
I20260709 13:17:13.040104 10031 rpcz_store.cc:276] 0709 13:17:11.878117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.132139 (+254022us) service_pool.cc:224] Handling call
0709 13:17:12.551547 (+419408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.033024 (+481477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.033056 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.033099 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:13.034844 (+  1745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.035409 (+   565us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.035570 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155943,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2728,"thread_start_us":480982,"threads_started":1}
W20260709 13:17:13.051729 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.051551 10108 rpcz_store.cc:276] 0709 13:17:11.858289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.862611 (+  4322us) service_pool.cc:224] Handling call
0709 13:17:11.862923 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.068083 (+205160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.068114 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:12.068160 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:12.068202 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.050890 (+982688us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002837d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:13.050937 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.051068 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292097408}
I20260709 13:17:13.035236 13006 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:13.038107 12810 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:13.059989 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.040766 12961 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:17:13.058264 13229 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.106369 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:13.107172 10184 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:13.110502 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 184919us
I20260709 13:17:13.115556 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.091769 12810 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.103677 13245 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.091145 13006 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.111956 12919 consensus_queue.cc:1243] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:13.123970 12810 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.117564 13163 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:13.124974 13163 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.126999 13163 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:13.127661 13245 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.177426 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1371) took 1319 ms. Trace:
I20260709 13:17:13.216384 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:13.245263 10078 leader_election.cc:336] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.517s (SENT)
I20260709 13:17:13.281916 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:13.282646 10039 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:13.281580 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:13.286072 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 579) took 1914 ms. Trace:
I20260709 13:17:13.154688 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:13.314690 10031 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:13.194680 13231 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:17:13.274504 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:13.271924 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 212009us
I20260709 13:17:13.209648 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 582) took 1197 ms. Trace:
W20260709 13:17:13.229319 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 111062us
I20260709 13:17:13.120319 13240 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:13.229969 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 257955us
W20260709 13:17:13.267391 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64602.5us
I20260709 13:17:13.258755 10111 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:13.194708 13234 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 13:17:13.138521 13229 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.254288 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1591) took 1426 ms. Trace:
I20260709 13:17:13.325929 10035 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:13.335917 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:13.325515 10186 rpcz_store.cc:276] 0709 13:17:12.011976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.152446 (+140470us) service_pool.cc:224] Handling call
0709 13:17:12.152818 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.153033 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:12.936970 (+783937us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.209240 (+272270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.209308 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:13.209360 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.209430 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.209571 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27546,"prepare.queue_time_us":547026,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":141325,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":828364,"threads_started":2,"wal-append.queue_time_us":312726}
I20260709 13:17:13.337604 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:13.338043 13212 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.070s	user 0.000s	sys 0.003s
I20260709 13:17:13.338531 10186 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.315303 10181 rpcz_store.cc:276] 0709 13:17:11.371962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.426743 (+ 54781us) service_pool.cc:224] Handling call
0709 13:17:11.627570 (+200827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.637885 (+ 10315us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:12.137667 (+499782us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.270201 (+1132534us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.270784 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.270974 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.271006 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.271066 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.285843 (+ 14777us) raft_consensus.cc:1685] finished
0709 13:17:13.285865 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.286007 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10454,"prepare.queue_time_us":906523,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":251160,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":5076,"thread_start_us":1181901,"threads_started":3,"wal-append.queue_time_us":691423}
I20260709 13:17:13.200515 13239 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:13.193142 13232 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:13.340070 13164 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:13.347563 13232 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.348706 13164 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:13.349236 13164 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:13.350229 13172 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:13.350677 13172 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:13.353785 12995 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:13.354286 12995 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.350188 13164 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.356892 13164 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.358197 12998 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.359124 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 500) took 1599 ms. Trace:
I20260709 13:17:13.359483 10106 rpcz_store.cc:276] 0709 13:17:11.759796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.759925 (+   129us) service_pool.cc:224] Handling call
0709 13:17:11.760260 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.568812 (+808552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.358899 (+790087us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400420c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:13.359065 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857912192}
I20260709 13:17:13.345297 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 575) took 2016 ms. Trace:
I20260709 13:17:13.360924 10180 rpcz_store.cc:276] 0709 13:17:11.328539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.328668 (+   129us) service_pool.cc:224] Handling call
0709 13:17:11.329016 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.555562 (+226546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.555603 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.629637 (+ 74034us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.866012 (+236375us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:12.803449 (+937437us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.803688 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.803785 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.337364 (+533579us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:13.340078 (+  2714us) raft_consensus.cc:1685] finished
0709 13:17:13.345084 (+  5006us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.345237 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12310,"prepare.queue_time_us":685414,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":9334,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":48489,"spinlock_wait_cycles":1148759424,"thread_start_us":1364195,"threads_started":3,"wal-append.queue_time_us":480966}
I20260709 13:17:13.362923 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:13.363680 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.335330 10187 rpcz_store.cc:276] 0709 13:17:11.827469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.926605 (+ 99136us) service_pool.cc:224] Handling call
0709 13:17:11.967280 (+ 40675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.967518 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:12.778768 (+811250us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.253911 (+475143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.253968 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.254016 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.254084 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.254221 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":584435,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":219561,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":78,"thread_start_us":1247785,"threads_started":3,"wal-append.queue_time_us":489958}
I20260709 13:17:13.348567 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.195930 13242 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.155673 13241 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:13.201786 13245 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:13.194739 13205 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:13.178092 12919 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:13.178315 13243 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.329619 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.329452 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 174850us
I20260709 13:17:13.325978 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.326402 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.275321 13251 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.333119 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:13.395501 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:13.333868 13254 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.396817 10184 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:13.397208 10180 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.282277 12989 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9.
I20260709 13:17:13.247059 10112 rpcz_store.cc:276] 0709 13:17:11.857677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.861106 (+  3429us) service_pool.cc:224] Handling call
0709 13:17:11.861482 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.869499 (+  8017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.869529 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.924978 (+ 55449us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.802697 (+877719us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:12.802737 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.805119 (+  2382us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.123319 (+318200us) raft_consensus.cc:1685] finished
0709 13:17:13.123342 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.177342 (+ 54000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2158,"raft.queue_time_us":7923,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7098,"thread_start_us":734691,"threads_started":1,"wal-append.queue_time_us":1062241}
I20260709 13:17:13.334133 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:13.341068 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.398730 10039 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:13.399899 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.401023 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:13.401558 10039 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.154062 12952 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 13:17:13.404467 12952 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:13.404835 12952 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:13.405802 12952 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.407178 12952 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.336530 10183 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:13.259157 13250 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.342664 13260 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.196583 12961 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.139s
I20260709 13:17:13.410017 10035 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:13.335287 13229 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.410615 13229 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.389089 12998 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:13.198782 13178 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.414498 10106 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:13.415426 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 583) took 1774 ms. Trace:
I20260709 13:17:13.394708 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:13.417682 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 91797.2us
I20260709 13:17:13.420110 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:13.422818 10183 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:13.421394 10181 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:13.415711 13178 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:13.431499 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.423319 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 576) took 2094 ms. Trace:
I20260709 13:17:13.432041 10189 rpcz_store.cc:276] 0709 13:17:11.328855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.330888 (+  2033us) service_pool.cc:224] Handling call
0709 13:17:11.746926 (+416038us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:11.747118 (+   192us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:11.747605 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.747634 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:11.752338 (+  4704us) log.cc:844] Serialized 52 byte log entry
0709 13:17:12.117029 (+364691us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:13.362182 (+1245153us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b180038ed80. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf
0709 13:17:13.362316 (+   134us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.422844 (+ 60528us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.423044 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.423114 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.423153 (+    39us) raft_consensus.cc:1685] finished
0709 13:17:13.423163 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.423269 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33874,"prepare.queue_time_us":586642,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":74144,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":64524928,"thread_start_us":1144755,"threads_started":2,"wal-append.queue_time_us":1161177}
I20260709 13:17:13.429008 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:13.434626 10153 leader_election.cc:403] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:13.429589 10679 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:13.431411 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 105074us
I20260709 13:17:13.442091 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:13.392345 12919 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:13.445159 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:13.417104 13251 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.423982 13260 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.351472 13172 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.387619 13257 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:17:13.416632 13254 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:13.429476 12998 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.427953 13185 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.440099 12802 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.453956 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:13.344139 13240 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.461189 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 580) took 1450 ms. Trace:
I20260709 13:17:13.455713 10713 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.423631 12810 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:13.443219 12989 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.440443 13239 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:13.446938 13251 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.461635 10188 rpcz_store.cc:276] 0709 13:17:12.011283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.029270 (+ 17987us) service_pool.cc:224] Handling call
0709 13:17:12.029666 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.030043 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.030069 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.030585 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.801887 (+771302us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:12.875832 (+ 73945us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.876068 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.876147 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.460961 (+584814us) raft_consensus.cc:1685] finished
0709 13:17:13.460982 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.461121 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78329,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":77635,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":5820,"thread_start_us":770917,"threads_started":1,"wal-append.queue_time_us":985838}
W20260709 13:17:13.475251 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 230023us
W20260709 13:17:13.477051 10078 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.652s (SENT)
I20260709 13:17:13.441535 12995 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.475277 12989 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.478199 13247 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:17:13.478538 12919 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.473129 13257 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:17:13.462558 12802 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.448899 13260 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.482146 12995 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.478222 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:13.479234 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:13.483906 10709 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:13.484375 10708 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:13.486941 12989 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.487349 10032 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:13.393491 13241 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.487453 12989 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.480384 12802 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.480456 13257 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:13.496275 13257 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:13.497160 13257 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.498693 13257 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:13.493147 10078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.696s (SENT) [suppressed 7 similar messages]
I20260709 13:17:13.500326 10039 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
W20260709 13:17:13.488278 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 124717us
I20260709 13:17:13.501513 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:13.492345 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:13.398041 13242 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.492057 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:13.518023 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72939.8us
I20260709 13:17:13.510799 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:13.520469 10039 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.521930 10186 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:13.506006 10031 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:13.509780 10180 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:13.511629 13240 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.479707 12919 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.487834 12818 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:17:13.428180 13243 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.450723 13254 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.525779 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:13.448745 13258 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:13.530081 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.569720 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:13.571288 10031 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.572791 10181 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:13.530961 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.479257 13247 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:13.500713 12989 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:13.578671 10039 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:13.492730 13030 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.582713 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.579666 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:13.587023 10039 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:13.488019 13261 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.593278 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.596182 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.596843 10039 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:13.598661 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.599273 10039 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:13.574899 13240 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:13.601259 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 147381us
I20260709 13:17:13.602584 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.578248 13247 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:13.603719 10039 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:13.586663 12989 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.584641 13030 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.530479 13244 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:17:13.500685 13239 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.625581 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:13.599958 13185 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:13.628141 10031 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:13.604404 13265 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.629745 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:13.636176 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 262299us
I20260709 13:17:13.616637 13030 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.645301 10039 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:13.651175 10031 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:17:13.651651 10031 pending_rounds.cc:85] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
I20260709 13:17:13.601079 12802 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.653218 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:13.666056 10031 pending_rounds.cc:107] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:13.666707 10031 raft_consensus.cc:2889] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:13.667604 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64448.3us
I20260709 13:17:13.669643 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.670435 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.623984 13240 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:13.752153 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 75768.1us
W20260709 13:17:13.766255 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 144053us
W20260709 13:17:13.770005 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 99640.2us
I20260709 13:17:13.770985 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:13.772068 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.773343 10707 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:13.675220 13261 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:13.684027 12961 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.683765 13270 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.774881 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.420828 10710 rpcz_store.cc:276] 0709 13:17:11.640966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.650708 (+  9742us) service_pool.cc:224] Handling call
0709 13:17:11.680164 (+ 29456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.680649 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.684389 (+  3740us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.828415 (+144026us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.896122 (+1067707us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:12.900849 (+  4727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.904697 (+  3848us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.415219 (+510522us) raft_consensus.cc:1685] finished
0709 13:17:13.415245 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.415369 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9577,"raft.queue_time_us":641,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16956,"thread_start_us":1021142,"threads_started":1,"wal-append.queue_time_us":1104473}
I20260709 13:17:13.789883 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.791558 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.649096 13265 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.788147 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.795187 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:13.798542 10034 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:13.798982 10034 pending_rounds.cc:85] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 5
I20260709 13:17:13.799206 10034 pending_rounds.cc:107] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 13:17:13.799131 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 129592us
I20260709 13:17:13.799676 10034 raft_consensus.cc:2889] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.801290 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:13.802062 10712 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:13.786554 13112 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.804117 13112 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:13.804538 13112 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.805616 13240 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:13.806342 13240 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:13.807339 13240 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.801185 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:13.778280 13178 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:13.808209 13178 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:13.808701 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:13.808223 10714 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:13.800472 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:13.788609 13238 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:13.815171 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:13.775583 13276 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.816212 10713 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
W20260709 13:17:13.792491 13266 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:17:13.787262 12961 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:13.808638 13268 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:17:13.793848 13244 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:13.778640 13274 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:13.833915 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 340792us
W20260709 13:17:13.836776 10107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 501) took 2054 ms (client timeout 2164 ms). Trace:
I20260709 13:17:13.809160 13178 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.845520 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:13.817936 12802 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.815218 13121 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:13.833410 13171 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.804s	user 0.010s	sys 0.012s
I20260709 13:17:13.810204 13240 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:13.853376 10183 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:13.849284 10107 rpcz_store.cc:269] 0709 13:17:11.760799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.760920 (+   121us) service_pool.cc:224] Handling call
0709 13:17:13.815146 (+2054226us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001bec54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:13.815290 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558843264}
I20260709 13:17:13.818586 13280 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:13.848055 13244 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:13.873443 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 64804.6us
I20260709 13:17:13.842897 12961 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.848942 13082 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:13.878800 13213 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.867s	user 0.011s	sys 0.035s
I20260709 13:17:13.879384 13269 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.788757 13185 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.851563 13265 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.844617 12891 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.672304 13247 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.854916 13241 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:13.876323 13171 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.847s	user 0.011s	sys 0.012s
I20260709 13:17:13.848685 13275 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.890368 13239 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:13.880344 13282 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.908591 10713 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:13.872186 13121 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.892505 13082 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:13.900184 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 77047.4us
I20260709 13:17:13.902747 13265 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.796854 13270 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.889365 13277 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.846324 13276 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.919348 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:13.889918 13240 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.923394 13244 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.924981 13082 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.927050 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1586) took 5085 ms. Trace:
I20260709 13:17:13.916239 13282 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.902822 13243 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.904663 13275 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:13.935215 13226 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.844s	user 0.000s	sys 0.003s
I20260709 13:17:13.919799 13121 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.916774 13242 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:13.929942 13247 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.937863 13277 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.963047 13149 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.963667 13149 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.964123 13149 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.966699 13112 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.973110 10181 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:13.900470 13280 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:13.949395 10036 rpcz_store.cc:276] 0709 13:17:08.841999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.175871 (+333872us) service_pool.cc:224] Handling call
0709 13:17:09.176198 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.179685 (+  3487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.179715 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.190034 (+ 10319us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.663043 (+2473009us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18002f1040. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:17:11.920080 (+257037us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:11.920140 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.929454 (+  9314us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.878089 (+1948635us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:13.926691 (+ 48602us) raft_consensus.cc:1685] finished
0709 13:17:13.926712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.926859 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3070,"raft.queue_time_us":4803,"raft.run_cpu_time_us":8322,"raft.run_wall_time_us":137007,"spinlock_wait_cycles":61755520,"thread_start_us":203108,"threads_started":1,"wal-append.queue_time_us":2760448}
W20260709 13:17:13.968516 13214 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.703s	user 0.007s	sys 0.012s
I20260709 13:17:13.953474 13275 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.947930 13265 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:13.990890 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 149922us
I20260709 13:17:13.958020 13277 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.993548 10183 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:13.993584 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:13.956112 13243 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:17:13.992019 10078 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.742s (SENT)
I20260709 13:17:13.909116 13261 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:13.991240 13082 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.974781 13030 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.004505 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:14.007830 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 131093us
I20260709 13:17:14.009333 13245 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.009877 13245 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:14.010038 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:14.010541 13265 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.010793 13245 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:14.011621 12952 consensus_meta.cc:287] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.003s
I20260709 13:17:14.012542 13282 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.012840 13002 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:14.001001 13179 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:14.011142 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.013628 13179 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.014092 13179 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.014194 13288 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.014794 13288 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.016964 13288 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.018215 13002 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.019552 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:14.020027 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 591135us
I20260709 13:17:14.021386 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1610) took 2860 ms. Trace:
I20260709 13:17:14.021950 10040 rpcz_store.cc:276] 0709 13:17:11.160905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.782289 (+621384us) service_pool.cc:224] Handling call
0709 13:17:11.782583 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.557348 (+774765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.021160 (+1463812us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400398fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:14.021328 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780472192}
W20260709 13:17:14.023473 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.027289 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 578) took 2655 ms. Trace:
I20260709 13:17:14.033867 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:14.036616 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.014194 13215 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.394s	user 0.001s	sys 0.002s
I20260709 13:17:14.034519 10714 raft_consensus.cc:2376] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8. Re-sending same reply.
I20260709 13:17:14.039183 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.004578 13283 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:14.012779 13030 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.046559 10034 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:14.053174 10034 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.029294 13002 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.029314 10182 rpcz_store.cc:276] 0709 13:17:11.371584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.381230 (+  9646us) service_pool.cc:224] Handling call
0709 13:17:11.406233 (+ 25003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.417588 (+ 11355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.417623 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.502222 (+ 84599us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.894351 (+392129us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:12.841769 (+947418us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.842039 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.842119 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.967888 (+1125769us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:14.020419 (+ 52531us) raft_consensus.cc:1685] finished
0709 13:17:14.027085 (+  6666us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.027228 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":657252,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":5547,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":15612,"spinlock_wait_cycles":1043533056,"thread_start_us":1143893,"threads_started":2,"wal-append.queue_time_us":654263}
I20260709 13:17:14.055174 13274 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.011050 13254 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.063869 13002 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:14.063716 13274 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.065179 13255 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:14.064929 13002 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.065711 13255 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.067185 13256 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:14.067814 13256 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.064932 10034 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.071313 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:14.068389 13251 consensus_meta.cc:287] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.002s
W20260709 13:17:14.063485 13295 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:17:14.075809 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71379.6us
I20260709 13:17:14.046156 13232 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:14.083074 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.074246 13251 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.045930 12802 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:14.086268 13112 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:14.085276 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 192822us
I20260709 13:17:14.090143 12901 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.091619 12901 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.063815 13270 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.092674 13280 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:14.096266 13257 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.002s
I20260709 13:17:14.054414 13283 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.074260 13255 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:14.100078 13254 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.100618 13283 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.092831 13279 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:17:14.102662 12989 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.102677 13279 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:14.056428 12720 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:14.103725 13279 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:14.104601 13279 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:14.105587 13260 consensus_meta.cc:287] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.625s	user 0.000s	sys 0.009s
I20260709 13:17:14.105764 13279 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.106045 13260 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.110103 10040 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:17:14.110502 10040 pending_rounds.cc:85] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 6
I20260709 13:17:14.110708 10040 pending_rounds.cc:107] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:17:14.110920 10040 raft_consensus.cc:2889] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.113945 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:14.117169 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.117692 10031 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.119823 10034 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:14.118417 12901 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:14.120931 13240 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.118645 13282 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:14.121990 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 547875us
I20260709 13:17:14.123878 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:14.125007 13254 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.126053 13276 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:14.112106 12919 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.003s
I20260709 13:17:14.127202 10186 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:17:14.127563 10186 pending_rounds.cc:85] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:17:14.127825 10186 pending_rounds.cc:107] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:14.128062 10186 raft_consensus.cc:2889] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.129480 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:14.132560 12998 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:14.132989 12998 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.133821 12998 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.135063 12998 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.136037 12919 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.122010 13282 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:14.137316 13282 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:14.137928 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.137863 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:14.140210 10185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 583) took 2128 ms (client timeout 2164 ms). Trace:
I20260709 13:17:14.112480 13250 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:14.141150 13250 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:14.141523 13262 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.541s	user 0.000s	sys 0.005s
I20260709 13:17:14.142196 13250 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.143535 10716 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:14.112689 13030 consensus_queue.cc:1175] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a67604b91f54791b1316fd327793337" responder_term: 6 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:14.140748 10185 rpcz_store.cc:269] 0709 13:17:12.012279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.044227 (+ 31948us) service_pool.cc:224] Handling call
0709 13:17:14.140012 (+2095785us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54003f0cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:14.140130 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57133312}
I20260709 13:17:14.147887 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 451) took 3251 ms. Trace:
I20260709 13:17:14.148134 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.148490 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.149194 10112 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:14.076870 13252 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:14.148139 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:14.151960 13210 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.599s	user 0.003s	sys 0.004s
I20260709 13:17:14.153453 12961 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.154881 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1591) took 4301 ms. Trace:
I20260709 13:17:14.155251 10037 rpcz_store.cc:276] 0709 13:17:09.853394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.309663 (+1456269us) service_pool.cc:224] Handling call
0709 13:17:11.310007 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.785180 (+1475173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.154642 (+1369462us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400276fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:14.154819 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3385502464}
W20260709 13:17:14.121572 13206 log.cc:927] Time spent T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.553s	user 0.000s	sys 0.005s
W20260709 13:17:14.113564 13229 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.004s
I20260709 13:17:14.136195 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.158587 10033 rpcz_store.cc:276] 0709 13:17:10.896815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.699792 (+802977us) service_pool.cc:224] Handling call
0709 13:17:11.743552 (+ 43760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.980417 (+1236865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.147635 (+1167218us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540031ddd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:14.147829 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843181824}
W20260709 13:17:14.159091 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.157073 10038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2435) took 2271 ms (client timeout 1685 ms). Trace:
W20260709 13:17:14.162846 10038 rpcz_store.cc:269] 0709 13:17:11.885479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.960003 (+ 74524us) service_pool.cc:224] Handling call
0709 13:17:14.156886 (+2196883us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400276ad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:14.157004 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690257280}
I20260709 13:17:14.169795 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.077225 12891 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.175993 13254 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.176275 12891 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.176383 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.176482 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.194468 12720 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.194780 13256 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.195602 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:14.196784 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:14.197427 10037 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:14.198310 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:14.200949 10037 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:14.201357 10034 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:14.155725 12961 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.177021 12919 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.176764 10710 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.203416 12919 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.203918 12919 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:14.177073 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63193.9us
I20260709 13:17:14.191150 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.205549 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:14.177842 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57826.2us
I20260709 13:17:14.207819 10108 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:14.206795 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:14.210870 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.212239 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:14.226563 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 88756.1us
I20260709 13:17:14.227429 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:14.234195 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:14.235606 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.172048 13269 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.232087 13256 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.157299 13229 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:14.251439 10078 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.142s (SENT)
W20260709 13:17:14.258437 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52971.6us
W20260709 13:17:14.277745 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51609.1us
I20260709 13:17:14.259250 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:14.284040 10031 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:14.287137 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.298571 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:14.298192 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 178697us
I20260709 13:17:14.299469 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:14.302906 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.304147 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.303259 13261 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:14.304792 10185 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:14.306119 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.307476 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.307377 12891 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:14.308588 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.309947 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.306494 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:14.310618 10184 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:17:14.311008 13161 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:14.311396 13161 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.311976 10108 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.312216 13161 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.313186 13161 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.315537 13163 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:14.316630 13163 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:14.317087 13163 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:14.318697 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:14.319412 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.320047 10180 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:14.303607 10187 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:14.255076 13255 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.267187 13002 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:14.344480 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93075.3us
I20260709 13:17:14.341879 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.332955 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:14.325228 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:14.347352 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62231.9us
I20260709 13:17:14.355031 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.348363 10183 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:14.354651 10038 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.358361 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.288156 13232 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.291250 13241 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.291642 13254 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:14.253319 13053 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:17:14.156508 13252 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.368198 10188 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:14.319095 13270 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:14.325995 13283 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.320286 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:14.350127 13265 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:14.391788 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71547.8us
I20260709 13:17:14.392907 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:14.382869 13256 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.393921 13293 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.394425 13293 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.394779 13293 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.350278 12720 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:14.369757 13241 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:14.396196 13241 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.291335 12995 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:17:14.397598 12995 consensus_queue.cc:1243] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:14.384352 13270 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:14.400458 12961 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:14.402716 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47632.1us
I20260709 13:17:14.298264 13151 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:17:14.260198 13269 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.414182 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.401228 12961 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.422472 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.422863 13283 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:14.434867 13283 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:14.438870 13121 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.441251 13275 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.442966 12961 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.445812 13282 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.444423 12919 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.391856 13053 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:14.448762 13053 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.449446 13269 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.400015 12891 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:17:14.451244 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.451707 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:14.400707 13270 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.458037 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:14.461382 13312 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:14.461932 13312 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.462285 13312 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.462407 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.472090 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.475139 10108 raft_consensus.cc:1217] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-11.11]   Dedup: 8.9->[9.10-11.11]
I20260709 13:17:14.450344 13053 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.399880 13149 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.480010 13255 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.480070 13296 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:14.357406 13163 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.483301 13298 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.483762 13252 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:14.484894 10038 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:14.486584 13121 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.488296 12891 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:14.495787 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 150654us
I20260709 13:17:14.516609 10111 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:17:14.517817 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.457649 13151 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.500034 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.505587 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.518996 10188 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.459774 13256 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.508596 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:14.464136 12919 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.514273 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.517695 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.497025 10108 pending_rounds.cc:85] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 9
I20260709 13:17:14.520064 10186 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.523427 10108 pending_rounds.cc:107] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:14.463385 13232 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:17:14.498695 13282 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.524417 10108 raft_consensus.cc:2889] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.504724 13261 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:14.505369 13255 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:14.514252 13053 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.527906 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.531068 10038 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.540014 10708 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.519703 12891 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.509263 13277 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.548977 13149 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.537253 13163 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.526549 13275 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:14.573029 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:14.553172 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.558950 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.559725 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.560141 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.561285 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.561858 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.562654 10110 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.577773 10109 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:14.578058 10106 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.578747 10186 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:14.528473 13255 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.581161 10715 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:14.582137 13252 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:14.587524 10106 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:14.582281 13205 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:14.583962 10115 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:14.569422 13256 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.591566 13256 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:14.592883 13271 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.716s	user 0.002s	sys 0.000s
W20260709 13:17:14.587536 13179 consensus_meta.cc:287] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:17:14.583146 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.564369 13261 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.595099 13205 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.565605 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.597848 10189 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:14.561978 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:14.598186 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.570567 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.598553 10112 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:14.593809 13256 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:14.580271 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.601051 10038 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:14.594372 13179 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.603772 10708 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.606331 13240 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.609839 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.654645 13179 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.612186 12995 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.655294 12995 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:14.616238 13229 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:14.656579 10037 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:14.637634 10034 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:14.638769 13277 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.641185 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.628813 12891 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.652910 13265 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:14.654844 10111 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:14.656163 12995 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.630537 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.563391 13241 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.518687 13151 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.666213 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.660029 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.662810 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:14.664453 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:14.678030 10186 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:14.678267 10715 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.679580 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.680889 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.674825 10712 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:14.673549 10112 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:14.666201 10707 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:14.685546 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.686520 10707 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:14.688277 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.689046 10189 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.670325 10188 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:14.694486 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.685276 12995 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.665382 13265 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.643306 13293 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.673213 13242 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.700004 13161 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:14.687732 12891 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.662701 13149 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:17:14.707499 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.708057 10715 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:14.663393 13178 consensus_queue.cc:1059] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:14.709627 10188 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:14.711568 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:14.722451 10031 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:14.660519 12901 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:14.695632 10707 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.727034 10707 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:14.728725 13168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.124s	user 0.007s	sys 0.013s
W20260709 13:17:14.729111 13168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.137s	user 0.007s	sys 0.013s
I20260709 13:17:14.708576 13242 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.730685 13004 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:14.731148 13004 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:14.732313 10114 raft_consensus.cc:2410] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:17:14.732129 13004 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.733436 13004 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:14.742355 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.755311 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.756407 10188 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:14.724884 13289 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:14.756063 13121 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:14.765645 13121 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.766516 13121 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.738600 13149 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.737797 12919 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:14.772085 13279 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.005s
I20260709 13:17:14.773447 13121 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.777070 13006 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.778883 10707 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:14.730701 13242 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:14.783136 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.794622 10187 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:14.785323 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:14.735010 13239 consensus_queue.cc:1175] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 6 status { last_received { term: 6 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 6 index: 3 } }
W20260709 13:17:14.787534 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.790351 10713 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.813830 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:14.769405 13289 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:14.796056 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.803961 13312 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.829147 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.796619 13274 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.810690 10189 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:14.814983 10031 raft_consensus.cc:2410] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:14.786478 13151 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.818064 13172 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:14.818642 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1614) took 1544 ms (client timeout 1864 ms). Trace:
W20260709 13:17:14.835978 10032 rpcz_store.cc:269] 0709 13:17:13.268577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.274196 (+  5619us) service_pool.cc:224] Handling call
0709 13:17:14.813061 (+1538865us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003bd3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:14.813181 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262228352}
I20260709 13:17:14.837222 10032 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.837366 13242 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.792312 13149 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:14.820426 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.822068 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.822651 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.822841 13298 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:14.823660 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.828365 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.848613 10187 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.796028 13161 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.830341 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.820106 13241 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.852092 10038 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:14.835839 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.852736 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.852977 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.853611 10188 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:14.853626 10112 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:14.839603 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.845793 10031 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.845109 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.846935 10036 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:14.851049 10679 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.852228 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.859651 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.858667 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.862529 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.863008 10186 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:14.864121 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.864776 10032 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.867138 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.850612 13298 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.846016 13053 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:14.856055 13278 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.875128 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.858942 13273 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.876350 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.877610 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.885800 10188 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:14.886652 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.887221 10188 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.887691 13251 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:14.877636 13278 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:14.877983 13293 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:14.878436 13247 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:17:14.879225 13325 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:14.879591 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.904450 10183 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.879830 13270 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:14.880319 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1618) took 1538 ms. Trace:
W20260709 13:17:14.880465 13324 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:14.867184 12995 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.882342 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.883044 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.895574 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:14.895814 10187 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:14.899399 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:14.870111 10189 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.891700 13278 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.905385 10035 rpcz_store.cc:276] 0709 13:17:13.341817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.348246 (+  6429us) service_pool.cc:224] Handling call
0709 13:17:14.880155 (+1531909us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54003bd8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:14.880259 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80835840}
I20260709 13:17:14.906705 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:14.910120 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.910444 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:14.911581 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.912281 10112 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:14.909797 10036 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.912734 10113 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:14.913158 10187 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:14.913628 10711 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:14.914709 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.919275 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:14.920715 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.922063 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.923175 10183 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:14.924127 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.924012 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.924899 10183 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:14.942198 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.942749 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.943463 10187 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.947489 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.948221 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.948282 10112 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:14.902159 13273 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:14.883581 13255 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.953922 10040 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:14.973289 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 130148us
I20260709 13:17:14.922780 13251 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.955906 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:14.962442 10188 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:14.954632 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.944993 13232 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.990597 10187 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:14.944765 12952 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:14.944562 13241 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.966708 13229 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.014290 13312 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.014606 10111 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:15.015417 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.016103 10186 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:15.016204 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.017060 10109 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:14.991595 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.992075 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.018198 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.018267 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.018929 10187 raft_consensus.cc:2376] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6. Re-sending same reply.
I20260709 13:17:15.019783 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.020313 10187 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.020612 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.021238 10185 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:15.022073 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.022702 10185 raft_consensus.cc:2368] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:14.989529 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.024578 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:15.025933 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.026734 10181 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:15.028558 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:15.029282 10707 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:17:15.029645 10707 pending_rounds.cc:85] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 7
I20260709 13:17:15.029865 10707 pending_rounds.cc:107] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:15.030100 10707 raft_consensus.cc:2889] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.031668 13241 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.032408 13241 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.032783 13241 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:15.033154 13241 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.992383 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:14.945485 12995 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:15.036828 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:14.952669 13256 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:14.995230 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.956373 13261 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:14.985374 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:14.994606 12952 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.009855 13260 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.016966 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:14.955799 13006 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.042337 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:15.044812 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53297.2us
W20260709 13:17:15.055222 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.056123 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:14.905772 13149 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:14.952461 12919 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:17:14.994915 13277 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:15.027585 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.023438 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:14.974606 12989 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:14.990741 13251 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:14.994737 13205 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.060624 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.044238 13232 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:15.019469 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.046026 10187 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:15.072029 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.073021 10188 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:17:15.081482 10188 pending_rounds.cc:85] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:17:15.053658 13254 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.052605 13185 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.079908 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:15.057646 13327 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:17:15.053692 12952 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.081662 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:15.081745 10188 pending_rounds.cc:107] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:17:15.107410 10188 raft_consensus.cc:2889] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.063709 10189 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:15.085227 13296 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:15.068027 13252 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.087677 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.112468 10185 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.076084 13205 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:15.090380 13306 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.727s	user 0.003s	sys 0.000s
I20260709 13:17:15.053433 12995 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.064519 13179 raft_consensus.cc:2764] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:15.095810 10109 raft_consensus.cc:2410] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:15.087808 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.065075 13168 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:15.093169 13112 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:17:15.100339 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.101542 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.078687 13251 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.126636 10108 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:15.058092 13163 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:15.052866 13312 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:17:15.115835 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.093643 13004 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.116959 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.092315 13316 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.093945 12919 consensus_queue.cc:1243] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:15.024900  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:15.124985 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.134407 10187 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:15.117347 13205 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.134532 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.112943 13296 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.117425 12720 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.138587 10189 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:15.133661 13004 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:15.153127 13004 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.159657 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.159969 12919 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:15.160598 12919 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.165009 12919 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:15.165966 13232 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.124806 13168 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:15.169904 13168 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.177768 13289 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.178949 13289 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.184237 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.185571 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.186292 13151 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.187002 13151 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:15.141356 13006 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.144552 10185 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
W20260709 13:17:15.151400 13328 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:15.151067 13316 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.216908 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.209800 10040 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:15.217967 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:15.211023 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 95353.9us
I20260709 13:17:15.197748 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:15.151909 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.222128 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:15.223513 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.095491 13273 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:15.222136 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50447us
I20260709 13:17:15.225944 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.226441 10188 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:15.233529 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.236591 10185 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:15.237223 10039 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:15.110146 13185 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.119379 13252 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.247654 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.248473 10115 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:15.249199 13030 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:15.249472 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.250739 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.251832 13255 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:15.251993 13112 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:15.252445 13112 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:15.253399 13112 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.256716 13241 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.252166 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.258870 13241 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.259619 10115 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:15.261895 13251 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.165009 12720 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:15.266271 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.266615 12720 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.267171 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.268363 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.269065 10187 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 6: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:15.269452 13252 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:15.269815 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.270136 10183 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.273342 10181 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:15.226022 13270 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.245571 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:15.278194 10038 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:15.279386 10189 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:17:15.280834 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.281669 10187 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
W20260709 13:17:15.281929 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.283058 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.283722 10187 raft_consensus.cc:2368] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11.
I20260709 13:17:15.286612 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.216243 13179 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.290468 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.291275 10187 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:15.291491 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.292132 10189 raft_consensus.cc:2376] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9. Re-sending same reply.
I20260709 13:17:15.242239 13243 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.296116 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.297019 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:15.299270 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 53816.8us
I20260709 13:17:15.265900 13168 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.310701 10187 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:15.301952 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:15.312294 10187 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:15.314141 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.315044 10189 raft_consensus.cc:2410] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:15.342597 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:15.343626 10106 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:15.291086 13179 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:15.361797 10037 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:15.429792 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 66058.4us
W20260709 13:17:15.303292 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81245.3us
I20260709 13:17:15.308213 10114 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:15.301126 13293 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.434317 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.438565 10184 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.309283 13292 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.441080 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:15.451785 10078 leader_election.cc:400] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8.
I20260709 13:17:15.453322 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:15.308812 13270 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.459097 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.320808 13243 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:15.469827 13004 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.472920 12961 raft_consensus.cc:3055] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:15.473364 12961 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:15.474177 12961 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.475323 12961 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.432948 13179 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:15.478387 10036 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:17:15.478826 10036 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:15.479215 10184 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:15.313580 13053 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:17:15.430214 13252 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:15.485561 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:15.486130 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:15.489739 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48749us
I20260709 13:17:15.526337 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.438868 13161 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:17:15.433430 13309 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:15.516759 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.527545 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.534197 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:15.535064 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:15.525017 10189 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:15.536360 10184 raft_consensus.cc:2376] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9. Re-sending same reply.
I20260709 13:17:15.537521 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.538209 10184 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
W20260709 13:17:15.543485 13298 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.005s
I20260709 13:17:15.543983 13298 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.546083 13298 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:15.546626 12919 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:15.547572 12919 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.547928 12919 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:15.548799 12919 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.549975 12919 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.491329 13172 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.457973 12891 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:17:15.553891 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:15.511294 13270 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:15.510426 12810 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.604683 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:15.518373 13265 consensus_meta.cc:287] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.000s
I20260709 13:17:15.458226 13293 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:15.613145 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59336.8us
I20260709 13:17:15.598866 13006 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.615480 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.552115 13312 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.609380 10184 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:17:15.551982 13255 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.621594 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1294) took 1025 ms. Trace:
I20260709 13:17:15.564495 13245 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.623401 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:15.624691 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.625010 10107 raft_consensus.cc:1217] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 13:17:15.625566 10107 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:15.598775 13241 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:15.631336 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.599110 13298 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:15.614583 13006 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.637797 10109 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:15.601459 13053 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.612365 13254 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:15.620067 13240 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:15.618503 13270 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:15.621033 13312 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:15.619851 13004 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.624357 13255 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:15.653452 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 200218us
W20260709 13:17:15.644215 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 205761us
I20260709 13:17:15.637147 13257 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.642966 13245 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:15.645378 13053 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:15.621995 10184 rpcz_store.cc:276] 0709 13:17:14.596392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.608553 (+1012161us) service_pool.cc:224] Handling call
0709 13:17:15.609066 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.621298 (+ 12232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.621530 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:15.615269 13265 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:15.665527 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 381774us
W20260709 13:17:15.664238 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.552340 13252 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.674398 10707 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:15.673796 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:15.681751 10184 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:15.690626 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:15.656454 13240 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:15.709604 13278 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.661680 13312 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.663683 13255 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.715902 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.672681 13004 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:15.717458 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:15.723768 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.018s
I20260709 13:17:15.662195 13185 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.723138 10036 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:15.718969 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.724119 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.011s	sys 0.018s
I20260709 13:17:15.723948 10035 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:15.725358 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 505414us
I20260709 13:17:15.726015 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:15.727784 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.728474 10184 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:15.729354 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:15.729892 10184 raft_consensus.cc:2376] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9. Re-sending same reply.
I20260709 13:17:15.732062 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:15.649829 13254 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.723193 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.759586 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.761495 10035 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:17:15.761826 10039 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:15.762930 10035 pending_rounds.cc:85] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 8
I20260709 13:17:15.763264 10035 pending_rounds.cc:107] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:15.763504 10035 raft_consensus.cc:2889] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.765574 10038 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:15.765897 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.708812 13257 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:15.765507 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.768646 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.766732 10034 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:15.770905 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44971.1us
I20260709 13:17:15.772444 10032 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:17:15.767198 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:15.773922 10031 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:15.640933 13243 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.780966 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:15.781821 10039 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:15.775570 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.782542 10036 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:15.777758 10184 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.683727 13161 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:17:15.708308 12810 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:17:15.736074 13168 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.720990 12891 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:17:15.790696 13247 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:15.778165 13163 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.789319 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1297) took 1189 ms. Trace:
I20260709 13:17:15.799439 10034 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:15.805300 10184 rpcz_store.cc:276] 0709 13:17:14.597301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.757177 (+1159876us) service_pool.cc:224] Handling call
0709 13:17:15.777453 (+ 20276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.786646 (+  9193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.787036 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:15.816751 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.818655 13112 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.820777 13168 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.821354 13168 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.822048 13316 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.824059 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:15.824826 13309 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.825279 13309 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:15.826227 13309 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:15.829411 13252 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:15.837368 13149 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.838001 13149 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.787698 13346 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:15.840212 13149 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:15.840716 13346 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:15.734473 13270 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.843159 10184 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.844720 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1298) took 1247 ms. Trace:
I20260709 13:17:15.845086 10184 rpcz_store.cc:276] 0709 13:17:14.597610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.842654 (+1245044us) service_pool.cc:224] Handling call
0709 13:17:15.842985 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.843636 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.844653 (+  1017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:15.735275 13278 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.796154 13247 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.823474 13168 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.875218 10039 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:15.801800 13239 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.827608 13309 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.835564 13254 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:15.812047 13241 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:15.912907 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.788516 13053 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:15.884135 13335 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:17:15.880065 13247 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.918854 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:15.936115 13278 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.936746 13265 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.938908 13179 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:15.941021 13296 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.000s
I20260709 13:17:15.942097 13179 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.941433 13296 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:15.942165 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.962980 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:15.841864 13240 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:15.931694 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 208262us
W20260709 13:17:15.948279 13339 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:17:15.792333 13245 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:15.949172 13338 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:17:15.949708 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 760125us
I20260709 13:17:15.915683 13006 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:15.954205 13251 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:15.956362 13344 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:17:15.956857 13053 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.960927 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:15.968572 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:15.977602 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.953625 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1293) took 1357 ms. Trace:
I20260709 13:17:15.984423 13312 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.040064 10187 rpcz_store.cc:276] 0709 13:17:14.596130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.313588 (+717458us) service_pool.cc:224] Handling call
0709 13:17:15.313871 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.340013 (+ 26142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.340048 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.439452 (+ 99404us) log.cc:844] Serialized 26 byte log entry
0709 13:17:15.739548 (+300096us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:15.739591 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.739667 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.953402 (+213735us) raft_consensus.cc:1685] finished
0709 13:17:15.953424 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.953565 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":92255,"thread_start_us":247037,"threads_started":1,"wal-append.queue_time_us":483765}
I20260709 13:17:16.042402 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1613) took 1255 ms. Trace:
I20260709 13:17:16.042732 10187 rpcz_store.cc:276] 0709 13:17:14.787258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.041572 (+1254314us) service_pool.cc:224] Handling call
0709 13:17:16.041894 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.042085 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.042113 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.042155 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:16.042185 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.042235 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.042345 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:15.988549 13179 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.045753 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 77264.2us
I20260709 13:17:15.976224 13293 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.056792 13293 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:16.057197 13293 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:15.989630 10037 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:15.990299 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.992064 13296 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.059646 13296 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:15.992547 10112 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:15.994024 10034 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:15.994403 13255 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:15.998097 13241 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:16.002550 13205 consensus_meta.cc:287] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.000s
I20260709 13:17:16.005507 10709 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:16.006570 13265 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.139390 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:16.006886 12952 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.887s	user 0.008s	sys 0.000s
I20260709 13:17:16.008320 10032 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:16.007418 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:15.991545 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:16.036772 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53525.4us
I20260709 13:17:16.050279 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2645) took 1124 ms. Trace:
I20260709 13:17:16.047293 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:15.908607 13257 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.051165 13179 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.066711 12919 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.124950 13006 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:16.046602 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:16.036362 13256 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:16.048518 13251 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:16.141846 10033 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:16.214218 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1310) took 1311 ms. Trace:
I20260709 13:17:16.216332 10184 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:16.150656 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 103449us
I20260709 13:17:16.142788 10111 rpcz_store.cc:276] 0709 13:17:14.926241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.257654 (+331413us) service_pool.cc:224] Handling call
0709 13:17:15.257958 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.298405 (+ 40447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.298449 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.298938 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:17:15.556551 (+257613us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:15.556595 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.556673 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.050050 (+493377us) raft_consensus.cc:1685] finished
0709 13:17:16.050072 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.050208 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40589,"raft.queue_time_us":40201,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":7876,"thread_start_us":215745,"threads_started":1,"wal-append.queue_time_us":342806}
I20260709 13:17:16.153039 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:16.153762 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.989038 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 365709us
I20260709 13:17:16.254658 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:16.154100 13353 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:16.256428 13353 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.209906 13256 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:16.170289 13004 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:16.171058 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 439075us
I20260709 13:17:16.142537 13205 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.214644 10181 rpcz_store.cc:276] 0709 13:17:14.902667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.027333 (+124666us) service_pool.cc:224] Handling call
0709 13:17:16.213911 (+1186578us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540019b9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:16.214143 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476585344}
I20260709 13:17:16.045238 10187 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:16.277269 13354 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:16.278554 13312 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:16.220880 13278 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.251385 13251 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.221832 13356 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.292939 13352 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.297248 13255 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.144670 12952 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.299506 12995 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:16.300513 12961 consensus_meta.cc:287] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.825s	user 0.014s	sys 0.000s
I20260709 13:17:16.328222 13296 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.305724 13239 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.312651 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1615) took 1522 ms. Trace:
W20260709 13:17:16.330961 10006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.037s	sys 0.029s
I20260709 13:17:16.331346 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1620) took 1539 ms. Trace:
I20260709 13:17:16.395527 10187 rpcz_store.cc:276] 0709 13:17:14.790411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.044616 (+1254205us) service_pool.cc:224] Handling call
0709 13:17:16.044898 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.312329 (+267431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.312583 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:16.396781 10006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.037s	sys 0.029s
I20260709 13:17:16.397219 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:16.397930 10187 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:16.337049 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 94282.7us
I20260709 13:17:16.190248 13168 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:17:16.190995 12919 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.298691 13316 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.369151 10715 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:16.373232 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1623) took 1362 ms. Trace:
I20260709 13:17:16.430022 10186 rpcz_store.cc:276] 0709 13:17:15.011214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.016738 (+  5524us) service_pool.cc:224] Handling call
0709 13:17:16.372992 (+1356254us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54002dc3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:16.373158 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375709568}
I20260709 13:17:16.431354 10186 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:16.431893 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 597) took 1623 ms. Trace:
I20260709 13:17:16.144944 13265 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.239483 13006 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.331949 13163 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.347877 12720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.013s	sys 0.021s
I20260709 13:17:16.352869 13278 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.382293 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:16.382603 13004 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.383997 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:16.462543 10716 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:16.384697 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:16.388955 13205 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.378351 12891 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:16.390236 13247 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.391764 12995 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.213975 13293 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:16.328012 13232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.027s	sys 0.046s
W20260709 13:17:16.394044 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.438701 13351 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.333837 13309 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.395730 10181 rpcz_store.cc:276] 0709 13:17:14.791823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.330440 (+1538617us) service_pool.cc:224] Handling call
0709 13:17:16.330790 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.331011 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.331038 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.331078 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:16.331118 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.331167 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.331285 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:16.259927 13289 consensus_meta.cc:287] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.081s	user 0.011s	sys 0.000s
I20260709 13:17:16.335937 13356 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:16.369357 13352 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.432185 10186 rpcz_store.cc:276] 0709 13:17:14.808699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.430879 (+1622180us) service_pool.cc:224] Handling call
0709 13:17:16.431186 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.431664 (+   478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.431843 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.489544 10186 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:16.490177 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 601) took 1680 ms. Trace:
I20260709 13:17:16.490476 10186 rpcz_store.cc:276] 0709 13:17:14.809648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.489058 (+1679410us) service_pool.cc:224] Handling call
0709 13:17:16.489364 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.489944 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.490124 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.462317 13172 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.437547 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:16.405802 13161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.024s	sys 0.046s
I20260709 13:17:16.436739 13255 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.451836 12720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.013s	sys 0.022s
I20260709 13:17:16.374987 13256 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.481105 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1612) took 1697 ms. Trace:
I20260709 13:17:16.481105 10181 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.483286 13205 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.427999 10709 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:16.514442 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 600) took 1705 ms. Trace:
I20260709 13:17:16.517552 10181 rpcz_store.cc:276] 0709 13:17:14.809418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.480634 (+1671216us) service_pool.cc:224] Handling call
0709 13:17:16.480943 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.514167 (+ 33224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.514378 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.461737 13163 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.493384 13279 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.496402 10707 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:16.495769 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:16.517354 13289 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:16.544668 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 534) took 1457 ms. Trace:
W20260709 13:17:16.478281 13300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.005s	sys 0.022s
W20260709 13:17:16.552600 13300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.006s	sys 0.022s
W20260709 13:17:16.484076 13242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.028s
W20260709 13:17:16.553287 13242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.028s
I20260709 13:17:16.555542 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1296) took 1958 ms. Trace:
I20260709 13:17:16.555982 10189 rpcz_store.cc:276] 0709 13:17:14.596974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.627188 (+1030214us) service_pool.cc:224] Handling call
0709 13:17:15.643919 (+ 16731us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:15.651463 (+  7544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.651495 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:15.662010 (+ 10515us) log.cc:844] Serialized 52 byte log entry
0709 13:17:16.156077 (+494067us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:16.156119 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.156183 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.555304 (+399121us) raft_consensus.cc:1685] finished
0709 13:17:16.555324 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.555481 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21400,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":35162,"thread_start_us":434256,"threads_started":1,"wal-append.queue_time_us":780291}
I20260709 13:17:16.558176 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 603) took 1685 ms. Trace:
I20260709 13:17:16.558508 10189 rpcz_store.cc:276] 0709 13:17:14.873250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.557325 (+1684075us) service_pool.cc:224] Handling call
0709 13:17:16.557729 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.557890 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.557913 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.557950 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.557985 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.558034 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.558127 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.476742 13358 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.436398 13316 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:16.482987 13232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.032s	sys 0.047s
I20260709 13:17:16.450335 13239 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.513548 10184 rpcz_store.cc:276] 0709 13:17:14.783760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.845866 (+1062106us) service_pool.cc:224] Handling call
0709 13:17:16.216136 (+370270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.216748 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.480919 (+264171us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540019b9d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:16.481045 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850769664}
I20260709 13:17:16.576236 10184 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:16.518863 10181 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:16.536295 13179 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.575591 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1417) took 1368 ms. Trace:
I20260709 13:17:16.488817 13356 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.510494 13172 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:16.536753 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 99298.6us
I20260709 13:17:16.503382 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1286) took 1976 ms. Trace:
I20260709 13:17:16.545207 10112 rpcz_store.cc:276] 0709 13:17:15.087757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.454604 (+366847us) service_pool.cc:224] Handling call
0709 13:17:15.454919 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.063799 (+608880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.544406 (+480607us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400189f54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:16.544601 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236024704}
W20260709 13:17:16.546247 10079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.007s
W20260709 13:17:16.546598 10081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.016s
I20260709 13:17:16.560199 10711 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:16.513948 13362 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:16.534159 13256 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.536183 13293 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:16.513707 12818 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:17:16.546483 13250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.003s	sys 0.014s
W20260709 13:17:16.647310 10081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.024s
I20260709 13:17:16.430361 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 596) took 1622 ms. Trace:
I20260709 13:17:16.520234 13360 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:16.647797 10187 rpcz_store.cc:276] 0709 13:17:14.808323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.429511 (+1621188us) service_pool.cc:224] Handling call
0709 13:17:16.429848 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.430037 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.430063 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.430116 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:16.430151 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.430200 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.430302 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:16.508605 13161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.024s	sys 0.047s
I20260709 13:17:16.491636 10186 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:16.546193 13243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.016s
I20260709 13:17:16.536450 13279 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:16.536391 13292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.014s	sys 0.032s
I20260709 13:17:16.535414 13365 raft_consensus.cc:2764] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:16.493453 13351 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:16.515178 13255 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.577610 10109 rpcz_store.cc:276] 0709 13:17:15.207594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.487157 (+279563us) service_pool.cc:224] Handling call
0709 13:17:15.491155 (+  3998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.638414 (+147259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.575352 (+936938us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002b8254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:16.575531 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336376064}
I20260709 13:17:16.584529 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1311) took 1675 ms. Trace:
I20260709 13:17:16.662554 10184 rpcz_store.cc:276] 0709 13:17:14.903030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.575712 (+1672682us) service_pool.cc:224] Handling call
0709 13:17:16.576042 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.577844 (+  1802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.578107 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:16.647578 13250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.003s	sys 0.014s
I20260709 13:17:16.663568 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:16.665611 10184 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.666774 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1619) took 1875 ms. Trace:
I20260709 13:17:16.641399 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:16.594722 10114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1390) took 1770 ms (client timeout 1841 ms). Trace:
W20260709 13:17:16.563311 12810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.009s	sys 0.036s
I20260709 13:17:16.584228 13239 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:16.561545 13289 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:16.640877 10183 rpcz_store.cc:276] 0709 13:17:14.526896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.053758 (+526862us) service_pool.cc:224] Handling call
0709 13:17:15.076306 (+ 22548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.270544 (+194238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.494912 (+1224368us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400100254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:16.503302 (+  8390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445337856}
W20260709 13:17:16.640673 10079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.007s
I20260709 13:17:16.577044 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1308) took 1726 ms. Trace:
W20260709 13:17:16.577572 13273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.013s	sys 0.032s
W20260709 13:17:16.577713 13298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.018s	sys 0.001s
W20260709 13:17:16.675423 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.030s
I20260709 13:17:16.536067 13205 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.677917 10184 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:16.679697 13205 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.654006 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1304) took 1825 ms. Trace:
I20260709 13:17:16.680305 10186 rpcz_store.cc:276] 0709 13:17:14.828158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.491196 (+1663038us) service_pool.cc:224] Handling call
0709 13:17:16.491476 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.653714 (+162238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.653942 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.681878 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1337) took 1364 ms. Trace:
W20260709 13:17:16.655663 13243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.001s	sys 0.016s
I20260709 13:17:16.683207 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:16.684098 13360 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:16.684677 13360 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:16.685676 13351 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:16.682191 10186 rpcz_store.cc:276] 0709 13:17:15.317723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.681144 (+1363421us) service_pool.cc:224] Handling call
0709 13:17:16.681410 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.681594 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.681617 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.681655 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.681688 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.681736 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.681827 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:16.667316 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 367486us
W20260709 13:17:16.669358 12810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.009s	sys 0.050s
W20260709 13:17:16.580816 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 589377us
I20260709 13:17:16.643930 10106 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:16.669695 10180 raft_consensus.cc:2376] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8. Re-sending same reply.
W20260709 13:17:16.668663 10114 rpcz_store.cc:269] 0709 13:17:14.823853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.859439 (+ 35586us) service_pool.cc:224] Handling call
0709 13:17:16.594509 (+1735070us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400404054. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:16.594653 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953226112}
W20260709 13:17:16.673660 13273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.017s	sys 0.040s
W20260709 13:17:16.676177 13298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.018s	sys 0.001s
I20260709 13:17:16.672308 10185 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:17:16.656983 13251 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.657173 12952 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:16.673182 10181 rpcz_store.cc:276] 0709 13:17:14.851183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.518380 (+1667197us) service_pool.cc:224] Handling call
0709 13:17:16.518688 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.576776 (+ 58088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.576988 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:16.660159 13292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.014s	sys 0.032s
W20260709 13:17:16.674443 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.685578 13360 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:16.670588 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:16.650170 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 689292us
W20260709 13:17:16.670161 10154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.005s
I20260709 13:17:16.690412 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:16.692114 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1338) took 1374 ms. Trace:
I20260709 13:17:16.644953 13362 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:16.693627 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.030s
I20260709 13:17:16.673548 13161 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:16.740139 10110 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:16.672926 12919 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:16.673702 13289 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:16.701691 10181 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:16.743328 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1342) took 1424 ms. Trace:
I20260709 13:17:16.743726 10181 rpcz_store.cc:276] 0709 13:17:15.319163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.696252 (+1377089us) service_pool.cc:224] Handling call
0709 13:17:16.701339 (+  5087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.743057 (+ 41718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.743265 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.745393 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 606) took 1078 ms. Trace:
I20260709 13:17:16.745702 10181 rpcz_store.cc:276] 0709 13:17:15.667062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.744599 (+1077537us) service_pool.cc:224] Handling call
0709 13:17:16.744911 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.745086 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.745111 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.745151 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:16.745184 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.745235 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.745339 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.574826 13358 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:16.737238 10154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.006s	sys 0.009s
I20260709 13:17:16.734529 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:16.738729 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48437.2us
I20260709 13:17:16.737669 10186 rpcz_store.cc:276] 0709 13:17:15.318033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.687233 (+1369200us) service_pool.cc:224] Handling call
0709 13:17:16.687524 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.691766 (+  4242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.691795 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.691840 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:16.691878 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.691943 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.692056 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.667124 10188 rpcz_store.cc:276] 0709 13:17:14.791533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.231624 (+1440091us) service_pool.cc:224] Handling call
0709 13:17:16.293832 (+ 62208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.666445 (+372613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.666475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.666515 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:16.666551 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.666609 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.666722 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":366589,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3785,"thread_start_us":372191,"threads_started":1}
W20260709 13:17:16.742197 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.675658 13240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.001s	sys 0.013s
I20260709 13:17:16.697070 13278 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:16.988447 10033 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.788863 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:17.056497 10031 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:17.787345 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:17.026464 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 224337us
I20260709 13:17:17.788115 10040 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:16.788348 10110 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:17.671025 10039 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:17.789753 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 539) took 1043 ms. Trace:
W20260709 13:17:17.110716 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 184902us
I20260709 13:17:16.787921 10184 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:17.667019 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:17.490835 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:16.699995 13298 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:16.704790 13247 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:17.805584 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:16.791162 13347 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.818s	user 0.017s	sys 0.022s
W20260709 13:17:17.790870 10189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.006s	sys 0.015s
W20260709 13:17:17.860584 10189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.008s	sys 0.016s
I20260709 13:17:17.720644 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:17.460141 13369 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.533s	user 0.000s	sys 0.001s
I20260709 13:17:17.225349 10709 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:17.018147 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:17.006616 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.883982 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.515969 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 611) took 1165 ms. Trace:
I20260709 13:17:16.793368 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1414) took 1586 ms. Trace:
I20260709 13:17:17.641809 12720 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:17.591298 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 521) took 1629 ms. Trace:
W20260709 13:17:17.668085 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 997542us
I20260709 13:17:17.887405 10078 leader_election.cc:400] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11.
I20260709 13:17:16.937387 10183 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:17.640857 13006 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:16.749163 10181 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:17.893407 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 609) took 1524 ms. Trace:
I20260709 13:17:17.893740 10181 rpcz_store.cc:276] 0709 13:17:16.369131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.748434 (+379303us) service_pool.cc:224] Handling call
0709 13:17:16.748709 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.893119 (+1144410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.893346 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.889161 10707 rpcz_store.cc:276] 0709 13:17:15.962287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.974631 (+ 12344us) service_pool.cc:224] Handling call
0709 13:17:15.984266 (+  9635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.543465 (+559199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.590950 (+1047485us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54005fa5d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:17.591213 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177214848}
W20260709 13:17:17.287050 10187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.009s	sys 0.014s
W20260709 13:17:17.895284 10187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.009s	sys 0.030s
I20260709 13:17:17.744699 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:17.677759 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.378445 12995 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:16.888294 10180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1324) took 1803 ms (client timeout 1829 ms). Trace:
I20260709 13:17:16.703931 13292 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:17.841675 13252 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.788561 12818 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:17.047772 13257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.017s	sys 0.020s
I20260709 13:17:17.841799 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 763) took 1082 ms. Trace:
I20260709 13:17:16.923957 12952 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:16.964547 13163 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:16.924773 13151 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.796445 13368 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:17:17.912703 13257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.040s	sys 0.066s
I20260709 13:17:16.792176 13244 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:17.844650 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.673210 13255 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:16.740144 13251 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.851636 10186 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:17.920133 13151 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:17.807827 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 140905us
I20260709 13:17:17.123324 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.790220 10110 rpcz_store.cc:276] 0709 13:17:16.746490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.748304 (+  1814us) service_pool.cc:224] Handling call
0709 13:17:16.788038 (+ 39734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.789509 (+1001471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.789690 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.857100 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:17.928462 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 615) took 1127 ms. Trace:
W20260709 13:17:17.454547 13374 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.711s	user 0.001s	sys 0.000s
W20260709 13:17:17.466892 13370 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
W20260709 13:17:17.453959 13381 log.cc:927] Time spent T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 13:17:17.473750 13372 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.299s	user 0.000s	sys 0.000s
W20260709 13:17:16.849362 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48732us
I20260709 13:17:17.942127 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.677474  9938 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:17.942806 10712 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:17.833160 13254 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:17.863941 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 604) took 2969 ms. Trace:
I20260709 13:17:17.865271 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1336) took 2547 ms. Trace:
I20260709 13:17:17.847715 13382 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:17.871989 13298 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:17.874773 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1295) took 3278 ms. Trace:
I20260709 13:17:17.943887 10189 rpcz_store.cc:276] 0709 13:17:14.894473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.559367 (+1664894us) service_pool.cc:224] Handling call
0709 13:17:16.559647 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.562381 (+  2734us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:17.026868 (+464487us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.863348 (+836480us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.863554 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.863616 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:17.863667 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.863731 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.863877 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10265,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":171,"thread_start_us":1283247,"threads_started":2,"wal-append.queue_time_us":899195}
I20260709 13:17:17.944782 10182 rpcz_store.cc:276] 0709 13:17:14.596690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.612677 (+1015987us) service_pool.cc:224] Handling call
0709 13:17:15.633879 (+ 21202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.070914 (+437035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.070944 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.139913 (+ 68969us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.576109 (+436196us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.576144 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.576207 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.874539 (+1298332us) raft_consensus.cc:1685] finished
0709 13:17:17.874559 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.874704 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16704,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7857,"thread_start_us":791335,"threads_started":2,"wal-append.queue_time_us":1702404}
I20260709 13:17:17.946563 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:17.947052 10182 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.947094 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 605) took 3031 ms. Trace:
I20260709 13:17:17.865934 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:17.947479 10187 rpcz_store.cc:276] 0709 13:17:14.915908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.657605 (+1741697us) service_pool.cc:224] Handling call
0709 13:17:16.657964 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.658294 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.658319 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.658812 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.896369 (+1237557us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.896413 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.896486 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.946884 (+ 50398us) raft_consensus.cc:1685] finished
0709 13:17:17.946904 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.947040 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14424,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":12774,"thread_start_us":1237245,"threads_started":1,"wal-append.queue_time_us":1227552}
I20260709 13:17:17.949106 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:17.950186 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:17.951192 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:17.951988 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 536) took 1248 ms. Trace:
I20260709 13:17:17.952373 10109 rpcz_store.cc:276] 0709 13:17:16.703953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.704081 (+   128us) service_pool.cc:224] Handling call
0709 13:17:16.732046 (+ 27965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.732436 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.732464 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.732972 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.111086 (+378114us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.111132 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.111210 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.951770 (+840560us) raft_consensus.cc:1685] finished
0709 13:17:17.951791 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.951920 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3540,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":377720,"threads_started":1,"wal-append.queue_time_us":1212352}
I20260709 13:17:17.953773 10184 rpcz_store.cc:276] 0709 13:17:15.317415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.678621 (+1361206us) service_pool.cc:224] Handling call
0709 13:17:16.678919 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.791589 (+1112670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.865012 (+ 73423us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540033cf54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:17.865203 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249835776}
I20260709 13:17:17.954859 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:17.926348 13244 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:17.879423 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:16.740325 13161 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:17.347282 13274 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:17.966849 13274 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:17.967820 13274 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:17.969414 13274 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.448792 13359 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:17.665779 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:17.450609 13149 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:17.972208 13149 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:17.884920 10106 rpcz_store.cc:276] 0709 13:17:15.206837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.485832 (+278995us) service_pool.cc:224] Handling call
0709 13:17:16.594907 (+1109075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.689656 (+ 94749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.793142 (+103486us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400404050. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:16.793301 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488704384}
I20260709 13:17:17.386396 13371 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.973232 13371 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:17.975596 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 764) took 1225 ms. Trace:
I20260709 13:17:17.915625 12952 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:17.447851 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.886444 10711 rpcz_store.cc:276] 0709 13:17:16.350982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.351112 (+   130us) service_pool.cc:224] Handling call
0709 13:17:16.351411 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.640738 (+289327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.515615 (+874877us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54004d0154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:17.515886 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450179456}
I20260709 13:17:17.888618 13256 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.890565 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.890715 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:17.690955 13279 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:17.805395 13355 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.915819 12818 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:17.981354 10709 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:17.818382 13265 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:17.791005 13352 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:17.896984 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.887863 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1313) took 1984 ms. Trace:
I20260709 13:17:16.964623 13376 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.897450 10038 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:17.894775 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:17.175725 12919 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:17.900157 13270 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:18.012364 13270 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.015165 13270 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:17.908005 10713 rpcz_store.cc:276] 0709 13:17:16.750227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.750338 (+   111us) service_pool.cc:224] Handling call
0709 13:17:17.832687 (+1082349us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:17.908294 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 213945us
I20260709 13:17:18.028337 13239 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:17.899937 13030 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.891235 13168 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.029513 13030 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.029814 13168 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:17.886081 13241 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.921492  9934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 291) took 22090 ms (client timeout 15000 ms). Trace:
I20260709 13:17:18.006450 13256 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:17.920279 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:17.979031 13292 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.001205 13388 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.982757 10182 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:17.667117 10112 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:17.929852 10114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.052s	sys 0.120s
I20260709 13:17:17.930787 10186 rpcz_store.cc:276] 0709 13:17:16.801006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.805174 (+1004168us) service_pool.cc:224] Handling call
0709 13:17:17.928395 (+123221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.932621 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:17.933038 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.900662 13380 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.053264 10114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.052s	sys 0.120s
I20260709 13:17:18.053292 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 537) took 1344 ms. Trace:
I20260709 13:17:17.925241 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:18.063973 10112 rpcz_store.cc:276] 0709 13:17:16.709382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.734245 (+ 24863us) service_pool.cc:224] Handling call
0709 13:17:18.053227 (+1318982us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:18.064728 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 139573us
W20260709 13:17:17.927825 13004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.018s
I20260709 13:17:17.957149 10031 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
W20260709 13:17:17.791687 13240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.825s	user 0.015s	sys 0.036s
I20260709 13:17:17.956075 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:17.961256 10712 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:17.944391 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:17.953109 13316 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:17.964234 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:17.958624  9938 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.964221 13254 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:17.965624 13151 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:17.964180 13161 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:17.966317 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 616) took 1165 ms. Trace:
I20260709 13:17:17.972443 13389 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:17:17.888412 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1316) took 2885 ms. Trace:
W20260709 13:17:17.940963 13293 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.293s	user 0.000s	sys 0.011s
I20260709 13:17:17.975986 10716 rpcz_store.cc:276] 0709 13:17:16.750618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.750727 (+   109us) service_pool.cc:224] Handling call
0709 13:17:17.975535 (+1224808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.006345 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1667) took 2027 ms. Trace:
I20260709 13:17:17.971971 13359 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:18.007898 10185 rpcz_store.cc:276] 0709 13:17:14.903653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.593756 (+1690103us) service_pool.cc:224] Handling call
0709 13:17:16.649363 (+ 55607us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:16.695817 (+ 46454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.887481 (+191664us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54002ac6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:16.887781 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52201856}
I20260709 13:17:17.937759 13255 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:17:18.012710 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.020236 13172 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.019863 13355 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.021325 10709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:18.024605 13362 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.025247 13353 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:17.902112 10180 rpcz_store.cc:269] 0709 13:17:15.085061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.161185 (+ 76124us) service_pool.cc:224] Handling call
0709 13:17:16.495609 (+1334424us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3e9c 00007f3c6c3c3a5b 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:16.888122 (+392513us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400002dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:16.888234 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324410752}
I20260709 13:17:17.889053 12720 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:17.938097 10034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.016s	sys 0.049s
I20260709 13:17:17.912228 13006 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:18.065878 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:18.164229 10184 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:18.165318 10188 rpcz_store.cc:276] 0709 13:17:16.801292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.789191 (+987899us) service_pool.cc:224] Handling call
0709 13:17:17.966244 (+177053us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:18.169824 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 108705us
I20260709 13:17:18.278856 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:18.163368  9938 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 4, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 4 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.032167  9934 rpcz_store.cc:269] 0709 13:16:55.844860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.847982 (+  3122us) service_pool.cc:224] Handling call
0709 13:17:17.921404 (+22073422us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:12.901351 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:12.902017 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:12.902072 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:17:12.902086 (+    14us) tablet.cc:662] Decoding operations
0709 13:17:13.123942 (+221856us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:13.124032 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:13.124063 (+    31us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:17:13.125404 (+  1341us) tablet.cc:701] Row locks acquired
0709 13:17:13.125453 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:13.125616 (+   163us) write_op.cc:270] Start()
0709 13:17:13.125760 (+   144us) write_op.cc:276] Timestamp: P: 1783603033125549 usec, L: 0
0709 13:17:13.125781 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:17:13.126498 (+   717us) log.cc:844] Serialized 7108 byte log entry
0709 13:17:13.452119 (+325621us) op_driver.cc:464] REPLICATION: finished
0709 13:17:13.801097 (+348978us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6c3de0ac 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c72f1eef0
0709 13:17:13.884184 (+ 83087us) write_op.cc:301] APPLY: starting
0709 13:17:13.884302 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:13.884729 (+   427us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:13.884768 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:13.965600 (+ 80832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:13.965960 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:17:13.966008 (+    48us) write_op.cc:312] APPLY: finished
0709 13:17:13.966418 (+   410us) log.cc:844] Serialized 125 byte log entry
0709 13:17:13.990603 (+ 24185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:13.995473 (+  4870us) write_op.cc:454] Released schema lock
0709 13:17:14.004089 (+  8616us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:14.052008 (+ 47919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:14.055670 (+  3662us) write_op.cc:454] Released schema lock
0709 13:17:14.589846 (+534176us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e532a 00007f3c6f46af14 00007f3c6f46aec3 00007f3c6f46ae38 00007f3c6f46adf3 00007f3c6f46a0dc 00007f3c6f493e16 00007f3c6f47bcbb 00007f3c6f46639d 00007f3c6f469d75
Metrics: {"mutex_wait_us":661584,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":409251,"apply.run_cpu_time_us":8818,"apply.run_wall_time_us":148473,"num_ops":18,"prepare.queue_time_us":1146670,"prepare.run_cpu_time_us":15882,"prepare.run_wall_time_us":368597,"raft.queue_time_us":111460,"raft.run_cpu_time_us":26478,"raft.run_wall_time_us":1198029,"replication_time_us":315133,"spinlock_wait_cycles":80257664,"thread_start_us":1256259,"threads_started":4,"wal-append.queue_time_us":147527,"wal-append.run_cpu_time_us":14581,"wal-append.run_wall_time_us":1696885}]]}
W20260709 13:17:18.309397 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 520591us
W20260709 13:17:18.038913 13289 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.145s	user 0.006s	sys 0.002s
I20260709 13:17:18.066591 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.316826 10036 rpcz_store.cc:276] 0709 13:17:15.979334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.979440 (+   106us) service_pool.cc:224] Handling call
0709 13:17:15.992128 (+ 12688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.992497 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.992526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.993000 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.481965 (+488965us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.482003 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.482066 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.006089 (+1524023us) raft_consensus.cc:1685] finished
0709 13:17:18.006122 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.006274 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":480,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":488596,"threads_started":1,"wal-append.queue_time_us":735606}
I20260709 13:17:18.307216 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.359927 10184 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
W20260709 13:17:18.145545 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 77557.5us
I20260709 13:17:18.032033 13252 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.311932 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.361552 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:18.314265  9938 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.362947 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:18.362994  9938 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.364764  9938 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.366312  9938 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.307474 10189 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.313098 10181 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
W20260709 13:17:18.050938 13377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.003s	sys 0.028s
W20260709 13:17:18.066265 13004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.008s	sys 0.018s
I20260709 13:17:18.032140 13379 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:18.047017 13388 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.319020 10183 rpcz_store.cc:276] 0709 13:17:15.002850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.672903 (+1670053us) service_pool.cc:224] Handling call
0709 13:17:16.937187 (+264284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.887974 (+950787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.888329 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.036019 13149 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.327369 10182 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:18.031734 13030 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.328433 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.011478 13376 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:18.031894 13168 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:18.243312 13393 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:17:18.072304 13251 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:18.331984 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.153743 13247 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:18.330457 13289 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.344421 13359 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.074569 13371 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.262408 13240 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.033404 13382 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.295s
I20260709 13:17:18.345978 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.353920 13163 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:17:18.332537 13353 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.066888 12919 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.312493 10709 raft_consensus.cc:606] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:18.442567 10032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.005s	sys 0.025s
I20260709 13:17:18.448585 10709 raft_consensus.cc:614] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:18.448901 10032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.005s	sys 0.026s
I20260709 13:17:18.369303 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:18.452142 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82933.9us
W20260709 13:17:18.453478 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.317507 10034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.567s	user 0.021s	sys 0.053s
I20260709 13:17:18.369199  9938 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 5 to 7, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.352319 13256 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.375995 10181 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:18.457237 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 612) took 2063 ms. Trace:
I20260709 13:17:18.457577 10181 rpcz_store.cc:276] 0709 13:17:16.393899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.375324 (+1981425us) service_pool.cc:224] Handling call
0709 13:17:18.375658 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.456968 (+ 81310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.457173 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.457975 10186 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:18.458724 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.459378 10181 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:18.461325 10111 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:18.465153 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:18.468283 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:18.395301 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.421396 10189 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:18.422577 10180 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:18.072525 13380 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.425205 13030 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.434978 13376 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.425802 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 617) took 1624 ms. Trace:
I20260709 13:17:18.429733 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.327538 13006 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.487368 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 476) took 2108 ms. Trace:
I20260709 13:17:18.489446 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.436707 10184 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:18.489722 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 147961us
I20260709 13:17:18.490121 10188 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:18.347543 13270 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:18.355463 13341 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:17:18.032023 13241 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.184651 13244 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.356081 13362 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:17:18.479939 13030 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:18.455089  9938 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.513528  9938 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 7, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:18.514241 13362 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:18.514698 13362 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:18.433270 13255 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.430212 13358 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:18.438462 13356 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.798s	user 0.006s	sys 0.006s
I20260709 13:17:18.472862 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.517166 13244 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.517616 10189 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:18.437717 13247 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.518517 13247 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.481670 10180 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:18.375322 13252 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.520222 13254 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:18.460527 13360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.012s	sys 0.028s
W20260709 13:17:18.520886 13360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.028s
I20260709 13:17:18.457129 13353 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.521657 13360 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:18.372944 13377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.006s	sys 0.040s
I20260709 13:17:18.523303 13353 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:18.487293 10187 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.490373 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 611) took 2096 ms. Trace:
I20260709 13:17:18.524864 10184 rpcz_store.cc:276] 0709 13:17:16.393632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.376267 (+1982635us) service_pool.cc:224] Handling call
0709 13:17:18.436520 (+ 60253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.490131 (+ 53611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.490309 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:18.525765 13401 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 13:17:18.492964 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 602297us
I20260709 13:17:18.492296 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.530112 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:18.531299 13030 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.514285 13355 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.521049 10185 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:18.515092  9938 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 7, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.538940  9938 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.436105 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.015s
I20260709 13:17:18.488572 10034 rpcz_store.cc:276] 0709 13:17:16.379003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.379132 (+   129us) service_pool.cc:224] Handling call
0709 13:17:16.386384 (+  7252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.386579 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:16.750277 (+363698us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.487020 (+1736743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.487076 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.487124 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.487186 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.487305 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32592,"prepare.queue_time_us":1533645,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":2059573,"threads_started":2}
I20260709 13:17:18.422845 13379 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.449187 13240 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.479636 12995 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.498145 10181 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:18.496595 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:18.553069 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 56552.9us
I20260709 13:17:18.553867 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.554726 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.555104 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:18.555688 10186 raft_consensus.cc:2376] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10. Re-sending same reply.
I20260709 13:17:18.479364 13359 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:18.375155 12720 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.456215 13279 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:18.505450 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 572938us
W20260709 13:17:18.442265 13345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.021s	sys 0.009s
I20260709 13:17:18.515614 12919 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.577909 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:18.521989 13252 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.517238 13356 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:18.541435 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.015s	sys 0.016s
W20260709 13:17:18.579844 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 695327us
I20260709 13:17:18.552419 12995 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.582093 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:18.426317 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 613) took 1937 ms. Trace:
I20260709 13:17:18.546509 10187 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:18.548583  9938 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 5, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 5 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.504947 13385 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.010s	sys 0.014s
I20260709 13:17:18.495975 12952 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.551388 10035 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:18.595397 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:18.551795 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.559921 13412 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.551795 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1671) took 1665 ms. Trace:
W20260709 13:17:18.519896 13274 consensus_meta.cc:287] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.001s
I20260709 13:17:18.462528 13149 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.599892 13168 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:18.600322 13168 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.600666 13006 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.602175 13240 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:18.555600 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.593089 12995 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:18.604105 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48580.2us
I20260709 13:17:18.605012 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.605821 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:18.606837 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.566612 10188 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:18.607918 13004 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:18.608539 10188 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:18.610116 10188 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:18.611284 10188 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:18.567013 10112 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:17:18.611896 10112 pending_rounds.cc:85] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 8
I20260709 13:17:18.612140 10112 pending_rounds.cc:107] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:17:18.612362 10112 raft_consensus.cc:2889] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.576936 10186 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:18.580461 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:18.490639 10183 rpcz_store.cc:276] 0709 13:17:16.801554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.419939 (+1618385us) service_pool.cc:224] Handling call
0709 13:17:18.425300 (+  5361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.425484 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.425508 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.425552 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.425588 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.425638 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.425745 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.557384 13410 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.590431 10182 rpcz_store.cc:276] 0709 13:17:16.488598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.425555 (+1936957us) service_pool.cc:224] Handling call
0709 13:17:18.425849 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.426022 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.426044 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.426081 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.426110 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.426159 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.426258 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.591826 10716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:18.617548 10716 raft_consensus.cc:606] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:18.592315  9938 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.594672 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:18.578289 13345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.021s	sys 0.010s
I20260709 13:17:18.597471 10032 rpcz_store.cc:276] 0709 13:17:16.885939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.886066 (+   127us) service_pool.cc:224] Handling call
0709 13:17:17.666335 (+780269us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:17.666796 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.666825 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:17.805932 (+139107us) log.cc:844] Serialized 78 byte log entry
0709 13:17:17.871914 (+ 65982us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b18002b3b40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:17:18.449713 (+577799us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:18.510340 (+ 60627us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.542348 (+ 32008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.542431 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.542475 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:18.551538 (+  9063us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.551714 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54118,"prepare.queue_time_us":117749,"raft.queue_time_us":38233,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":56958,"spinlock_wait_cycles":18416512,"thread_start_us":577514,"threads_started":1,"wal-append.queue_time_us":686987}
I20260709 13:17:18.608217 13416 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.581785 12720 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.549933 13360 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:18.580229 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:18.515477 13362 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.622080 10107 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:18.598043 13385 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.011s	sys 0.014s
I20260709 13:17:18.642089 13316 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:18.645012 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:18.618989  9938 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 9, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:18.576557 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 213685us
I20260709 13:17:18.600675 13168 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.681842 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 525) took 1192 ms. Trace:
W20260709 13:17:18.692618 10114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.003s	sys 0.014s
I20260709 13:17:18.694317  9938 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.702128 10710 rpcz_store.cc:276] 0709 13:17:17.489895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.491419 (+  1524us) service_pool.cc:224] Handling call
0709 13:17:17.491877 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.492329 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.492362 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.926526 (+434164us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.481131 (+554605us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.481178 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.481252 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.681614 (+200362us) raft_consensus.cc:1685] finished
0709 13:17:18.681635 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.681776 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2431,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"thread_start_us":473040,"threads_started":1,"wal-append.queue_time_us":672127}
I20260709 13:17:18.640071 13006 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.694016 10106 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:18.590632 13292 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.694203 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:18.695999 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 347375us
W20260709 13:17:18.696466 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81063.7us
I20260709 13:17:18.613436 13412 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.710619 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.707068 13316 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:18.707756 13252 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:18.703430 10114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.015s
I20260709 13:17:18.725481 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 535) took 2022 ms. Trace:
W20260709 13:17:18.711589 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.701632 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 121548us
W20260709 13:17:18.727056 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.622155 13270 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:18.712210 13292 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.689347 13380 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.596515 13371 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:17:18.597532 13172 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:17:18.719543 13404 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:18.691126 13405 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:18.692111 13289 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.688122 13356 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.721745 13161 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.722921 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 540) took 1974 ms. Trace:
I20260709 13:17:18.734436 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:18.725940 10114 rpcz_store.cc:276] 0709 13:17:16.702716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.702847 (+   131us) service_pool.cc:224] Handling call
0709 13:17:16.703115 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.703298 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:18.066633 (+1363335us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.724953 (+658320us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.725093 (+   140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.725136 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:18.725189 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.725304 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.725418 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1460016,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":83,"thread_start_us":2017646,"threads_started":2}
I20260709 13:17:18.641299 13240 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:18.722524 13389 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:18.778122 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 67582.6us
I20260709 13:17:18.779544 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 484) took 1001 ms. Trace:
I20260709 13:17:18.666571 13410 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:18.705399 13312 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.704254 13244 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.687848 13241 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:18.686808 13379 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:18.787251 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 197724us
I20260709 13:17:18.849066 10110 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:18.849216 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:18.787634 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 191737us
I20260709 13:17:18.850600 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:18.789036 10183 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:18.723394 13412 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.687058 12952 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:17:18.690340 13359 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:18.855037 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.823496 13352 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:18.831214 13312 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.799360 13252 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:18.731926 13414 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.796713 10111 rpcz_store.cc:276] 0709 13:17:16.748690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.751769 (+  3079us) service_pool.cc:224] Handling call
0709 13:17:16.752061 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.461752 (+1709691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.722648 (+260896us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540010dbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:18.722853 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3930632576}
W20260709 13:17:18.794071 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 263974us
I20260709 13:17:18.810926 10189 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:18.809262 12818 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.871973 10709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:18.688336 13360 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:17:18.872669 13356 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.781208 13270 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.814590 10184 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:18.853018 13254 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:18.819387 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1635) took 1008 ms. Trace:
W20260709 13:17:18.820540 10003 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.810s (SENT) [suppressed 36 similar messages]
I20260709 13:17:18.877430 10187 rpcz_store.cc:276] 0709 13:17:17.810722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.950980 (+140258us) service_pool.cc:224] Handling call
0709 13:17:18.819239 (+868259us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54002d87d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:18.819331 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231764736}
I20260709 13:17:18.860103 13352 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:18.879756 13352 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.880980 13352 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.882143 13030 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.883610 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.854708 13359 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:18.822679 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 543) took 2066 ms. Trace:
I20260709 13:17:18.795794 13405 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.686744 13247 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.818514 10037 rpcz_store.cc:276] 0709 13:17:17.778222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.877686 (+ 99464us) service_pool.cc:224] Handling call
0709 13:17:17.878167 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.878433 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:18.318725 (+440292us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.779129 (+460404us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.779190 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.779242 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.779318 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.779476 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45448,"prepare.queue_time_us":42033,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":49176,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8424,"thread_start_us":841877,"threads_started":2}
I20260709 13:17:18.645035 13416 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.788832 13004 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:18.831091 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 136936us
W20260709 13:17:18.901057 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51934us
I20260709 13:17:18.813076 13240 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.788370 13353 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.823294 13410 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:18.826407 13389 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.869088 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:18.870827 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.871130 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.871483 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.871830 13431 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.804337 10188 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:18.873260 13356 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.801788 10185 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:18.872633 10709 raft_consensus.cc:606] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:18.878832 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:18.918072 10187 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.822285 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.884485 10183 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
W20260709 13:17:18.877820 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57320.8us
I20260709 13:17:18.913702 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:18.921283 13427 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:18.908385 13244 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:18.922678 13244 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:18.923835 13421 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:18.924166 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.920831 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.887120 10107 rpcz_store.cc:276] 0709 13:17:16.756139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.790974 (+ 34835us) service_pool.cc:224] Handling call
0709 13:17:16.791247 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.665323 (+1874076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.816554 (+151231us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540022bad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:18.822606 (+  6052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4210237696}
I20260709 13:17:18.860229 13298 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.874500 13316 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.866694 13312 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.891467 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.867623 12995 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.923416 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.927714 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:18.927934 13292 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:18.873977 13270 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:18.907336 10004 leader_election.cc:336] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.841s (SENT)
I20260709 13:17:18.910780 10714 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:18.798861 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 64505.5us
I20260709 13:17:18.932548 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:18.933831 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:18.934021 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.911453 13389 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.863567 13172 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:18.912071 10716 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:18.912279 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.923563 13244 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.924130 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:18.822100 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 108763us
I20260709 13:17:18.916973 13407 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:17:18.885784 13254 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:18.928349 10184 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:18.929557 13289 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.928128 10185 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
W20260709 13:17:18.929275 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60262.8us
I20260709 13:17:18.911106 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:18.935479 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:18.821182 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 121650us
I20260709 13:17:18.893515 13359 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.953390 12818 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.956802 10183 raft_consensus.cc:2376] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8. Re-sending same reply.
I20260709 13:17:18.958050 10187 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:18.973435 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:18.954032 13379 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.909946 13240 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:18.954177 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49780.9us
I20260709 13:17:18.973416 10680 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:18.996315 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.042287 10713 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:19.017086 10716 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:19.040405 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:19.050684 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:18.914861 13004 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:18.973785 13371 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:19.114030 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48030.3us
I20260709 13:17:19.095997 10188 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:19.067314 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.099229 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.098758 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.066274 13163 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:18.909261 13404 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:17:18.963833 13006 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.113417 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:19.113897 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 140578us
I20260709 13:17:19.010679 13292 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.118088 10031 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
I20260709 13:17:19.120829 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.129776 10035 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:18.968339 13385 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:18.958230 13252 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.122825 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.097780 13254 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:19.125841 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 152473us
W20260709 13:17:19.120582 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.959638 12995 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.146070 10040 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:18.918387 13425 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.187s
W20260709 13:17:19.126266 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.964388 13356 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.130934 10106 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:19.004372 13172 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:19.121400 13163 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:19.121563 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.130345 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.133523 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:19.133760 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.134805 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.100059 13421 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:19.174753 10108 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
W20260709 13:17:19.126890 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 191461us
I20260709 13:17:19.126673 10182 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.040618 13289 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:19.135097 13385 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:19.140264 10109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:17:19.144089 10111 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:19.181828 10109 raft_consensus.cc:606] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.124858 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.182674 10114 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.089308 12818 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.179266 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.182268 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.184177 10111 raft_consensus.cc:2410] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:19.182175 10109 raft_consensus.cc:614] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:19.184945 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.147468 10709 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:18.961850 13030 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:18.959477 13427 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 13:17:19.114687 13371 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:19.148840 10036 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:19.188766 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:18.932137 13431 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.967837 13168 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:18.961046 13376 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.096109 13161 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.164557 10188 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:19.000447 13278 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:17:19.160102 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.131438 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:19.130559 13298 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.129032 13292 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:19.174376 10112 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.176584 10034 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:19.187027 13289 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.143208 13293 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.128571 13006 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.178139 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.178834 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:19.231549 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52812.2us
I20260709 13:17:19.172868 13241 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:17:19.139058 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:18.970647 13312 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.185966 10182 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
W20260709 13:17:19.160894 13149 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 13:17:19.139194 13437 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.177453 13172 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.182165 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.143870 13252 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:19.187988 10111 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:19.189567 10106 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
W20260709 13:17:19.191918 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 58491.2us
I20260709 13:17:19.132939 12720 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:17:19.194185 10114 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:19.231922 13409 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.196832 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:18.971009 13388 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.209216 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.293769 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.294561 10109 raft_consensus.cc:2410] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:19.210176 13168 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.211961 13431 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.215704 10711 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:19.216303 10115 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:19.215534 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 84189.1us
I20260709 13:17:19.215792 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.220470 13405 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.221436 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.221943 13278 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.222208 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.222429 13298 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:19.176425 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.181315 13356 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.180775 13421 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:19.194413 13371 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.176087 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.216112 13429 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:19.270737 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:19.212989 13441 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.125933 13410 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.284839 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.165805 13359 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.190629 13389 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.285624 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.232280 13006 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.288180 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.360850 10111 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:19.361304 10712 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:19.323541 13278 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.289664 10113 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:19.372768 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.373451 10113 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:19.204025 13434 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:17:19.296667 10039 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:19.270969 13379 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.269647 13163 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.306433 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:19.269841 13416 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.282132 13252 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:19.323679 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 116773us
I20260709 13:17:19.326488 10108 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:19.280087 13437 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:19.279672 13420 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.279842 13254 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.213613 13004 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.289201 13409 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:19.311007 13439 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.112s	user 0.001s	sys 0.005s
I20260709 13:17:19.335970 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.272397 12919 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:17:19.267866 13293 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.339860 13450 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:19.340106 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.357623 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:19.358603 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 137266us
W20260709 13:17:19.359346 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 88694.4us
W20260709 13:17:19.289119 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 248799us
I20260709 13:17:19.361955 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.305611 10112 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:19.381232 10034 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:19.384728 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:19.388744 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.395658 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.369796 13341 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.376820 13278 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.403591 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:19.338716 13356 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:19.404309 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.388525 13429 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:19.413271 10109 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:19.358376 13388 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:19.417042 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:19.419678 10111 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:17:19.441645 10111 pending_rounds.cc:85] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 4
W20260709 13:17:19.398797 13412 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.540s	user 0.004s	sys 0.006s
I20260709 13:17:19.390558 13410 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.386781 13438 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:17:19.428184 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.450804 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:19.402338 10036 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:19.428460 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.417614 12952 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:19.398937 13254 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.434224 13379 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.438048 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.441915 10111 pending_rounds.cc:107] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:17:19.330757 13292 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.438666 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.361368 13441 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.316480 13385 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.419370 13341 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.400811 13409 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.452322 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.398859 13420 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.455964 10709 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:19.459228 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:19.458257 13423 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.392616 13437 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.465587 10111 raft_consensus.cc:2889] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.435387 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.471304 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.489578 10109 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:19.471917 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.488042 13385 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.472191 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.477587 10108 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:19.489781 13423 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:19.453375 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49876.1us
I20260709 13:17:19.480702 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.479379 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.505985 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.506789 13420 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.477131 13341 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.511330 13426 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.469611 12952 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:19.526288 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.494333 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.539929 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.545671 10111 raft_consensus.cc:2376] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9. Re-sending same reply.
I20260709 13:17:19.546813 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.547708 10032 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:19.476387 13376 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.490779 12818 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.498617 13423 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.494570 13463 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:19.497980 13352 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.002s
W20260709 13:17:19.562059 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 411701us
I20260709 13:17:19.563467 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.564782 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:19.565340 10032 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.559383 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.485850 13456 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.571449 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.450673 13412 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.571043 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:19.573355 10709 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 6.
I20260709 13:17:19.575570 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.474488 13379 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:19.569768 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44962.5us
I20260709 13:17:19.539829 13292 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.477833 13407 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:17:19.441219 13298 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.556650 13458 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.591991 10115 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:19.597896 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.499197 13441 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:19.583516 13445 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:17:19.601568 10032 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:19.578912 13456 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.606751 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.606967 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.609434 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:19.623116 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.628320 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:19.629125 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.599359 13434 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:17:19.578401 13463 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.595566 13427 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:17:19.594862 13425 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:19.604959 13241 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:17:19.611184 13441 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:17:19.603183 13254 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.605136 13172 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.636790 10032 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:19.659969 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.660789 10032 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:19.640059 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.603267 13455 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.608319 13392 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:17:19.657307 10709 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.611706 13456 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.541141 13429 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:19.661690 10153 leader_election.cc:336] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.631s (SENT)
I20260709 13:17:19.652211 13427 consensus_queue.cc:1243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:19.671226 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.605983 13352 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:17:19.664886 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.652621 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.664346 13356 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.677062 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 627) took 1201 ms. Trace:
W20260709 13:17:19.683470 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55249.8us
I20260709 13:17:19.684305 10181 rpcz_store.cc:276] 0709 13:17:18.475180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.816168 (+340988us) service_pool.cc:224] Handling call
0709 13:17:18.816440 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.816756 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.816782 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.827423 (+ 10641us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.246431 (+419008us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:19.246480 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.246559 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.676869 (+430310us) raft_consensus.cc:1685] finished
0709 13:17:19.676889 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.677012 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4649,"raft.queue_time_us":487,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8408,"thread_start_us":381496,"threads_started":1,"wal-append.queue_time_us":441318}
I20260709 13:17:19.687530 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:19.688858 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:19.691491 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:19.635179 13448 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:17:19.628183 12952 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.693945 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.697391 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.698024 10115 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:19.699203 10115 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:19.666716 13376 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:19.701026 13465 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:19.702142 13451 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:19.702591 13451 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:19.703567 13451 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.704820 13451 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:19.708492 13464 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:19.709254 13463 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.711269 13379 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.712122 13341 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.712672 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:19.713349 10184 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:19.605238 13458 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.720405 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.719310 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.722414 10112 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:19.723431 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.724607 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:19.725001 13467 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:19.728724 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:19.729935 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:19.674187 13254 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.730520 10186 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:19.731267 13462 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:17:19.733682 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:19.734010 10709 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:19.665455 13459 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:19.717882 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:19.747197 10189 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.721521 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:19.731488 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:19.768283 10153 leader_election.cc:336] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.716s (SENT)
I20260709 13:17:19.768941 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.769902 13463 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.770596 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:19.772405 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:19.776572 13426 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.745002 13379 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.777777 13379 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:19.763033 13240 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.000s
I20260709 13:17:19.781504 13240 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.784889 10182 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:19.789534 13252 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.792526 13371 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.796768 10032 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:19.800135 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:19.796635 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.803706 10189 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:19.809010 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:19.812031 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.813303 10184 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:19.775279 13278 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.763114 13423 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:19.814284 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 219846us
I20260709 13:17:19.745404 13376 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:19.817160 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.820972 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.803325 13412 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.819505 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:19.827948 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.830332 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:19.822173 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:19.823925 10184 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:19.832965 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.835599 10712 raft_consensus.cc:606] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:17:19.836174 10712 raft_consensus.cc:614] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:19.838349 10714 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:19.843051 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.845696 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:19.849814 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.818392 13252 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:19.836018 13270 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.004s
I20260709 13:17:19.852802 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:19.836627 13460 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 13:17:19.787489 13437 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.869556 13172 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.884164 13172 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.884477 10708 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.886320 13437 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.867194 13376 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.835526 13352 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:19.844390 13449 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:17:19.834618 13385 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.835717 13434 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:19.850164 13444 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.862888 13341 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.869324 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.857388 13379 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.856846 13453 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.858656 13270 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.922848 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.923965 13270 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.924083 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.860948 13278 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:19.873967 13359 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
I20260709 13:17:19.874619 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:19.876484 10710 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.877792 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:19.926541 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48808.7us
I20260709 13:17:19.865823 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:19.867981 13312 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.880573 13149 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.928522 13149 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:19.929570 13149 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.881961 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 549) took 1286 ms. Trace:
I20260709 13:17:19.931051 10110 rpcz_store.cc:276] 0709 13:17:18.595928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.596098 (+   170us) service_pool.cc:224] Handling call
0709 13:17:18.598831 (+  2733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.854013 (+255182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.881679 (+1027666us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540004a1d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:19.881897 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575042944}
I20260709 13:17:19.931998 13371 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.857049 13356 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.889842 13030 raft_consensus.cc:993] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:19.933686 13030 raft_consensus.cc:1081] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:19.891055 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.934340 13379 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:19.934903 13379 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:19.935509 10038 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.936781 10038 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:19.937163 13379 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.862231 13423 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.892273 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.888489 13293 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:19.895438 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.857713 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.896404 10107 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:19.941088 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:19.879590 13289 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.001s
I20260709 13:17:19.907461 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.909852 13385 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.884549 13172 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.911401 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:19.914999 10185 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:17:19.916254 13479 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:19.911502 13454 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.911803 13444 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:19.921599 13240 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:19.953958 13289 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:19.905092 13352 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.860870 13455 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.925405 10034 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.932570 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.970536 10110 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:19.862229 13458 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.853701 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:19.945354 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87741.9us
W20260709 13:17:19.974428 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 120811us
I20260709 13:17:19.975107 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.975293 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:19.976428 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:19.946264 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:19.972023 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:19.978930 10114 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:19.947938 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:19.949605 10715 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:19.951336 10112 raft_consensus.cc:2410] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:19.953087 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.956300 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:19.913259 13453 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.939368 13341 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:19.928524 13252 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.949585 13426 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:19.930886 13149 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.954627 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.964426 10039 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:19.965021 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:19.949790 13356 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.952555 13371 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:19.955564 13454 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:19.953780 13379 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.985481 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.990373 10034 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:17:19.972484 13244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.021s	sys 0.025s
I20260709 13:17:19.950311 13355 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:17:19.930878 13389 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:19.970387 13352 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.993286 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.985984 13451 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:20.018276 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:19.992414 10109 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:19.969518 13455 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.019264 13455 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.000738 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:19.984138 13312 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:19.985728 13316 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:19.984206 13463 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.988855 13453 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.019703 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:19.988631 13458 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.023880 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:19.988695 13362 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.994355 13252 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.020381 13412 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.994184 13293 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.988898 13341 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:20.030493 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:20.001989 13244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.021s	sys 0.025s
I20260709 13:17:19.993969 13434 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:20.082074 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 66064.3us
I20260709 13:17:20.016014 13420 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.999189 13379 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.097482 13247 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.100540 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.115614 10182 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.972455 13409 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:20.112792 13483 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:19.995550 13392 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:17:20.028208 13312 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:20.030404 13410 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:20.117316 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 86900.2us
I20260709 13:17:20.020399 13316 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:20.078516 13382 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:20.105288 13463 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.143699 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.150734 10107 raft_consensus.cc:2376] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7. Re-sending same reply.
I20260709 13:17:20.144160 13468 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:20.122699 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.084844 13252 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.091248 13454 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.113607 13434 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:20.134346 13481 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:17:20.169706 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.141707 13421 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.079211 13456 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:20.115691 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 91954.7us
I20260709 13:17:20.179112 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:20.169292 13385 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:20.122282 10182 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:20.117522 13379 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.150555 13463 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.158303 13434 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:20.182722 13355 raft_consensus.cc:2764] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:20.182997 13463 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.184193 13456 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.184979 10115 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:20.177081 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:20.159346 10188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1659) took 1309 ms (client timeout 1677 ms). Trace:
I20260709 13:17:20.159659 13409 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.160521 13316 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.160946 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.164088 13341 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.164903 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.171316 10107 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:20.171949 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:20.173071 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.148289 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.131886 13382 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.198668 13382 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:20.181427 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.158787 13454 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.199311 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.200762 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.201983 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:20.185851 10188 rpcz_store.cc:269] 0709 13:17:18.849489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.913457 (+ 63968us) service_pool.cc:224] Handling call
0709 13:17:20.159176 (+1245719us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54002d91d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.159284 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405243776}
I20260709 13:17:20.203709 10112 raft_consensus.cc:2410] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:20.204569 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.205610 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.206748 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.207319 10112 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.187656 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.215643 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.217011 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.217911 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:20.182175 13006 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.000s
I20260709 13:17:20.218632 10038 raft_consensus.cc:2410] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:17:20.218776 10107 raft_consensus.cc:2410] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:20.223645 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.217556 10113 raft_consensus.cc:2376] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10. Re-sending same reply.
I20260709 13:17:20.214847 10112 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:20.180394 13420 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.233423 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:20.234357 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.236240 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.234145 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.191430 13421 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:20.246758 13475 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:20.254117 13360 raft_consensus.cc:993] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:20.254691 13360 raft_consensus.cc:1081] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:20.256860 13423 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:20.257345 13423 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:20.258394 13423 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.232543 13279 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:20.268253 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.245695 13030 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.238696 13355 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.291888 13279 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:20.292976 13279 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:20.296375 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.245308 13458 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:20.252746 13289 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.285300 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:20.301177 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.236313 13341 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.235697 13006 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:20.313354 13484 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:17:20.263530 13444 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:20.246390 13420 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.332177 10036 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:20.237720 13312 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.320309 13423 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:20.343240 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.346575 10034 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:20.347815 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.350232 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:20.348884 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:20.352902 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:20.354139 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.356324 10038 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:20.356562 13006 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.356884 13420 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:20.357427 13420 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.358114 13420 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.358572 13420 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.362531 13149 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.363116 13149 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.365255 13149 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.365793 13491 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:20.366572 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2462) took 1074 ms. Trace:
I20260709 13:17:20.366391 13491 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.366950 10032 rpcz_store.cc:276] 0709 13:17:19.291772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.664570 (+372798us) service_pool.cc:224] Handling call
0709 13:17:20.366352 (+701782us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540031b0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.366510 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277217664}
I20260709 13:17:20.368181 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:20.368693 13491 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:20.369374 10033 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.373559 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:20.380312 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:20.384752 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 619) took 1222 ms. Trace:
I20260709 13:17:20.385198 10711 rpcz_store.cc:276] 0709 13:17:19.162455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.162600 (+   145us) service_pool.cc:224] Handling call
0709 13:17:19.162932 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.308602 (+145670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.372171 (+1063569us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54006103d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:20.384675 (+ 12504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120604928}
I20260709 13:17:20.371239 13355 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.349818 13444 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.442104 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.442963 10113 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:20.396660 13491 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.384557 13149 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.387362 13456 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.333122 13453 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.435624 13355 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.401692 13380 raft_consensus.cc:2764] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:17:20.487172 10110 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:20.401763 13244 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:17:20.496925 10003 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.677s (SENT)
I20260709 13:17:20.497411 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.462281 13458 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:20.438352 13293 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:17:20.441104 13356 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:17:20.509155 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.511952 13006 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.512554 13006 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.488396 13355 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.515118 13355 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:20.501447 13392 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.515663 13355 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:20.516469 13355 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.473409 13491 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.463449 13444 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.518946 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.543077 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.498617 12995 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.555460 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 319266us
I20260709 13:17:20.493355 13376 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:17:20.549396 10183 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.564580 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.554849 13362 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:20.563344 13172 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:17:20.574151 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:20.581171 13493 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:17:20.584411 13496 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:17:20.585166 13463 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.585635 10183 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:20.586551 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:20.586423 13434 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.587282 13463 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.587483 10034 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:20.587159 10183 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:20.587873 13499 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:20.588394 13499 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.588798 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.589560 10183 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:20.581185 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.588034 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2475) took 1087 ms. Trace:
I20260709 13:17:20.590337 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.590811 10039 rpcz_store.cc:276] 0709 13:17:19.500403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.998019 (+497616us) service_pool.cc:224] Handling call
0709 13:17:19.998308 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.998601 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.998619 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.016377 (+ 17758us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.219919 (+203542us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:20.219961 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.220026 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.587810 (+367784us) raft_consensus.cc:1685] finished
0709 13:17:20.587833 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.587975 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69300,"raft.queue_time_us":705,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":18784,"thread_start_us":100630,"threads_started":1,"wal-append.queue_time_us":232645}
I20260709 13:17:20.592334 10183 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.558598 12995 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.606755 12995 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.569976 13407 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.569568 13293 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:20.608697 13293 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:20.598268 13463 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:20.611722 13353 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.612300 13353 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.613102 13444 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.617226 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51490 (request call id 8) took 1166 ms. Trace:
I20260709 13:17:20.617686 10712 rpcz_store.cc:276] 0709 13:17:19.450553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.450678 (+   125us) service_pool.cc:224] Handling call
0709 13:17:20.616981 (+1166303us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54004362d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e2853 00007f3c744b060a 00007f3c6da367d4 00007f3c6da36762 00007f3c6da36691 00007f3c6da3660c 00007f3c6da358c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.617113 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883469184}
I20260709 13:17:20.569480 13252 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.620225 10183 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:20.621196 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.621716 10183 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:20.622550 13455 consensus_meta.cc:287] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.603s	user 0.003s	sys 0.005s
I20260709 13:17:20.590631 13499 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:20.599129 13494 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:17:20.623163 13499 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:20.623724 13499 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.625357 13420 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.626142 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 558) took 1174 ms. Trace:
I20260709 13:17:20.627234 13453 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.579527 13362 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.593003 13172 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.629897 13172 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.592233 13500 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:20.632258 13500 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.633131 13289 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.633587 13289 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:20.596856 13497 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:17:20.609779 13293 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.635380 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.656018 10186 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.635625 13293 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.593434 13458 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.636317 13362 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.636343 13500 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:20.637028 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:20.637832 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 632) took 1570 ms. Trace:
I20260709 13:17:20.667918 10187 rpcz_store.cc:276] 0709 13:17:19.067045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.119380 (+ 52335us) service_pool.cc:224] Handling call
0709 13:17:19.119702 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.121135 (+  1433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.121163 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.121734 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.116993 (+995259us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b18003f8800. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:17:20.395692 (+278699us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:20.395735 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.395993 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.637512 (+241519us) raft_consensus.cc:1685] finished
0709 13:17:20.637533 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.637769 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13621,"raft.queue_time_us":1108,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":16322,"spinlock_wait_cycles":11510144,"thread_start_us":278492,"threads_started":1,"wal-append.queue_time_us":1273963}
W20260709 13:17:20.634413 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.640552 13491 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:20.642916 13379 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.643522 13507 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.646440 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:20.672464 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.673128 10189 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:20.673386 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:20.674875 10189 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:20.676080 10189 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.681030 10187 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:20.670207 13352 consensus_meta.cc:287] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.004s
I20260709 13:17:20.638895 13382 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.685789 13279 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:20.684739 13436 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:20.688369 13279 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:20.658093 13455 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.689507 13279 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.648370 13353 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.680279 13434 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.634512 13289 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.688674 13436 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.692981 13382 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.680896 13507 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.697014 13499 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.699455 13436 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.699262 13379 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.699661 13507 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.685642 13352 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.701299 13353 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:20.702665 13352 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.704180 13455 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.738125 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:20.741671 10038 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:20.741698 10037 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:20.595711 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 131375us
I20260709 13:17:20.744555 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.746353 10039 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:20.747970 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.748998 10039 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.750200 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.751276 10032 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:20.755817 10109 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:20.639001 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2671) took 1356 ms. Trace:
W20260709 13:17:20.757156 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 188664us
I20260709 13:17:20.644835 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.759337 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:20.760880 10115 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:20.760982 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.650771 10108 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:20.744663 10035 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8.
I20260709 13:17:20.756807 10114 rpcz_store.cc:276] 0709 13:17:19.282940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.284586 (+  1646us) service_pool.cc:224] Handling call
0709 13:17:20.638774 (+1354188us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54000b5754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.638934 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465982208}
I20260709 13:17:20.767957 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.769086 10114 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:20.647585 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.647059 10183 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
W20260709 13:17:20.749054 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.626612 10106 rpcz_store.cc:276] 0709 13:17:19.451309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.492460 (+ 41151us) service_pool.cc:224] Handling call
0709 13:17:19.492764 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.557412 (+ 64648us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:19.582518 (+ 25106us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.258698 (+676180us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18003a65a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1
0709 13:17:20.260203 (+  1505us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b18003a65a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:20.395733 (+135530us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b18003a65a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:17:20.568178 (+172445us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.569013 (+   835us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.569160 (+   147us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.569193 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.569269 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.625900 (+ 56631us) raft_consensus.cc:1685] finished
0709 13:17:20.625921 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.626067 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66452,"prepare.queue_time_us":25287,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":60,"raft.queue_time_us":90121,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":6580,"spinlock_wait_cycles":28112896,"thread_start_us":170930,"threads_started":1,"wal-append.queue_time_us":1041474}
I20260709 13:17:20.772185 10180 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.773696 10039 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:20.770212 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:20.773126 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.805116 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.791018 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:20.800926 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.778975 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:20.839190 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:20.797079 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:20.786371 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:20.805490 13359 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.852957 10114 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.747424 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:20.798038 13240 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:20.856042 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 495) took 1632 ms. Trace:
W20260709 13:17:20.857692 10036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2469) took 1547 ms (client timeout 1803 ms). Trace:
I20260709 13:17:20.858006 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:20.858883 13382 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.853070 13359 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.788234 13289 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.787314 13006 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.864802 10037 pending_rounds.cc:85] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 8
I20260709 13:17:20.866127 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1674) took 1748 ms. Trace:
I20260709 13:17:20.866626 10114 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:20.868165 10184 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:20.805517 13385 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.869890 13352 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.870627 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.871764 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.793346 10716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:20.874684 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.856103 13420 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:20.900537 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.901398 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1434) took 1263 ms. Trace:
I20260709 13:17:20.901773 10108 rpcz_store.cc:276] 0709 13:17:19.637492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.637689 (+   197us) service_pool.cc:224] Handling call
0709 13:17:20.650563 (+1012874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.765249 (+114686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.901080 (+135831us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000b5750. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.901216 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328621312}
I20260709 13:17:20.903280 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.877909 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.904270 10032 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.887467 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.799161 13293 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
W20260709 13:17:20.885074 10036 rpcz_store.cc:269] 0709 13:17:19.309592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.471953 (+162361us) service_pool.cc:224] Handling call
0709 13:17:20.857183 (+1385230us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b540031ced4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.857444 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928947456}
I20260709 13:17:20.893855 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:20.894778 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:20.895596 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.896193 10716 raft_consensus.cc:606] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:17:20.898041 10039 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:20.889936 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 561) took 1028 ms. Trace:
I20260709 13:17:20.889084 10037 pending_rounds.cc:107] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:17:20.884682 10033 rpcz_store.cc:276] 0709 13:17:19.222908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.939170 (+716262us) service_pool.cc:224] Handling call
0709 13:17:20.369167 (+429997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.369721 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.855475 (+485754us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540031b0d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:20.855709 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949187968}
I20260709 13:17:20.886127 13382 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.889430 10040 rpcz_store.cc:276] 0709 13:17:19.117980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.118151 (+   171us) service_pool.cc:224] Handling call
0709 13:17:19.118458 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.146481 (+ 28023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.865593 (+1719112us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540031d8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:20.865924 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58827008}
I20260709 13:17:20.913623 10114 rpcz_store.cc:276] 0709 13:17:19.861568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.769794 (+908226us) service_pool.cc:224] Handling call
0709 13:17:20.889877 (+120083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:20.893864 13352 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:20.918565 13458 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:20.919076 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.919625 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.920583 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:20.921093 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:20.921466 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:20.921663 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:20.913802 10037 raft_consensus.cc:2889] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.923823 13004 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:20.924422 13353 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:20.926608 13405 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.927131 13405 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.927026 13504 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:20.927886 13405 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:20.928267 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 181417us
I20260709 13:17:20.928526 13504 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:20.929211 13504 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:20.930701 13504 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.931241 13421 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:20.932823 13421 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:20.934679 10186 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:20.934340 13421 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.936156 13421 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.937872 13359 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:20.938444 13359 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:20.924017  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:20.941673 13004 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.942204 13004 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:20.922026 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.919353 13458 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:20.926903 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.929288 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:20.923705 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 538) took 1636 ms. Trace:
I20260709 13:17:20.944295 10181 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:20.961643 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.958161 10708 rpcz_store.cc:276] 0709 13:17:19.287392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.287944 (+   552us) service_pool.cc:224] Handling call
0709 13:17:19.327036 (+ 39092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.885016 (+557980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.923157 (+1038141us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540049cd54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:20.923484 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281588096}
I20260709 13:17:20.961671 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:20.915766 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:20.908810 13240 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:20.965296 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:20.944388 13382 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.969755 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1358) took 1274 ms. Trace:
I20260709 13:17:20.924005 13360 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.973017 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:20.987931 10181 rpcz_store.cc:276] 0709 13:17:19.690142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.746829 (+ 56687us) service_pool.cc:224] Handling call
0709 13:17:20.920754 (+1173925us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:20.964387 (+ 43633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049920}
I20260709 13:17:21.002995 10115 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:21.006232 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2682) took 1019 ms. Trace:
I20260709 13:17:20.994506 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.006642 10115 rpcz_store.cc:276] 0709 13:17:19.986992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.921657 (+934665us) service_pool.cc:224] Handling call
0709 13:17:21.006157 (+ 84500us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:20.989527 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 68019.4us
I20260709 13:17:21.011629 10184 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.997658 10185 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:21.017709 10180 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:20.943602 13004 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:20.995796 13293 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.977866 13352 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.025099 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:21.026782 10711 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:21.028174 10181 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
W20260709 13:17:21.032584 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60808.6us
I20260709 13:17:21.031230 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.025089 10106 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:21.031828 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:21.040871 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.030357 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:21.040750 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.044045 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1460) took 1133 ms. Trace:
I20260709 13:17:21.044432 10115 rpcz_store.cc:276] 0709 13:17:19.910205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.011417 (+1101212us) service_pool.cc:224] Handling call
0709 13:17:21.043971 (+ 32554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.047883 10036 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:21.050724 13355 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.048470 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.048610 10180 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:21.052179 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1673) took 1065 ms. Trace:
I20260709 13:17:21.052670 10180 rpcz_store.cc:276] 0709 13:17:19.986620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.047854 (+1061234us) service_pool.cc:224] Handling call
0709 13:17:21.048293 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.051668 (+  3375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.051990 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.055073 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.056049 10106 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:21.056609 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2676) took 1090 ms. Trace:
I20260709 13:17:21.056941 10106 rpcz_store.cc:276] 0709 13:17:19.965754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.034988 (+1069234us) service_pool.cc:224] Handling call
0709 13:17:21.056537 (+ 21549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.058048 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.060726 10185 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.061055 10115 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:17:21.061841 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 132694us
I20260709 13:17:21.062214 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.048770 13491 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.069634 10115 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:21.070101 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2687) took 1082 ms. Trace:
I20260709 13:17:21.069976 13491 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.070482 10115 rpcz_store.cc:276] 0709 13:17:19.987943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.061874 (+1073931us) service_pool.cc:224] Handling call
0709 13:17:21.070019 (+  8145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.062599 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:21.073441 13458 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.044344 13161 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:21.073988 13426 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:21.074630 13426 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:21.075704 13426 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.076771 10188 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:21.078574 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1678) took 1056 ms. Trace:
I20260709 13:17:21.078948 10188 rpcz_store.cc:276] 0709 13:17:20.022059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.077404 (+1055345us) service_pool.cc:224] Handling call
0709 13:17:21.077749 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.078092 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.078239 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.078299 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:21.078335 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.078388 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.078487 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.080644 10188 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:21.081321 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:21.082916 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1447) took 1270 ms. Trace:
I20260709 13:17:21.030268 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.073688 10114 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.083343 10112 rpcz_store.cc:276] 0709 13:17:19.812786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.081487 (+1268701us) service_pool.cc:224] Handling call
0709 13:17:21.081887 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.082431 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:21.082456 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.082509 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.082554 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.082614 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.082732 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.090847 10033 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:21.092410 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1443) took 1374 ms. Trace:
I20260709 13:17:21.092783 10114 rpcz_store.cc:276] 0709 13:17:19.711409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.073105 (+1361696us) service_pool.cc:224] Handling call
0709 13:17:21.073503 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.085898 (+ 12395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.086081 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.096040 10032 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:21.083791 13161 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:21.044595 13240 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.098286 13161 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:21.103243 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62779.5us
I20260709 13:17:21.106248 10185 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:21.104403 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2684) took 1117 ms. Trace:
W20260709 13:17:21.114228 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51456.7us
I20260709 13:17:21.108933 10109 rpcz_store.cc:276] 0709 13:17:19.987289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.957955 (+970666us) service_pool.cc:224] Handling call
0709 13:17:21.104325 (+146370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.119135 10111 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:21.119205 10106 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:21.121255 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1449) took 1301 ms. Trace:
I20260709 13:17:21.121590 10106 rpcz_store.cc:276] 0709 13:17:19.822147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.089877 (+1267730us) service_pool.cc:224] Handling call
0709 13:17:21.118884 (+ 29007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.120891 (+  2007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.121165 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.123015 10106 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:21.123378 10106 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:21.126559 13293 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.127224 13293 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.129834 13293 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.125566 10106 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.132063 10106 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:21.154460 10184 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:21.162868 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:21.166620 10115 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:21.167155 10115 pending_rounds.cc:85] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:17:21.167402 10115 pending_rounds.cc:107] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:21.167649 10115 raft_consensus.cc:2889] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.172595 10184 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:21.132155 13292 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:17:21.172475 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:21.172749 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.172595 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:21.182029 13252 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.183523 13455 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:21.184115 13455 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:21.187384 10032 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:21.189791 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:21.190706 10711 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:21.191306 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 639) took 1084 ms. Trace:
I20260709 13:17:21.191712 10182 rpcz_store.cc:276] 0709 13:17:20.106894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.190143 (+1083249us) service_pool.cc:224] Handling call
0709 13:17:21.190562 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.190873 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.190899 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.190937 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.190977 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.191028 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.191128 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.192503 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:21.192853 10182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:17:21.194247 10106 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:21.195951 13356 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:21.196676 13356 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.197611 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.198349 13522 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.199215 13491 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.199733 10109 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:21.200275 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1670) took 1221 ms. Trace:
I20260709 13:17:21.200404 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1462) took 1286 ms. Trace:
I20260709 13:17:21.200699 10183 rpcz_store.cc:276] 0709 13:17:19.978699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.773487 (+794788us) service_pool.cc:224] Handling call
0709 13:17:20.774309 (+   822us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:20.775214 (+   905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.775248 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:20.872800 (+ 97552us) log.cc:844] Serialized 78 byte log entry
0709 13:17:20.914408 (+ 41608us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:20.914450 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.914516 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.199881 (+285365us) raft_consensus.cc:1685] finished
0709 13:17:21.199902 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.200071 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100847,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":50664,"thread_start_us":41136,"threads_started":1,"wal-append.queue_time_us":124496}
I20260709 13:17:21.202147 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:21.195926 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1464) took 1281 ms. Trace:
I20260709 13:17:21.207261 10109 rpcz_store.cc:276] 0709 13:17:19.913546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.115638 (+1202092us) service_pool.cc:224] Handling call
0709 13:17:21.199561 (+ 83923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.200171 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.200353 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.202020 10035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2480) took 1391 ms (client timeout 1726 ms). Trace:
I20260709 13:17:21.207537 10106 rpcz_store.cc:276] 0709 13:17:19.914167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.122360 (+1208193us) service_pool.cc:224] Handling call
0709 13:17:21.122743 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.195594 (+ 72851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.195834 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.210806 10035 rpcz_store.cc:269] 0709 13:17:19.810672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.865541 (+ 54869us) service_pool.cc:224] Handling call
0709 13:17:21.201792 (+1336251us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400043154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:21.201955 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839681792}
I20260709 13:17:21.208994 13420 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:21.199180 13356 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.232200 13312 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.232795 13163 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:21.233547 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1672) took 1247 ms. Trace:
I20260709 13:17:21.233978 13274 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.248468 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1440) took 1525 ms. Trace:
I20260709 13:17:21.250092 10115 rpcz_store.cc:276] 0709 13:17:19.710586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.071156 (+1360570us) service_pool.cc:224] Handling call
0709 13:17:21.097025 (+ 25869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.225639 (+128614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.235574 (+  9935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.247767 10187 rpcz_store.cc:276] 0709 13:17:19.986365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.779503 (+793138us) service_pool.cc:224] Handling call
0709 13:17:20.780160 (+   657us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:20.781077 (+   917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.781106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:20.781900 (+   794us) log.cc:844] Serialized 52 byte log entry
0709 13:17:20.815453 (+ 33553us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:20.815495 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.815563 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.233187 (+417624us) raft_consensus.cc:1685] finished
0709 13:17:21.233208 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.233379 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":355,"raft.queue_time_us":96112,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":255,"thread_start_us":33043,"threads_started":1,"wal-append.queue_time_us":354207}
I20260709 13:17:21.254313 10187 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:21.254984 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1682) took 1037 ms. Trace:
W20260709 13:17:21.255504 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58026.2us
I20260709 13:17:21.256636 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.255384 10187 rpcz_store.cc:276] 0709 13:17:20.217501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.253609 (+1036108us) service_pool.cc:224] Handling call
0709 13:17:21.254030 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.254732 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.254922 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.226003 13293 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.261174 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 180040us
I20260709 13:17:21.261807 10182 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:21.262329 10182 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.264343 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.257179 13491 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:21.285288 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.294330 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.298079 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.299552 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:21.301189 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1366) took 1310 ms. Trace:
W20260709 13:17:21.306842 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 104820us
I20260709 13:17:21.308009 10106 pending_rounds.cc:85] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 3
I20260709 13:17:21.310487 10106 pending_rounds.cc:107] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:21.310741 10106 raft_consensus.cc:2889] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.264581 13293 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:21.314656 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 169156us
I20260709 13:17:21.303907 13420 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.315369 10115 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:21.328462 10187 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:21.306435 10181 rpcz_store.cc:276] 0709 13:17:19.991198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.074423 (+1083225us) service_pool.cc:224] Handling call
0709 13:17:21.074846 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.075222 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:21.075588 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.286951 (+211363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.286999 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.300939 (+ 13940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.301013 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.301132 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":52,"raft.queue_time_us":9693,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7363,"thread_start_us":193059,"threads_started":1}
I20260709 13:17:21.331068 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 638) took 1224 ms. Trace:
W20260709 13:17:21.331897 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 75466.9us
I20260709 13:17:21.314350 13426 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.332098 10184 rpcz_store.cc:276] 0709 13:17:20.106637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.174123 (+1067486us) service_pool.cc:224] Handling call
0709 13:17:21.174560 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.174944 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:21.175597 (+   653us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.330568 (+154971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.330663 (+    95us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:21.330730 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.330812 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.330991 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":5690,"thread_start_us":149525,"threads_started":1}
I20260709 13:17:21.335495 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1683) took 1077 ms. Trace:
I20260709 13:17:21.338737 10187 rpcz_store.cc:276] 0709 13:17:20.253982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.258180 (+1004198us) service_pool.cc:224] Handling call
0709 13:17:21.308738 (+ 50558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.328977 (+ 20239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.331320 (+  2343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.341446 13405 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.337338 13426 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.344220 13426 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.348155 10108 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:21.324990 13382 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.353680 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.354287 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.355099 10038 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:21.355284 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.355844 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.354327 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.356638 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.357074 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1677) took 1335 ms. Trace:
W20260709 13:17:21.358228 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.358093 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.356001 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.359102 10040 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:21.359959 13491 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:21.360375 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:21.361054 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.362262 13355 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.367180 13161 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.356034 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:17:21.372218 10187 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:21.358129 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.357486 10180 rpcz_store.cc:276] 0709 13:17:20.021689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.053939 (+1032250us) service_pool.cc:224] Handling call
0709 13:17:21.054466 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.059238 (+  4772us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:21.059707 (+   469us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.215189 (+155482us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.247893 (+ 32704us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.251518 (+  3625us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.251681 (+   163us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.251712 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.251801 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.356845 (+105044us) raft_consensus.cc:1685] finished
0709 13:17:21.356862 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.357001 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32358,"prepare.queue_time_us":520,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":34275,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":9177,"thread_start_us":151485,"threads_started":1,"wal-append.queue_time_us":239430}
I20260709 13:17:21.382187 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:21.367730 10115 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:21.411616 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1370) took 1114 ms. Trace:
I20260709 13:17:21.412503 10187 rpcz_store.cc:276] 0709 13:17:20.297436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.371319 (+1073883us) service_pool.cc:224] Handling call
0709 13:17:21.371952 (+   633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.411304 (+ 39352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.411544 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.378839  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:21.392804 10181 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:21.418977 10181 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.420609 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.378021 13405 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.425657 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:21.426362 10038 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.424122 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1681) took 1258 ms. Trace:
I20260709 13:17:21.390882 13355 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:21.432849 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 74852.1us
I20260709 13:17:21.413681 13385 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:21.446682 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64652.6us
I20260709 13:17:21.386641 13426 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.465103 10713 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:21.465837 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.476730 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 560) took 1623 ms. Trace:
I20260709 13:17:21.477005 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.477262 10114 rpcz_store.cc:276] 0709 13:17:19.850305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.093507 (+1243202us) service_pool.cc:224] Handling call
0709 13:17:21.173537 (+ 80030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.173933 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:21.298798 (+124865us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.473548 (+174750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.473602 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:21.473650 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.473715 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.473840 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":271874,"raft.queue_time_us":3781,"thread_start_us":277159,"threads_started":2}
I20260709 13:17:21.478307 10115 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
W20260709 13:17:21.478752 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.479103 10180 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:21.479800 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1685) took 1120 ms. Trace:
I20260709 13:17:21.480132 10180 rpcz_store.cc:276] 0709 13:17:20.359852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.395340 (+1035488us) service_pool.cc:224] Handling call
0709 13:17:21.432016 (+ 36676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.479513 (+ 47497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.479709 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.475054 10187 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:21.483678 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:21.467495 13289 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:21.472138 13504 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.489197 10184 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:21.495769 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.493367 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.498579 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.499176 10115 raft_consensus.cc:2410] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:21.500392 10114 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:21.502431 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 567) took 1333 ms. Trace:
I20260709 13:17:21.502796 10114 rpcz_store.cc:276] 0709 13:17:20.169279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.501171 (+1331892us) service_pool.cc:224] Handling call
0709 13:17:21.501650 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.502093 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.502119 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.502183 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:21.502224 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.502282 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.502380 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.504729 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 568) took 1175 ms. Trace:
I20260709 13:17:21.505086 10114 rpcz_store.cc:276] 0709 13:17:20.329595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.503695 (+1174100us) service_pool.cc:224] Handling call
0709 13:17:21.504092 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.504440 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.504464 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.504504 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:21.504532 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.504583 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.504679 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.508291 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 637) took 1408 ms. Trace:
I20260709 13:17:21.503526 13356 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:21.510985 10188 rpcz_store.cc:276] 0709 13:17:20.100370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.090924 (+990554us) service_pool.cc:224] Handling call
0709 13:17:21.181886 (+ 90962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.182221 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.182252 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.182956 (+   704us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.284825 (+101869us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.284863 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.284927 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.508093 (+223166us) raft_consensus.cc:1685] finished
0709 13:17:21.508110 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.508235 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":101413,"threads_started":1,"wal-append.queue_time_us":232286}
W20260709 13:17:21.523289 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45325.7us
I20260709 13:17:21.516602 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.527491 10115 raft_consensus.cc:2410] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:21.524552 10040 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:21.531539 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.532151 10032 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:21.524477 13240 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:21.532846 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:21.533092 13030 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.533519 13240 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.533638 13030 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.535794 13240 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:21.543282 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 108241us
I20260709 13:17:21.551138 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1471) took 1425 ms. Trace:
I20260709 13:17:21.554176 10106 rpcz_store.cc:276] 0709 13:17:20.125654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.215926 (+1090272us) service_pool.cc:224] Handling call
0709 13:17:21.250616 (+ 34690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.349150 (+ 98534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.349184 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.349669 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.466133 (+116464us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:21.466173 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.466254 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.550883 (+ 84629us) raft_consensus.cc:1685] finished
0709 13:17:21.550907 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.551072 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":116071,"threads_started":1,"wal-append.queue_time_us":177516}
I20260709 13:17:21.560040 13444 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:21.560616 13444 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:21.561028 13444 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.562173 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.510537 13289 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.560042 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:21.564308 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:21.564908 13426 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:21.565622 13163 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:21.566702 13382 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.567256 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.567379 13382 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.567871 13382 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.568235 13382 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.568706 10106 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:21.571542 13004 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.572095 10188 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.575320 10188 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:21.576615 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.577354 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 562) took 1706 ms. Trace:
I20260709 13:17:21.578183 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:21.578823 13353 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:21.579792 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:21.582417 13380 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.582245 13289 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:21.584889 13491 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.428591 10183 rpcz_store.cc:276] 0709 13:17:20.166012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.202381 (+1036369us) service_pool.cc:224] Handling call
0709 13:17:21.202836 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.203249 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:21.204856 (+  1607us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.423506 (+218650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.423605 (+    99us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.423682 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.423809 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.424035 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":315,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":61,"raft.queue_time_us":6854,"thread_start_us":196847,"threads_started":1}
I20260709 13:17:21.585738 13149 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.543442 13274 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.554708 10182 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.591259 10108 rpcz_store.cc:276] 0709 13:17:19.870743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.994996 (+1124253us) service_pool.cc:224] Handling call
0709 13:17:21.577165 (+582169us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54000b27d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:21.577295 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720503552}
I20260709 13:17:21.596812 13380 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.552481 13356 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:21.599181 10040 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 7: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:21.550725 13385 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.611979 12995 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:21.600683 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:21.606283 10713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 614) took 2460 ms (client timeout 1671 ms). Trace:
I20260709 13:17:21.613231 13380 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.608759 13356 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.603004 10183 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:21.605453 13491 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:21.622875 10713 rpcz_store.cc:269] 0709 13:17:19.145718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.146427 (+   709us) service_pool.cc:224] Handling call
0709 13:17:21.606034 (+2459607us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54006ad6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:21.606178 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4719417600}
I20260709 13:17:21.632548 10188 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:21.633558 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.628278 10038 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:21.629491 10181 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.645951 10180 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.645206 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.600399 13149 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:21.611863 13516 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:21.652412 13163 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:21.653331 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:21.653920 10183 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:21.656271 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 78286.4us
I20260709 13:17:21.657217 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.657987 13353 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:21.661557 13491 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.662245 13491 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.667866 13274 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:21.668670 13274 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:21.669535 13353 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:21.670827 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 75089.9us
I20260709 13:17:21.672853 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:21.674430 13298 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:21.675429 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 45443us
I20260709 13:17:21.676188 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.678066 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.650002 13252 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:21.679574 13252 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.681777 13252 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.683481 13149 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.652755 13516 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:21.658960 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:21.684633 13149 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.686919 13516 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:21.692327 10181 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.696763 10188 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:21.702050 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47762 (request call id 642) took 1434 ms. Trace:
I20260709 13:17:21.701930 10108 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 5: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:21.702608 10181 rpcz_store.cc:276] 0709 13:17:20.260333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.330468 (+1070135us) service_pool.cc:224] Handling call
0709 13:17:21.695035 (+364567us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":199}
I20260709 13:17:21.695340 13385 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.693102 13420 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.692862 13292 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:21.671482 13382 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:21.703397 10110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1452) took 1834 ms (client timeout 1664 ms). Trace:
W20260709 13:17:21.713518 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 54637.6us
W20260709 13:17:21.711187 10110 rpcz_store.cc:269] 0709 13:17:19.855456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.971358 (+115902us) service_pool.cc:224] Handling call
0709 13:17:21.684993 (+1713635us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000b36d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:21.689451 (+  4458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393270144}
I20260709 13:17:21.704447 13298 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.717928 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.718479 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.718605 13516 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.669757 13274 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.710409 13292 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.727800 10183 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:21.732968 13292 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.736241 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:21.737757 13516 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:21.750586 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.751840 13353 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:21.752858 13353 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.753232 13353 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:21.754293 13353 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.756438 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.757091 10110 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.757488 12995 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.758141 12995 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.758872 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1679) took 1655 ms. Trace:
I20260709 13:17:21.758162 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2689) took 1201 ms. Trace:
I20260709 13:17:21.759217 10185 rpcz_store.cc:276] 0709 13:17:20.103004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.170975 (+1067971us) service_pool.cc:224] Handling call
0709 13:17:21.221978 (+ 51003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.291140 (+ 69162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.291178 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.327431 (+ 36253us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.481458 (+154027us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.481497 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.481572 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.758661 (+277089us) raft_consensus.cc:1685] finished
0709 13:17:21.758680 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.758818 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":107620,"threads_started":1,"wal-append.queue_time_us":356435}
I20260709 13:17:21.760227 10114 rpcz_store.cc:276] 0709 13:17:20.557060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.505916 (+948856us) service_pool.cc:224] Handling call
0709 13:17:21.506274 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.507566 (+  1292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.507595 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.586631 (+ 79036us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.700675 (+114044us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:21.700722 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.700794 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.757892 (+ 57098us) raft_consensus.cc:1685] finished
0709 13:17:21.757922 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.758091 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":80020,"threads_started":1,"wal-append.queue_time_us":132885}
I20260709 13:17:21.761149 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.761906 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.762058 13385 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:21.762564 10114 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:21.763469 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.764217 10114 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:17:21.765280 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.768419 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.764077 13163 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:21.782805 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:21.767693 13426 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.765319 13353 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.770439 13289 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.796162 13289 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:21.798435 13478 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 2.076s	user 0.008s	sys 0.000s
I20260709 13:17:21.798708 13289 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:21.789227 13252 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:21.800547 13252 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.800966 13252 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.757575 13459 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:21.785523 13426 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.807343 13426 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:21.811672 10108 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:21.814333 13382 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.743227 13444 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.816351 12995 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.817749 13444 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:21.820052 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.823984 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.821587 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:21.825328 10109 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.824679 13004 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:21.829303 13539 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:17:21.833122 10110 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:21.834647 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:21.824620 13533 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.324s	user 0.003s	sys 0.000s
I20260709 13:17:21.836416 13292 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.851876 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:21.853102 10114 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:21.854355 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:21.837080 13004 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:21.856781 13426 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.864164 13382 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:21.869570 13504 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:21.878548 13292 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:21.883385 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.883961 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:21.886986 10108 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:21.838632 13420 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:21.888648 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.921774 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1470) took 1793 ms. Trace:
I20260709 13:17:21.890697 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:21.913786 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.880802 13030 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.920533 10114 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:21.873018 13149 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.920876 13504 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.922132 10112 rpcz_store.cc:276] 0709 13:17:20.125302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.209128 (+1083826us) service_pool.cc:224] Handling call
0709 13:17:21.266654 (+ 57526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.326119 (+ 59465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.326154 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.347980 (+ 21826us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.468758 (+120778us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:21.468802 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.468876 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.828432 (+359556us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:21.854468 (+ 26036us) raft_consensus.cc:1685] finished
0709 13:17:21.854488 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.919062 (+ 64574us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16935,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2771,"spinlock_wait_cycles":21269760,"thread_start_us":101610,"threads_started":1,"wal-append.queue_time_us":149925}
I20260709 13:17:21.936749 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:21.970877 10114 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:21.928305 13382 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:21.974256 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 90425.5us
I20260709 13:17:21.933641 13420 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:21.934516 13458 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.936496 13004 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.977799 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:21.971524 13030 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.988417 13030 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.989213 13341 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.989711 13341 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.990674 13030 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:21.970001 13149 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.987520 10108 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:21.992668 13252 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:21.994726 13149 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:21.980943 12995 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.995734 12995 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:21.996181 13252 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:21.986222 13385 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:21.997203 13385 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.997575 13385 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.998169 13491 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.998762 13491 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.000567 13382 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.001353 13380 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.003137 13491 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.003984 12995 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.005873 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:22.006449 10115 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.009197 13420 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.009865 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 565) took 2083 ms. Trace:
I20260709 13:17:21.988019 13379 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.010269 10107 rpcz_store.cc:276] 0709 13:17:19.926509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.194383 (+1267874us) service_pool.cc:224] Handling call
0709 13:17:21.194724 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.204198 (+  9474us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:21.420026 (+215828us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.529914 (+109888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.529963 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:21.536427 (+  6464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.009517 (+473090us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b54001bec54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:22.009562 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.009695 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27002,"prepare.queue_time_us":284414,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":91,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":21127552,"thread_start_us":295774,"threads_started":2,"wal-append.queue_time_us":284837}
I20260709 13:17:21.996344 13459 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:22.012241 13459 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.014480 13459 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.017379 10115 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:21.971437 13163 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:22.019897 10109 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:22.025710 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:22.033605 13030 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:22.036087 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:21.979092 13458 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:22.036522 10188 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:22.038403 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.038712 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1694) took 1050 ms. Trace:
I20260709 13:17:22.039335 13371 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:22.039793 13004 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.040024 13312 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:22.047271 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.066382 10185 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:22.048050 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:22.049131 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 61861.6us
I20260709 13:17:22.036005 10189 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:22.052557 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:22.055272 13537 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.379s	user 0.004s	sys 0.000s
I20260709 13:17:22.027992 10113 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:21.967365 13426 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.036670 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.062656 10187 rpcz_store.cc:276] 0709 13:17:20.990722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.499714 (+508992us) service_pool.cc:224] Handling call
0709 13:17:21.516161 (+ 16447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.626798 (+110637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.626831 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.651458 (+ 24627us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.932578 (+281120us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.932622 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.938152 (+  5530us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.038518 (+100366us) raft_consensus.cc:1685] finished
0709 13:17:22.038536 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.038655 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4131,"raft.queue_time_us":509,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":228787,"threads_started":1,"wal-append.queue_time_us":341176}
I20260709 13:17:22.028641 13405 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.086856 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.084370 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:22.068372 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:22.085809 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:22.086236 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.113592 10716 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.062407 13458 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:22.119702 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 119082us
I20260709 13:17:22.116834 10711 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 5.
I20260709 13:17:22.123114 10708 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:22.069729 13312 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.121376 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.123368 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:22.125648 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:22.124521 10114 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
W20260709 13:17:22.128063 10111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1429) took 2569 ms (client timeout 1810 ms). Trace:
W20260709 13:17:22.128456 10111 rpcz_store.cc:269] 0709 13:17:19.558908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.559116 (+   208us) service_pool.cc:224] Handling call
0709 13:17:22.123230 (+2564114us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540010e0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:22.127975 (+  4745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471091072}
I20260709 13:17:22.126531 13240 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.130185 13240 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.130544 13240 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.131909 13274 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.025206 13385 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.134207 13385 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.134770 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:22.136138 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65980.9us
I20260709 13:17:22.132217 13293 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.140901 10716 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:22.112650 13252 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.113623 13030 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.123236 13371 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.087363 13298 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:22.148571 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:22.149250 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:22.150782 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.153395 10714 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.154307 10182 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.152694 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.158028 10185 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
W20260709 13:17:22.156302 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70142.8us
I20260709 13:17:22.160941 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:22.161571 10713 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:22.158902 10714 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:22.163280 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47762 (request call id 641) took 2045 ms. Trace:
I20260709 13:17:22.163659 10182 rpcz_store.cc:276] 0709 13:17:20.112919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.192631 (+1079712us) service_pool.cc:224] Handling call
0709 13:17:22.148270 (+955639us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54001883d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4dfa3d 00007f3c744afcd0 00007f3c6da34254 00007f3c6da341e2 00007f3c6da34111 00007f3c6da3408c 00007f3c6da33342 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:22.158055 (+  9785us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154249600}
I20260709 13:17:22.164739 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.166621 10712 raft_consensus.cc:2368] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7.
I20260709 13:17:22.167454 10182 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:22.153890 13293 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:22.168229 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 142784us
I20260709 13:17:22.119535 13004 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.029923 13163 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:22.169188 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 43609.1us
I20260709 13:17:22.142443 13405 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.180636 10187 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:22.180500 13292 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.181433 13292 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.183851 10181 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:22.185178 10181 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.185930 13252 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.188432 13252 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.188719 13426 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.188836 13456 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.192148 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:22.197800 10182 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.197881 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.198993 10188 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:22.196132 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.154064 13274 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.234617 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:22.237555 13553 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:22.242210 10183 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.245170 13405 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.253800 13521 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:22.254254 13521 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:22.256814 13430 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:22.257278 13430 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:22.258404 13430 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.259464 13430 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.261384 13371 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:22.263175 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 135642us
W20260709 13:17:22.289265 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 109616us
W20260709 13:17:22.289963 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 121121us
I20260709 13:17:22.293129 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:22.294188 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.222750 10714 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.224751 13456 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.299638 10033 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:22.307303 10186 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:22.302979 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 152819us
I20260709 13:17:22.310079 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.320595 10033 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:22.321619 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:22.320529 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.322782 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.310389 10039 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:22.324131 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:22.324818 10037 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:22.325273 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.325838 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:22.326269 13379 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.310509 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.326840 13379 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:22.255155 13521 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.326383 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.226409 13289 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:17:22.311281 10040 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:22.327862 13379 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.328598 13521 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.329151 13252 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.329684 13252 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.330062 13252 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.312137 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.312279 13030 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.327703 10036 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.332183 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.295262 13293 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.332479 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.332858 13293 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.323067 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.334517 10033 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:22.334935 13293 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.304057 13371 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.312916 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.335595 13371 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.313259 13455 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.314126 10038 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:22.314630 13312 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.336041 13371 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.336628 13289 consensus_queue.cc:1243] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:22.337167 13289 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:22.337481 13289 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:22.337702 13312 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.338678 13455 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.340340 10185 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 4.
I20260709 13:17:22.233474 13444 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:22.340323 13289 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.342397 13289 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.342772 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.343393 10114 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:22.335844 10111 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:22.315984 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.344156 13252 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.316737 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.345438 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.346164 13252 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.317050 13240 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.317273 13353 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.326591 10039 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.319273 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:22.319918 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.346997 10038 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:22.310200 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.328579 13565 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.339861 13149 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.379685 10032 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:22.380188 13341 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.326571 10037 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:17:22.317761 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.381561 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.297037 13456 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.376951 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:22.386093 10183 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.377166 10186 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:22.377381 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:22.378103 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:22.387126 10111 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.233291 13292 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:17:22.386184 10114 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.387179 10712 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:22.382332 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89293.5us
I20260709 13:17:22.378468 10109 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:22.342303 10714 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.394104 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.394726 10183 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:22.395485 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.396154 10184 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:22.410883 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:22.411602 10713 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:22.376151 13312 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:22.412474 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.324060 13380 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:22.341109 13004 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:22.416679 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.427194 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.348568 13298 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:22.421890 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:22.432962 10107 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.388911 13456 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.425668 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.436251 10186 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:22.384411 13385 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:22.430765 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.434595 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:22.431402 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 118463us
I20260709 13:17:22.438721 10108 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:22.425217 13293 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:22.448848 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:22.327773 13563 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:17:22.453951 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.420713 13353 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:22.300180 13426 consensus_queue.cc:1175] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 12 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:22.347491 13356 consensus_queue.cc:1175] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a67604b91f54791b1316fd327793337" responder_term: 10 status { last_received { term: 7 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:22.391577 13382 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:17:22.448799 13293 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.439427 13380 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:22.434810 13312 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:22.421218 13444 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:17:22.451459 13292 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:22.475087 10111 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:22.508653 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:22.506513 10113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2692) took 1942 ms (client timeout 1529 ms). Trace:
I20260709 13:17:22.514977 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.476248 13501 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.518220 10111 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
W20260709 13:17:22.511994 10113 rpcz_store.cc:269] 0709 13:17:20.563887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.580878 (+ 16991us) service_pool.cc:224] Handling call
0709 13:17:22.475080 (+1894202us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000b5254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:22.506432 (+ 31352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305744640}
I20260709 13:17:22.479487 10712 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:22.504161 13293 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:22.527468 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.522570 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:22.482060 13371 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.535100 13371 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.543996 13252 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:22.544624 13252 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:22.558182 10114 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:22.559600 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.457016 13385 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:22.561607 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 214988us
I20260709 13:17:22.565491 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.567966 10108 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 7: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:22.569188 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 250022us
I20260709 13:17:22.572939 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:22.573313 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.574818 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.575141 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:22.574851 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:22.575923 10716 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:22.576496 10708 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:22.575631 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:22.579480 10039 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:22.561403 13298 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.578500 10710 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:22.583487 13274 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.584106 13274 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:22.584450 13274 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:22.507922 13405 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:17:22.585158 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:22.586817 13240 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.586979 10711 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:22.587703 13312 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.588724 13420 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:22.589150 13420 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:22.589515 13420 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:22.591100 13558 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:22.591888 13568 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:22.585206 13274 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.593866 13149 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.594041 13274 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.577121 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:22.595510 10707 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 7: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:22.598001 13149 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:22.598973 13149 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.599936 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2483) took 1246 ms. Trace:
W20260709 13:17:22.547266 13504 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:17:22.600679 13504 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:22.602718 13504 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:22.604375 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.610286 10107 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:22.568579 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.614748 10714 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
W20260709 13:17:22.618275 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 226907us
I20260709 13:17:22.622857 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.623641 10111 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:22.625264 10107 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:22.614431 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.521040 13501 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.639926 13501 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.640729 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.642161 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:22.642895 10108 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:22.643595 10038 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.600186 13149 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.629729 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:22.655421 10182 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.636670 13371 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:22.636916 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.632586 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.637425 13247 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.639014 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:22.634676 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:22.653316 10107 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:22.660149 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:22.698872 10712 raft_consensus.cc:2376] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6. Re-sending same reply.
W20260709 13:17:22.664562 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.684981 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 215387us
I20260709 13:17:22.617568 13567 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.653770 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:22.614486 13355 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.592597  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:22.600345 10035 rpcz_store.cc:276] 0709 13:17:21.353550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.027376 (+673826us) service_pool.cc:224] Handling call
0709 13:17:22.027832 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.028139 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.028163 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.028678 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.154455 (+125777us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:22.161626 (+  7171us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.392371 (+230745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.392444 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.597775 (+205331us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b180002c320. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:22.599570 (+  1795us) raft_consensus.cc:1685] finished
0709 13:17:22.599688 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.599870 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7017,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":95,"raft.queue_time_us":61933,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":36995,"spinlock_wait_cycles":135617280,"thread_start_us":343952,"threads_started":2,"wal-append.queue_time_us":192452}
I20260709 13:17:22.707423 10189 raft_consensus.cc:2410] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:22.626653 13558 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:22.617811 13504 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.701094 10038 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:22.701974 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 69469us
I20260709 13:17:22.687621 10113 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:22.705655 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:22.716933 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 63255.8us
W20260709 13:17:22.723765 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.613978 13293 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.719596 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:22.714705 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:22.696092 13565 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:22.742268 10186 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:22.742245 10038 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:17:22.744123 10038 pending_rounds.cc:85] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
I20260709 13:17:22.744441 10038 pending_rounds.cc:107] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:22.744899 10038 raft_consensus.cc:2889] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:22.746336 10182 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:22.746613 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.713894 13353 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:22.706254 13554 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.749809 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:22.751128 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:22.762562 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:22.779891 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.783877 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.574304 13380 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.786106 10114 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 6: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:22.696762 13341 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:17:22.797925 10180 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:22.716101 13504 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.645795 13252 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.706202 13371 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.741726 13558 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:22.748060 13567 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:22.763906 13554 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.742560 13459 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:17:22.836572 13279 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.837186 13567 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.837772 13030 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.747327 13355 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.814225 13430 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:22.838187 13436 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:22.843196 13241 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:17:22.711971 13247 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.786032 13379 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:22.846303 10115 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:22.803732 13504 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.862198 13444 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.864228 10040 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:22.881541 10040 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:22.868566 13382 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.843994 13554 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.852720 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.820272 13570 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:22.847283 13521 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.003s
W20260709 13:17:22.875042 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 155540us
I20260709 13:17:22.898977 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:22.900569 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:22.901753 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:22.879653 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 237755us
I20260709 13:17:22.866540 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1474) took 1647 ms. Trace:
I20260709 13:17:22.885749 13581 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.886543 13566 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:22.872218 13455 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:22.890221 13458 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.003s
I20260709 13:17:22.976756 13458 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.977865 13578 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:22.978968 13458 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.979257 13576 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
W20260709 13:17:22.895112 13289 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:17:22.980216 10187 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.981050 13355 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.981235 13580 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:22.982374 13247 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:22.982949 13247 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.918955 10106 rpcz_store.cc:276] 0709 13:17:21.219040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.569738 (+350698us) service_pool.cc:224] Handling call
0709 13:17:22.497149 (+927411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.497359 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.497384 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.497428 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.497458 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.497513 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.866312 (+368799us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54000b5250. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:22.866463 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132129536}
I20260709 13:17:22.986315 13293 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:22.975481 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 69348.1us
I20260709 13:17:22.987838 13584 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:17:22.896848 13292 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:17:22.990052 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:22.991454 13566 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.977010 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:22.911867 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.884814 13444 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.992501 13247 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.992957 13247 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.993319 13247 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.942816 13570 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.993104 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:22.994292 13444 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:22.994700 13455 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.995265 13455 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:22.997364 13455 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.997953 13570 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:23.003461 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:23.002475 13570 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:23.005939 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.006404 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.008286 13456 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.003s
I20260709 13:17:23.008687 13456 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.009507 13430 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:22.966833 13385 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:23.011042 13163 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:22.879592 13379 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:23.012202 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44287.2us
I20260709 13:17:23.009846 10109 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:22.979967 13574 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 13:17:23.005246 13371 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:22.883157 13436 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:23.007229 13004 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:22.916189 13521 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:22.894840 13382 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:22.994822 13444 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.942587 13577 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:23.011480 13163 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:23.004006 13583 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.893227 13353 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.009923 13430 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:23.016775 13566 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.918550 13459 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:17:22.888115 13565 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.047075 13521 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.011535 13554 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.050406 13577 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.081369 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:23.046389 13371 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:22.974452 13558 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:23.324357 13586 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:17:23.340677 13574 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:23.341123 13574 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:23.226643 13149 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.126119 13566 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:23.342074 13574 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.343238 13574 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.158798 13587 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.328s
I20260709 13:17:23.346123 13587 consensus_queue.cc:1243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:23.226334 13591 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.293s
I20260709 13:17:23.162047 13436 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.087606 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:23.350080 10113 raft_consensus.cc:2410] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:17:23.093353 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.085667 13379 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:23.087220 13504 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.085636 13385 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:23.089510 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:23.356051 13385 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.356978 13504 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.298770 13163 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.134608 13355 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.359122 13163 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.358989 13355 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.132846 13458 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.361184 13458 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.363246 13458 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.088701 13382 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:23.081317 13521 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.355540 13577 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.050356 13444 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.358177 13385 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:23.398412 10114 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:23.415076 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.017s
I20260709 13:17:23.384366 13456 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:23.417297 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.017s
W20260709 13:17:23.414366 10081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.002s	sys 0.014s
W20260709 13:17:23.419710 10081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.002s	sys 0.014s
W20260709 13:17:23.420603 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 675662us
W20260709 13:17:23.420854 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 658355us
I20260709 13:17:23.379626 13004 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:23.413640 13581 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.420286 10078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.018s	sys 0.031s
W20260709 13:17:23.439391 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.012s	sys 0.008s
W20260709 13:17:23.439759 10078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.018s	sys 0.031s
W20260709 13:17:23.444885 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 550719us
W20260709 13:17:23.449213 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.424772 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.020s	sys 0.020s
W20260709 13:17:23.449717 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.020s	sys 0.021s
W20260709 13:17:23.449993 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 548288us
I20260709 13:17:23.343241 13566 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.430514 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:23.452394 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:23.452929 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.013s	sys 0.008s
I20260709 13:17:23.455454 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:23.424198 13584 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.406358 13149 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:23.461356 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.464617 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.457549 13030 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.466454 13030 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.469491 13030 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.470053 13298 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:23.470466 13298 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:23.471861 13405 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:23.472404 13405 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.473351 13149 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.474931 13405 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.471199 13298 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.476327 13298 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:23.477125 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46735us
I20260709 13:17:23.477684 13599 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:23.479979 13599 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.482239 13599 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.479307 13293 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.487342 10038 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:23.489818 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.443843 13581 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.493358 10038 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:23.497871 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.455799 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:23.441687 13567 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.500696 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:23.501261 10037 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.501776 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:23.509097 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.509898 10032 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:23.507181 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:23.457736 13355 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:23.513044 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:23.511998 10035 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:23.493573 13581 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:23.514806 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 473716us
W20260709 13:17:23.518989 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 779216us
I20260709 13:17:23.508347 13456 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.523336 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.511353 13574 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.525301 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.526609 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.535095 10036 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
W20260709 13:17:23.527302 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71604.6us
I20260709 13:17:23.538549 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:23.534950 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2717) took 1138 ms. Trace:
I20260709 13:17:23.540251 10112 rpcz_store.cc:276] 0709 13:17:22.396882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.397006 (+   124us) service_pool.cc:224] Handling call
0709 13:17:22.425675 (+ 28669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.731284 (+305609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.731315 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.782784 (+ 51469us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.281800 (+499016us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:23.281841 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.281922 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.534710 (+252788us) raft_consensus.cc:1685] finished
0709 13:17:23.534731 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.534888 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90168,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"thread_start_us":777920,"threads_started":2,"wal-append.queue_time_us":728881}
W20260709 13:17:23.515715 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 460294us
I20260709 13:17:23.532164 13554 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.532346 13592 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:23.532665 13587 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:23.528585 10031 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:23.559383 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:23.506479 13252 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:17:23.563885 10114 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.561105 10111 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
W20260709 13:17:23.566910 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 43821.3us
I20260709 13:17:23.524251 13274 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.577998 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.578866 10034 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:23.563397 13030 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.515074 13584 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.610262 10114 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:23.614090 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:23.540598 13456 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.615778 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:23.584767 13592 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:23.620792 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:23.621285 13501 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.981s	user 0.012s	sys 0.000s
I20260709 13:17:23.583364 13149 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:17:23.563674 13574 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:23.682837 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 106233us
I20260709 13:17:23.586457 13274 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.624610 13444 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:23.721114 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 162995us
I20260709 13:17:23.616082 13163 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:17:23.722962 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:23.683727 13558 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.616696 13426 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:17:23.621838 13436 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.625372 13405 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.619984 13459 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:17:23.745466 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:23.745478 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:23.616300 13596 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:17:23.745661 13405 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:23.749974 13603 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:23.750730 13405 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.751181 13603 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.752557 13611 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.753022 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:23.720131 13247 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.002s
W20260709 13:17:23.769155 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 148501us
W20260709 13:17:23.739454 10079 leader_election.cc:336] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Timed out: RequestConsensusVote RPC to 127.8.186.196:41001 timed out after 1.671s (SENT)
I20260709 13:17:23.740365 13554 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.778616 13274 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.745285 13608 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.781101 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:23.751786 13603 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.635203 13501 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.590332 13587 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.804297 13587 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.742375 13355 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:23.805430 13355 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.806746 10185 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:23.810767 13355 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.773602 13247 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.816817 10183 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:23.822503 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:23.823179 10037 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:23.792244 13554 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:23.824415 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 99464.1us
I20260709 13:17:23.824786 13501 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.824561 13554 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.827879 13247 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:23.831616 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:23.832305 10114 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.771154 13558 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.833909 13615 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.834494 13615 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:23.835268 13420 consensus_meta.cc:287] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.245s	user 0.014s	sys 0.003s
I20260709 13:17:23.835688 13420 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:23.837815 10184 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 5.
W20260709 13:17:23.855254 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 78726.1us
I20260709 13:17:23.874663 10114 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:23.875953 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:23.821054 13570 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:23.800073 13596 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:23.889075 13615 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.890173 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:23.892504 13456 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:23.893186 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:23.796461 13608 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.018432 10114 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:24.048005 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 277812us
I20260709 13:17:24.053644 10187 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:23.896471 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.035360 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:23.920145 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:24.056985 10181 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:24.058211 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 260815us
I20260709 13:17:24.059517 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 572) took 1683 ms. Trace:
I20260709 13:17:24.059845 10115 rpcz_store.cc:276] 0709 13:17:22.375965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.376106 (+   141us) service_pool.cc:224] Handling call
0709 13:17:22.392062 (+ 15956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.876338 (+484276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.059342 (+1183004us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400362754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:24.059470 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040192896}
I20260709 13:17:24.044565 13420 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:23.901085 13628 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.883051 13458 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.061375 13628 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:24.061596 13458 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.062410 13628 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.064482 13458 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:24.051656 10079 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.196:41001 timed out after 2.029s (SENT) [suppressed 35 similar messages]
I20260709 13:17:24.069373 10186 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:24.064627 13578 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:23.799417 13592 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.069583 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.068859 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:24.073836 10180 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:24.068040 13149 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:24.080330 13149 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.081501 13558 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:24.082265 13608 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.082474 13149 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.082688 13574 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:24.083658 13630 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 13:17:24.085206 13622 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:24.085749 13603 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:23.884703 13617 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:17:24.076889 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 180531us
I20260709 13:17:24.076998 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:24.062353 13626 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:24.112332 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.112191 10079 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:24.113284 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.079689 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.007536 13356 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.902973 13577 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.537s	user 0.004s	sys 0.004s
I20260709 13:17:24.114437 10187 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:23.883342 13385 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.063689 13611 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:24.131232 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.131250 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.138098 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.077277 13578 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:24.090060 13420 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:24.106709 13570 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.137038 10707 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 5.
I20260709 13:17:24.142902 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.148900 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:24.145062 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.149538 10115 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:24.151880 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.152542 10187 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:24.153443 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.154004 10187 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:24.154946 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.155462 10187 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:24.138783 10180 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:24.145717 13274 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.146438 13633 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:24.130939 13456 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.115487 13405 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:24.166723 10155 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.726s (SENT)
I20260709 13:17:24.192543 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:24.133667 13444 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:24.188539 10181 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:24.092113 13609 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:17:24.091189 13163 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:24.193922 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.190761 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.200049 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.205006 10181 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:24.205826 10180 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:24.206344 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.207113 10711 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:24.119375 13149 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.157801 13570 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:24.198691 13521 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.834s	user 0.004s	sys 0.010s
I20260709 13:17:24.228688 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.115046 13608 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:17:24.194583 13456 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.145133 13385 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.204944 13444 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.231727 10714 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:24.136988 13356 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.232191 10707 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:24.232719 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.235443 10106 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:24.252614 10710 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:24.140406 13577 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.237749 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71060us
I20260709 13:17:24.225566 13570 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.238806 10180 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:24.239063 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.239837 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.239893 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.258041 10709 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:24.243187 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.259121 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.258008 10716 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:24.259721 10709 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:24.260583 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.260602 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.262033 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.262881 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.194844 13274 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.265820 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.266601 10715 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:24.164619 13420 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:24.256388 10155 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.803s (SENT)
I20260709 13:17:24.234301 13426 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.277158 10710 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 6.
I20260709 13:17:24.263238 10181 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:24.227182 13603 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:24.245472 13456 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:24.281937 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 125287us
I20260709 13:17:24.282089 13642 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.283614 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:24.252565 13444 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.283845 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:24.289894 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 175825us
I20260709 13:17:24.282647 13603 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.244221 13521 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.284281 13252 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.198622 13578 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.309734 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.189090 13584 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:24.316107 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59758.5us
I20260709 13:17:24.320709 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.321676 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.282405 13247 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:17:24.322736 10716 raft_consensus.cc:2410] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:24.285666 13279 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:24.309140 13603 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.309303 13638 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.285379 13426 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.332518 10155 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.500s (SENT)
I20260709 13:17:24.334748 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:24.296060 13642 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.344043 10709 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:24.337520 13578 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.349330 10040 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.350502 13356 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.352835 13641 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.357297 13426 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.359634 13521 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:24.361503 13642 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.333807 13459 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:17:24.348168 13647 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:24.372473 13420 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:24.373028 13644 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:17:24.374600 13603 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.380764 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.380920 10040 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.399930 13385 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:24.401218 10040 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:24.401880 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1718) took 2082 ms. Trace:
I20260709 13:17:24.402522 10180 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:24.405418 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:24.405982 10180 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:24.408550 13643 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:24.379436 13641 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.410360 13641 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.411866 13603 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:24.381767 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 98249.9us
I20260709 13:17:24.413344 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:24.414640 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.415366 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.402184 10040 rpcz_store.cc:276] 0709 13:17:22.319340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.330398 (+ 11058us) service_pool.cc:224] Handling call
0709 13:17:22.330656 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.864108 (+533452us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400014b20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45fdc0 00007f3c6f4ea1c0 00007f3c6f4eb231 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c
0709 13:17:24.342192 (+1478084us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400014b20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f46606f 00007f3c6f4def60 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62
0709 13:17:24.401611 (+ 59419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.401822 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441492736}
I20260709 13:17:24.386392 13647 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:24.420286 13647 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.424275 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.426679 10180 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
W20260709 13:17:24.402113 13575 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:17:24.429575 13652 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:24.430194 13652 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:24.430621 13652 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.431216 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:24.436126 13657 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.436520 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.436793 13657 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.387218 13642 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:24.442968 13642 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.443420 13642 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.407267 13570 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.455998 10184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 667) took 2012 ms (client timeout 1605 ms). Trace:
W20260709 13:17:24.456473 10184 rpcz_store.cc:269] 0709 13:17:22.443545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.944261 (+500716us) service_pool.cc:224] Handling call
0709 13:17:24.455789 (+1511528us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400097254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:24.455911 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1944243072}
I20260709 13:17:24.468531 13456 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.469086 13616 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.697s	user 0.004s	sys 0.011s
I20260709 13:17:24.473417 10115 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.437417 13657 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.486215 13656 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.486778 13656 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.487206 13149 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:24.487661 13149 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.488031 13149 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.487231 13656 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.497143 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 795) took 1441 ms. Trace:
I20260709 13:17:24.497632 10713 rpcz_store.cc:276] 0709 13:17:23.055838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.074489 (+ 18651us) service_pool.cc:224] Handling call
0709 13:17:23.088888 (+ 14399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.125381 (+ 36493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.125416 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.163336 (+ 37920us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.562983 (+399647us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:23.563026 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.563096 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.468383 (+905287us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:24.496808 (+ 28425us) raft_consensus.cc:1685] finished
0709 13:17:24.496828 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.497071 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33835,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"spinlock_wait_cycles":7040768,"thread_start_us":249162,"threads_started":1,"wal-append.queue_time_us":398382}
I20260709 13:17:24.504782 13430 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.506074 13430 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.511631 13580 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.512444 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:24.512365 13580 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:24.516587 13611 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:24.516817 13580 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.513960 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:24.521992 10679 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:24.523362 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.523989 13279 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:24.524475 13611 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:24.526342 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89991.7us
I20260709 13:17:24.527118 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:24.467523 13444 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.544746 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 235077us
I20260709 13:17:24.530177 13279 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.547061 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:24.533267 13341 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:24.551712 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 842189us
I20260709 13:17:24.541173 13611 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:24.558375 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 265852us
I20260709 13:17:24.548842 13279 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.550555 13341 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.574252 10713 raft_consensus.cc:1217] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Deduplicated request from leader. Original: 7.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:17:24.574892 10713 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:24.578743 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.549587 13566 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:17:24.581037 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.583246 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.584468 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.585099 10711 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:24.569386 13341 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.590452 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.591336 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.593384 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:24.589890 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.595088 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.595312 10040 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:24.597007 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.600255 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1724) took 1103 ms. Trace:
I20260709 13:17:24.587412 13660 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:24.609277 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.608809 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:24.610616 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.562064 13647 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.615703 13661 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.617334 13658 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.614053 10004 connection.cc:256] RPC call timeout handler was delayed by -1.9441549369998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:17:24.620293 13566 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.621253 13620 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.845s	user 0.002s	sys 0.013s
I20260709 13:17:24.593173 13652 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.587442 13456 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:24.661652 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:24.662801 10035 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:24.600768 10039 rpcz_store.cc:276] 0709 13:17:23.496822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.496935 (+   113us) service_pool.cc:224] Handling call
0709 13:17:23.508507 (+ 11572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.508729 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:23.512959 (+  4230us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.585475 (+ 72516us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.502164 (+916689us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b1800116800. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb557 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:24.525051 (+ 22887us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b1800116800. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:17:24.599630 (+ 74579us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.599690 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:24.599769 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.600071 (+   302us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.600189 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131226,"prepare.queue_time_us":8491,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3191,"raft.queue_time_us":1008490,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":14806,"spinlock_wait_cycles":167526272,"thread_start_us":128356,"threads_started":2,"wal-append.queue_time_us":90530}
I20260709 13:17:24.654994 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:24.651295 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1390) took 2038 ms. Trace:
I20260709 13:17:24.677208 10183 rpcz_store.cc:276] 0709 13:17:22.618150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.634378 (+ 16228us) service_pool.cc:224] Handling call
0709 13:17:24.651078 (+2016700us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000b4fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:24.651235 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572397952}
I20260709 13:17:24.587685 13521 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:24.658926 10040 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:24.669502 10004 connection.cc:256] RPC call timeout handler was delayed by -1.888354937000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:17:24.685967 10004 connection.cc:256] RPC call timeout handler was delayed by -1.6210549369998262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:17:24.686322 10004 connection.cc:256] RPC call timeout handler was delayed by -1.4212549369999579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:17:24.669767 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:24.668450 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 106941us
I20260709 13:17:24.648833 13661 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:24.655107 10188 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:24.615945 13612 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:17:24.677219 10033 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.612831 13149 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.718896 10033 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:24.671015 13570 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:24.667572 13664 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:24.727103 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 167786us
I20260709 13:17:24.727103 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:24.728495 13662 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.685113 13247 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.740056 10111 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:24.607821 13611 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.735914 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 1.14758e+06us
I20260709 13:17:24.737104 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:24.737807 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 190834us
I20260709 13:17:24.673179 13566 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.744097 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.708338 13661 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.624398 13660 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.723928 13444 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:24.761969 10707 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:24.735889 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:24.751993 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:24.755467 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:24.737481 13664 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.737320 13584 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.771327 13584 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.772342 13664 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.773528 13584 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.775157 13570 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:24.775758 13570 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:24.776068 13603 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.776862 13668 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:24.776716 13570 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.777415 13668 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:24.778328 13668 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.781041 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:24.781895 10109 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:24.782893 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:24.784019 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:24.785205 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.776633 13603 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.785933 10037 raft_consensus.cc:2368] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:24.673519 13658 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.710446 13521 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.768817 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.798038 13673 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:24.799433 13521 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.801018 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:24.768889 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.770535 13608 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:24.785261 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:24.803834 10107 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:24.763805 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:24.804898 10113 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:24.805714 10707 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:24.807430 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.808336 10707 raft_consensus.cc:2368] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:24.808917 13652 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.795182 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.738225 13430 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:24.738819 13641 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.797214 13149 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.805778 13647 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:24.794484 13653 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:17:24.783494 10109 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:24.918787 13610 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.329s	user 0.008s	sys 0.022s
I20260709 13:17:24.902626 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.809121 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.915849 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:24.833997 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.785910 10106 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:24.921823 10708 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:24.854447 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.930365 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.931043 10710 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.932076 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:24.933050 10037 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
W20260709 13:17:24.937444 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 226316us
I20260709 13:17:24.945624 10040 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:24.956811 13341 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:24.959231 10715 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:24.962746 13641 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.963554 10111 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:24.861317 13642 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:24.965158 13636 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.654s	user 0.002s	sys 0.000s
I20260709 13:17:24.966126 10112 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.880980 13656 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:24.926218 13566 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:24.969213 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1397) took 1095 ms. Trace:
I20260709 13:17:24.969679 10182 rpcz_store.cc:276] 0709 13:17:23.874118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.888216 (+ 14098us) service_pool.cc:224] Handling call
0709 13:17:23.888612 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.054927 (+166315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.054959 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.061366 (+  6407us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.138682 (+ 77316us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:24.138722 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.138789 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.964522 (+825733us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:24.968902 (+  4380us) raft_consensus.cc:1685] finished
0709 13:17:24.968925 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.969128 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189243,"raft.queue_time_us":184063,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8546,"spinlock_wait_cycles":7034624,"thread_start_us":76915,"threads_started":1,"wal-append.queue_time_us":158526}
I20260709 13:17:24.969241 10114 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:24.956813 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.978727 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.001586 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.002346 10039 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.803949 13667 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:25.003330 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:24.927563 13660 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:24.769045 13574 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.232s
I20260709 13:17:25.540016 13641 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.545441 13667 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.545864 13641 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.547935 13667 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.548570 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:25.262961 13371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.012s	sys 0.009s
W20260709 13:17:25.549507 13371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.018s	sys 0.034s
W20260709 13:17:25.269027 10038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.001s	sys 0.026s
I20260709 13:17:25.549824 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:25.550146 10038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.008s	sys 0.040s
I20260709 13:17:25.549788 13641 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.091178 10710 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:25.065524 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.553275 10040 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:25.352280 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.266806 10036 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.016s
W20260709 13:17:25.555429 10036 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.017s	sys 0.021s
I20260709 13:17:25.019851 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.557126 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:25.557933 10113 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:25.561296 10037 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:25.314141 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 592) took 1091 ms. Trace:
I20260709 13:17:25.562810 10115 rpcz_store.cc:276] 0709 13:17:24.223015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.223534 (+   519us) service_pool.cc:224] Handling call
0709 13:17:24.244970 (+ 21436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.482001 (+237031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.313818 (+831817us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002b7d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:25.314052 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524866944}
W20260709 13:17:25.569304 10708 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.004s
I20260709 13:17:25.569893 10708 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:25.570993 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:25.576040 13567 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.968833 13656 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:25.347771 13240 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.000s	sys 0.031s
I20260709 13:17:25.584633 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:25.482492 13676 log.cc:927] Time spent T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:17:25.593612 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:25.594390 10712 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:25.594453 10039 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.002s
I20260709 13:17:25.594991 10039 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:25.595242 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.596086 10040 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:25.596046 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.596977 10039 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:25.599152 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:25.580363 13570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.014s	sys 0.004s
I20260709 13:17:25.292951 13430 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.601755 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:25.454901 13658 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.550987 13668 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.611238 10106 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:17:25.588099 13240 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.000s	sys 0.051s
I20260709 13:17:25.612650 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 523) took 1022 ms. Trace:
W20260709 13:17:25.614112 10713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.004s	sys 0.020s
I20260709 13:17:25.602978 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:25.626073 10713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.020s
W20260709 13:17:25.626546 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.622838 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:25.597985 13279 consensus_meta.cc:287] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 1.023s	user 0.008s	sys 0.003s
W20260709 13:17:25.627247 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.653575 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.624519 10032 rpcz_store.cc:276] 0709 13:17:24.589854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.597475 (+  7621us) service_pool.cc:224] Handling call
0709 13:17:24.622932 (+ 25457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.651774 (+ 28842us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:24.725223 (+ 73449us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.003603 (+278380us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.067375 (+ 63772us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.067592 (+   217us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.074380 (+  6788us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.577906 (+503526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.577989 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.612419 (+ 34430us) raft_consensus.cc:1685] finished
0709 13:17:25.612441 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.612585 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508899,"prepare.queue_time_us":228420,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":502796,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":19774,"thread_start_us":331466,"threads_started":2,"wal-append.queue_time_us":820370}
I20260709 13:17:25.626374 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.587090 13660 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.592051 13641 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.611569 13570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.014s	sys 0.004s
I20260709 13:17:25.610762 13656 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.169902 13664 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.626910 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.681084 10037 raft_consensus.cc:2376] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11. Re-sending same reply.
I20260709 13:17:25.642503 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.654954 10040 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.656790 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 524) took 1066 ms. Trace:
I20260709 13:17:25.656032 13576 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.668675 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.710050 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.711390 10106 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:25.712587 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.713276 10037 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.712579 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:25.714623 10106 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:25.622676 13430 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.671773 10712 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:25.581465 13567 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.618058 13642 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:25.609840 13298 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:25.627885 10708 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:25.720592 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.663905 13641 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.736450 10040 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:25.679848 13656 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.628367 13668 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.676585 13341 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.683264 13279 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.721720 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.747184 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1741) took 1089 ms. Trace:
W20260709 13:17:25.732365 13657 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.198s	user 0.009s	sys 0.004s
I20260709 13:17:25.742024 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.673745 13660 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.747570 10039 rpcz_store.cc:276] 0709 13:17:24.657955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.700072 (+1042117us) service_pool.cc:224] Handling call
0709 13:17:25.747112 (+ 47040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.749923 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 525) took 1159 ms. Trace:
I20260709 13:17:25.741907 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.723553 13667 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:25.752756 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2505) took 1064 ms. Trace:
I20260709 13:17:25.753883 10040 rpcz_store.cc:276] 0709 13:17:24.688311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.741587 (+1053276us) service_pool.cc:224] Handling call
0709 13:17:25.752692 (+ 11105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.709885 13576 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.737958 13459 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:25.757082 10037 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:25.757675 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2504) took 1069 ms. Trace:
I20260709 13:17:25.758111 10037 rpcz_store.cc:276] 0709 13:17:24.688060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.712359 (+1024299us) service_pool.cc:224] Handling call
0709 13:17:25.757612 (+ 45253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.759145 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.760113 10106 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:25.761161 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:25.761410 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.761891 10106 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:25.762133 10037 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:25.762810 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:25.762720 13341 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:25.763234 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.763973 10106 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:25.766224 10115 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:25.766829 13667 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.767709 13430 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.768450 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.768956 13667 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:25.769306 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.769663 13247 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.769876 10035 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:25.770105 13247 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:25.770803 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.769658 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:25.757469 13661 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.005s	user 0.007s	sys 0.004s
I20260709 13:17:25.751881 10034 rpcz_store.cc:276] 0709 13:17:24.590370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.591931 (+  1561us) service_pool.cc:224] Handling call
0709 13:17:24.592264 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.621468 (+ 29204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:24.621502 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.622025 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.898791 (+276766us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4800080358. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:17:25.063873 (+165082us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.063917 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.083341 (+ 19424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.749660 (+666319us) raft_consensus.cc:1685] finished
0709 13:17:25.749679 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.749862 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23242,"raft.queue_time_us":23476,"raft.run_cpu_time_us":2096,"raft.run_wall_time_us":277296,"spinlock_wait_cycles":7928704,"thread_start_us":441408,"threads_started":1,"wal-append.queue_time_us":1038323}
I20260709 13:17:25.777629 10032 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:25.778740 10040 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:25.779697 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.779826 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.780647 10035 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.740744 13298 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.785079 10039 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:25.790803 13567 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.810058 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.848337 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.796072 13690 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.849128 13567 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.864110 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 526) took 1273 ms. Trace:
I20260709 13:17:25.771081 13459 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.869899 10106 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:25.854393 10035 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:25.782225 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:25.776547 13677 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.754308 13657 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.862886 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2502) took 1174 ms. Trace:
W20260709 13:17:25.862423 13688 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:25.872066 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:25.872946 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.873198 13341 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:25.866184 10031 rpcz_store.cc:276] 0709 13:17:24.590634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.597548 (+  6914us) service_pool.cc:224] Handling call
0709 13:17:24.650908 (+ 53360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.671203 (+ 20295us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:24.671244 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.320129 (+648885us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b2c00000658. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:17:25.320698 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.696471 (+375773us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:25.696510 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.696589 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.860072 (+163483us) raft_consensus.cc:1685] finished
0709 13:17:25.860093 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.864027 (+  3934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1495,"raft.queue_time_us":16334,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5501,"spinlock_wait_cycles":2765184,"thread_start_us":375337,"threads_started":1,"wal-append.queue_time_us":435002}
I20260709 13:17:25.874441 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2736) took 1110 ms. Trace:
W20260709 13:17:25.874472 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 92332.1us
I20260709 13:17:25.880283 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:25.877723 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.879050 10110 rpcz_store.cc:276] 0709 13:17:24.763271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.763408 (+   137us) service_pool.cc:224] Handling call
0709 13:17:24.770869 (+  7461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.771229 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.771270 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.771791 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.170610 (+398819us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.873506 (+702896us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.873751 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.873841 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.873881 (+    40us) raft_consensus.cc:1685] finished
0709 13:17:25.873892 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.874014 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":702161,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":36945,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"thread_start_us":671298,"threads_started":2,"wal-append.queue_time_us":876025}
I20260709 13:17:25.882457 10035 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:25.874977 10037 rpcz_store.cc:276] 0709 13:17:24.687510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.764403 (+1076893us) service_pool.cc:224] Handling call
0709 13:17:25.861907 (+ 97504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.785475 13661 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.884455 10004 leader_election.cc:400] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7.
I20260709 13:17:25.891425 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:25.891812 10004 leader_election.cc:403] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:17:25.892287 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2507) took 1203 ms. Trace:
I20260709 13:17:25.892621 10035 rpcz_store.cc:276] 0709 13:17:24.688762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.891142 (+1202380us) service_pool.cc:224] Handling call
0709 13:17:25.892226 (+  1084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.893821 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.894912 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.896122 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 529) took 1284 ms. Trace:
I20260709 13:17:25.893522 13341 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:25.896512 13641 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.894290 13430 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:25.897890 13298 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.896579 10038 rpcz_store.cc:276] 0709 13:17:24.611282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.611544 (+   262us) service_pool.cc:224] Handling call
0709 13:17:24.611911 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.621985 (+ 10074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.622016 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.622474 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.731950 (+109476us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:25.107915 (+375965us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4800080358. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:17:25.564186 (+456271us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.892338 (+328152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.892393 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.892423 (+    30us) raft_consensus.cc:1685] finished
0709 13:17:25.895918 (+  3495us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.896062 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":611288,"prepare.queue_time_us":132418,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":112117,"raft.run_cpu_time_us":1604,"raft.run_wall_time_us":495518,"spinlock_wait_cycles":66093824,"thread_start_us":1130279,"threads_started":3,"wal-append.queue_time_us":401969}
I20260709 13:17:25.897763 13341 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.870934 13567 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.896624 13576 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.900486 13567 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.901175 10040 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:25.902303 13641 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.904167 13641 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.902616 13430 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:25.896389 13689 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.906528 13689 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.908824 13689 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:25.909353 13657 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.910347 13279 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.911006 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.911849 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2521) took 1018 ms. Trace:
I20260709 13:17:25.912130 10039 rpcz_store.cc:276] 0709 13:17:24.893750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.910722 (+1016972us) service_pool.cc:224] Handling call
0709 13:17:25.911783 (+  1061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.913035 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:25.913626 10039 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:25.916077 13298 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7.
I20260709 13:17:25.919471 13587 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.919988 13587 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.920274 13660 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.921288 13668 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.921586 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:25.865888 13690 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.922127 13567 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.922202 10108 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:25.922756 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2738) took 1128 ms. Trace:
I20260709 13:17:25.874791 13664 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.922677 13567 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:25.862874 13247 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:25.906019 13430 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.471809 13699 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.474493 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 602411us
I20260709 13:17:26.474864 13699 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:26.476011 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:26.476867 13240 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:26.477283 13240 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:26.477567 13699 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.477631 13240 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.890228 13677 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:26.464931 13690 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.480499 13677 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.039983 10113 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:26.482229 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:26.483474 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:26.484642 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:26.089862 13660 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.523890 13660 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:26.524334 13660 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.908850 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 556) took 1319 ms. Trace:
W20260709 13:17:26.489670 10107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.007s
I20260709 13:17:26.490710 10108 rpcz_store.cc:276] 0709 13:17:24.793919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.794107 (+   188us) service_pool.cc:224] Handling call
0709 13:17:25.921430 (+1127323us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:25.922698 (+  1268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10862464}
I20260709 13:17:26.529789 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:26.530527 10108 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:26.531371 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:26.264135 13298 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:26.176673 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.895530 10035 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:26.545289 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.545913 10035 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:25.925101 13661 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:26.489197 13241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.014s
I20260709 13:17:26.265631 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:25.924647 13577 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:26.471131 10680 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.004s
I20260709 13:17:25.937215 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:26.551213 10680 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.015s	sys 0.004s
I20260709 13:17:26.551551 10031 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:26.532692 10107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.012s
I20260709 13:17:25.926193 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2516) took 1183 ms. Trace:
W20260709 13:17:26.418443 13341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.020s
W20260709 13:17:26.300412 10081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.023s
W20260709 13:17:26.552579 10081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.011s	sys 0.030s
I20260709 13:17:26.069718 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 807) took 1338 ms. Trace:
I20260709 13:17:26.486501 13240 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:26.488675 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:26.539106 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69794us
I20260709 13:17:26.519279 13641 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.927258 13274 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:26.528396 10715 rpcz_store.cc:276] 0709 13:17:24.589101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.649587 (+ 60486us) service_pool.cc:224] Handling call
0709 13:17:25.908622 (+1259035us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540049cd54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:25.908760 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618550016}
I20260709 13:17:26.523126 13587 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:25.896099 13642 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.418725 13030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.021s
I20260709 13:17:26.546998 13298 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:26.549198 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2741) took 1508 ms (client timeout 1535 ms). Trace:
I20260709 13:17:25.936169 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.550387 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.550424 10106 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:26.488412 13247 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:26.551513 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 611960us
I20260709 13:17:26.079856 13576 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:26.055531 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 183530us
I20260709 13:17:25.936065 13656 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.700743 10713 rpcz_store.cc:276] 0709 13:17:24.731100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.919060 (+187960us) service_pool.cc:224] Handling call
0709 13:17:24.919404 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.919644 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:24.920158 (+   514us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.069296 (+1149138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.069361 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:26.069424 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.069498 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.069646 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1135,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":48481,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":21919,"thread_start_us":1148658,"threads_started":2,"wal-append.queue_time_us":830165}
I20260709 13:17:26.703164 13642 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:26.704421 10113 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:26.694015 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.705653 10038 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:26.706139 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2523) took 1775 ms. Trace:
I20260709 13:17:26.706461 10038 rpcz_store.cc:276] 0709 13:17:24.930853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.693680 (+1762827us) service_pool.cc:224] Handling call
0709 13:17:26.706072 (+ 12392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.707370 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.557160 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 595) took 1623 ms. Trace:
I20260709 13:17:26.710860 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:26.692730 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2520) took 1877 ms (client timeout 2083 ms). Trace:
W20260709 13:17:26.711944 10032 rpcz_store.cc:269] 0709 13:17:24.814981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.741741 (+926760us) service_pool.cc:224] Handling call
0709 13:17:26.692451 (+950710us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540031d3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:26.692639 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49222016}
I20260709 13:17:25.682049 10036 rpcz_store.cc:276] 0709 13:17:24.590108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.595834 (+  5726us) service_pool.cc:224] Handling call
0709 13:17:24.596120 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.596315 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:25.555984 (+959669us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.656437 (+100453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.656488 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.656547 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.656611 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.656728 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55516,"prepare.queue_time_us":267680,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":31,"raft.queue_time_us":65979,"spinlock_wait_cycles":14851456,"thread_start_us":1003753,"threads_started":2}
W20260709 13:17:26.690834 13686 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.940s	user 0.000s	sys 0.010s
W20260709 13:17:26.687973  9938 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 184) took 13485 ms (client timeout 15000 ms). Trace:
I20260709 13:17:26.685426 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2730) took 1931 ms. Trace:
I20260709 13:17:26.718308 10112 rpcz_store.cc:276] 0709 13:17:24.754442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.764292 (+  9850us) service_pool.cc:224] Handling call
0709 13:17:24.768867 (+  4575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.966587 (+197720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.685137 (+1718550us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540024fed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:26.685354 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453180800}
I20260709 13:17:26.699420 13603 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.714457 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2527) took 1016 ms. Trace:
I20260709 13:17:26.725368 13565 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:26.726015 13565 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:26.727470 13565 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:26.728211 13660 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:26.580662 13430 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:26.580684 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2726) took 1851 ms. Trace:
I20260709 13:17:26.731362 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:26.731580 10114 rpcz_store.cc:276] 0709 13:17:24.729153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.736839 (+  7686us) service_pool.cc:224] Handling call
0709 13:17:26.580434 (+1843595us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54002837d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:26.580608 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509703424}
W20260709 13:17:26.719352 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 230710us
I20260709 13:17:26.596370 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2731) took 1841 ms. Trace:
I20260709 13:17:26.732601 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.596043 10108 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:26.602594 10110 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:26.600706 10109 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:17:26.599684 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.733650 10034 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:26.734972 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.592873 10031 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:26.736929 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 535) took 1772 ms. Trace:
I20260709 13:17:26.737404 10031 rpcz_store.cc:276] 0709 13:17:24.964480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.936961 (+972481us) service_pool.cc:224] Handling call
0709 13:17:26.736860 (+799899us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:26.722009 10115 rpcz_store.cc:269] 0709 13:17:25.041138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.563943 (+522805us) service_pool.cc:224] Handling call
0709 13:17:26.549029 (+985086us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002b8c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:26.549139 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382146816}
I20260709 13:17:26.725679 10038 rpcz_store.cc:276] 0709 13:17:25.697985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.710165 (+1012180us) service_pool.cc:224] Handling call
0709 13:17:26.714392 (+  4227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.668139 13459 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.723526 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:26.717752  9938 rpcz_store.cc:269] 0709 13:17:13.202534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.215421 (+ 12887us) service_pool.cc:224] Handling call
0709 13:17:26.687710 (+13472289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:19.147067 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:19.307110 (+160043us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:19.317948 (+ 10838us) write_op.cc:435] Acquired schema lock
0709 13:17:19.317979 (+    31us) tablet.cc:662] Decoding operations
0709 13:17:19.630185 (+312206us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:19.630247 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:19.630274 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:17:19.631443 (+  1169us) tablet.cc:701] Row locks acquired
0709 13:17:19.631458 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:17:19.631614 (+   156us) write_op.cc:270] Start()
0709 13:17:19.631724 (+   110us) write_op.cc:276] Timestamp: P: 1783603039631560 usec, L: 0
0709 13:17:19.631774 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:17:19.632441 (+   667us) log.cc:844] Serialized 6345 byte log entry
0709 13:17:20.019298 (+386857us) op_driver.cc:464] REPLICATION: finished
0709 13:17:20.147923 (+128625us) write_op.cc:301] APPLY: starting
0709 13:17:20.148025 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:20.148352 (+   327us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:20.148515 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:20.154220 (+  5705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:20.154516 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:17:20.154563 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:20.154934 (+   371us) log.cc:844] Serialized 113 byte log entry
0709 13:17:20.171538 (+ 16604us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:20.190636 (+ 19098us) write_op.cc:454] Released schema lock
0709 13:17:20.191232 (+   596us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:20.252547 (+ 61315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:20.260991 (+  8444us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":304362,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":107153,"apply.run_cpu_time_us":4333,"apply.run_wall_time_us":84169,"num_ops":16,"prepare.queue_time_us":298507,"prepare.run_cpu_time_us":16350,"prepare.run_wall_time_us":666028,"raft.queue_time_us":136487,"raft.run_cpu_time_us":4670,"raft.run_wall_time_us":64006,"replication_time_us":387369,"thread_start_us":497051,"threads_started":4,"wal-append.queue_time_us":216845,"wal-append.run_cpu_time_us":18908,"wal-append.run_wall_time_us":1485387}]]}
I20260709 13:17:26.732875 10111 rpcz_store.cc:276] 0709 13:17:24.755044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.755181 (+   137us) service_pool.cc:224] Handling call
0709 13:17:26.596109 (+1840928us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540010e0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:26.596292 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458654080}
I20260709 13:17:26.734424 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:26.764707 10038 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:26.550944 13241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.007s	sys 0.014s
I20260709 13:17:26.715390 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:26.749557 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:26.552150 10033 rpcz_store.cc:276] 0709 13:17:24.743062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.549572 (+806510us) service_pool.cc:224] Handling call
0709 13:17:25.925836 (+376264us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5400157128. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752c5924 00007f3c744ae227 00007f3c744adab8 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:25.926128 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14930688}
I20260709 13:17:26.792716 10034 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:26.553762 13341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.010s	sys 0.023s
I20260709 13:17:26.714504 10079 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:26.708999 10107 rpcz_store.cc:276] 0709 13:17:24.933444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.933559 (+   115us) service_pool.cc:224] Handling call
0709 13:17:25.936765 (+1003206us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:25.937010 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.937421 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.937450 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.937959 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.552204 (+614245us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:26.552245 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.552309 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.552349 (+    40us) raft_consensus.cc:1685] finished
0709 13:17:26.552359 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.557093 (+  4734us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117591,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":33223,"spinlock_wait_cycles":12819200,"thread_start_us":613885,"threads_started":1,"wal-append.queue_time_us":545398}
I20260709 13:17:26.713093 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.796978 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 532) took 2141 ms. Trace:
I20260709 13:17:26.720058 10037 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:26.755208 13030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.010s	sys 0.026s
W20260709 13:17:26.796465 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 82053.3us
I20260709 13:17:26.583592 13567 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.822525 10031 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:26.811990 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1753) took 1080 ms. Trace:
W20260709 13:17:26.812321 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62861.8us
W20260709 13:17:26.809731 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 2.0779e+06us
I20260709 13:17:26.798650 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1754) took 1056 ms. Trace:
I20260709 13:17:26.814450 10106 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:26.817492 10036 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:26.813117 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:26.827999 10188 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.816386 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:26.828948 10181 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:26.797874 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2525) took 1191 ms. Trace:
I20260709 13:17:26.827708 10036 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:26.797582 10034 rpcz_store.cc:276] 0709 13:17:24.655535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.763422 (+2107887us) service_pool.cc:224] Handling call
0709 13:17:26.792496 (+ 29074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.796706 (+  4210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.796915 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:26.817634 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 2.48502e+06us
I20260709 13:17:26.825783 10031 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:26.815706 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:26.831583 10183 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.826728 10035 rpcz_store.cc:276] 0709 13:17:25.731497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.792414 (+1060917us) service_pool.cc:224] Handling call
0709 13:17:26.811473 (+ 19059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.811653 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.811678 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.811718 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:26.811779 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.811832 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.811932 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.830030 10037 rpcz_store.cc:276] 0709 13:17:25.606979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.892740 (+285761us) service_pool.cc:224] Handling call
0709 13:17:26.797805 (+905065us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:26.830932 10155 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.515s (SENT)
I20260709 13:17:26.835466 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:26.827235 10033 rpcz_store.cc:276] 0709 13:17:25.737609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.793258 (+1055649us) service_pool.cc:224] Handling call
0709 13:17:26.793570 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.793746 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.793769 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.793810 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:26.793846 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.793902 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.794001 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.838581 10033 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:26.838938 10033 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:26.846050 10032 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:26.647562 13611 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.847515 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:26.846688 10032 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:26.848835 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:26.853016 10181 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:26.742851 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 594) took 1810 ms. Trace:
I20260709 13:17:26.854492 10181 pending_rounds.cc:85] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 1
I20260709 13:17:26.852289 10031 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:26.855512 10031 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.857393 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:26.839677 10033 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:26.859517 10181 pending_rounds.cc:107] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:26.854429 10109 rpcz_store.cc:276] 0709 13:17:24.932992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.933127 (+   135us) service_pool.cc:224] Handling call
0709 13:17:26.600206 (+1667079us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:26.600446 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.734735 (+134289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.742785 (+  8050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9028352}
I20260709 13:17:26.860855 10181 raft_consensus.cc:2889] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.859555 10033 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.864102 10186 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.865193 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:26.865839 10185 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.830056 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:26.763355 13574 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.869781 10153 leader_election.cc:400] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:26.870163 10153 leader_election.cc:403] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.861805 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2522) took 1941 ms. Trace:
I20260709 13:17:26.872251 10038 rpcz_store.cc:276] 0709 13:17:24.920281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.738576 (+1818295us) service_pool.cc:224] Handling call
0709 13:17:26.760645 (+ 22069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.765300 (+  4655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.861736 (+ 96436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.868660 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:26.874979 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:26.875391 10180 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:26.875562 10106 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:26.760916 13587 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:26.880120 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.881181 10038 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:26.800593 13641 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:26.882577 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51645.8us
I20260709 13:17:26.856071 10032 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:26.811782 13459 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.884666 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:26.886888 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.755757 13576 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:26.812132 13430 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:26.867404 10036 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:26.917699 10713 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:26.892827 10033 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:26.808425 13638 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.814689 13240 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:26.873853 13574 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:26.929522 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72187.2us
I20260709 13:17:26.932087 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:26.894100 10153 connection.cc:256] RPC call timeout handler was delayed by -1.6012787800000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
I20260709 13:17:26.894747 10032 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:26.894312 10155 leader_election.cc:336] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.529s (SENT)
I20260709 13:17:26.906986 10031 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:17:26.863327 13662 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:26.882633 13660 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:26.913407 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:26.877635 13594 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.925328 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.798372 13274 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:26.932260 10036 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.855931 13405 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.919853 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:26.892899 13570 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:27.012945 10033 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:26.914819 13385 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:26.892836 13657 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.883139 13661 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:27.026909 10106 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:17:26.944658 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.000604 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.001556 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:27.000295 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 73033.9us
I20260709 13:17:27.027773 10180 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.005173 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:27.028515 10037 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:27.029539 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:27.030073 10037 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.005638 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.033275 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:26.893177 13615 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:26.933382 10153 connection.cc:256] RPC call timeout handler was delayed by -1.4738136559999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:17:27.034839 10153 connection.cc:256] RPC call timeout handler was delayed by -1.3893599210000502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:17:27.035184 10153 connection.cc:256] RPC call timeout handler was delayed by -1.093678779999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2543s for a response
I20260709 13:17:27.036324 13420 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:27.036908 10032 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:27.007993 10031 pending_rounds.cc:85] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 8
I20260709 13:17:27.037379 13591 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.037400 10031 pending_rounds.cc:107] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:17:27.038671 10031 raft_consensus.cc:2889] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.039391 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 533) took 2328 ms. Trace:
I20260709 13:17:27.039703 10031 rpcz_store.cc:276] 0709 13:17:24.711112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.763777 (+2052665us) service_pool.cc:224] Handling call
0709 13:17:26.822371 (+ 58594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.039119 (+216748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.039330 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.040825 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:27.045235 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.025838 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:26.882179 13501 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:17:26.863247 13611 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.036700 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.008288 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.075474 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.076735 10033 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:26.915274 13698 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:27.076192 10109 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:27.046537 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1760) took 1287 ms. Trace:
I20260709 13:17:27.016145 10038 raft_consensus.cc:2410] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:27.080288 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.002056 13574 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.058530 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:27.058733 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:26.925951 13641 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:26.912611 13567 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:27.082983 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.025918 10183 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:26.895231 13587 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.012010 13594 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.001792 13662 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:27.099280 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 205006us
W20260709 13:17:27.100044 10155 leader_election.cc:336] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.590s (SENT)
I20260709 13:17:27.100454 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.100762 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:27.034163 13615 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.087836 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.005939 13430 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
W20260709 13:17:27.056496 13703 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:27.089505 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:27.089846 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.083664 10032 rpcz_store.cc:276] 0709 13:17:25.759189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.798409 (+1039220us) service_pool.cc:224] Handling call
0709 13:17:26.798742 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.046313 (+247571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.046487 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.024768 13570 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:27.098085 10185 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:27.002398 13030 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:17:27.102332 10037 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:27.076639 13657 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.079128 13240 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:27.113144 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:27.113826 10180 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:27.081521 13241 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.085063 13420 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.116012 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.083659 13698 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.116268 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.115693 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.120515 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 187939us
I20260709 13:17:27.084519 13341 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.127425 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:27.127923 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:27.011596 13658 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:17:26.926103 13459 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.124408 10111 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:27.132977 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1496) took 1197 ms. Trace:
I20260709 13:17:27.133345 10111 rpcz_store.cc:276] 0709 13:17:25.935477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.123777 (+1188300us) service_pool.cc:224] Handling call
0709 13:17:27.124143 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.132664 (+  8521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.132910 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.024446 13613 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:17:27.127063 10155 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.590s (SENT)
I20260709 13:17:27.093078 13661 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:27.138433 10155 leader_election.cc:336] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.645s (SENT)
I20260709 13:17:27.102181 13594 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.101998 13638 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.129426 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.145105 10112 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:27.145563 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:27.092103 13458 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.130429 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.084934 13695 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:27.109964 13662 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.099834 13405 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.109349 13592 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.149121 10115 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:27.115797 13657 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.115710 13570 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:27.156445 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.158316 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.157501 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:27.130487 13380 raft_consensus.cc:2764] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:27.155982 13695 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.160476 10115 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:27.131668 13698 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.138080 13558 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:27.161803 10112 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:27.097201 13567 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.162333 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:27.239624 10037 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:27.130724 13593 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:27.244091 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 185657us
I20260709 13:17:27.139191 13658 consensus_queue.cc:1243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:27.162050 13664 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:27.140105 13341 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.167827 13660 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:27.177062 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.189832 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.149374 13659 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.157224 13405 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.163547 13240 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:27.224138 13642 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:27.224269 13587 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:27.225711 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1492) took 1291 ms. Trace:
I20260709 13:17:27.266251 10107 rpcz_store.cc:276] 0709 13:17:25.934475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.796805 (+862330us) service_pool.cc:224] Handling call
0709 13:17:26.800147 (+  3342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.800478 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.800504 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.846945 (+ 46441us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.021159 (+174214us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.201606 (+180447us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.225376 (+ 23770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.225453 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.225492 (+    39us) raft_consensus.cc:1685] finished
0709 13:17:27.225513 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.225639 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223134,"raft.queue_time_us":27190,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":4876,"thread_start_us":236672,"threads_started":2,"wal-append.queue_time_us":216642}
I20260709 13:17:27.226694 10112 pending_rounds.cc:85] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:17:27.127791 13241 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.156838 10111 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:27.273458 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1498) took 1218 ms. Trace:
I20260709 13:17:27.273837 10111 rpcz_store.cc:276] 0709 13:17:26.055362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.134151 (+1078789us) service_pool.cc:224] Handling call
0709 13:17:27.152964 (+ 18813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.273157 (+120193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.273390 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.179477 13298 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:27.167374 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.211652 13030 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:27.247699 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1493) took 1313 ms. Trace:
I20260709 13:17:27.224829 13380 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:27.254885 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 342549us
I20260709 13:17:27.261361 13659 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.227901 13723 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:27.261818 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 403106us
I20260709 13:17:27.267827 10112 pending_rounds.cc:107] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:27.256170 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1749) took 1597 ms. Trace:
I20260709 13:17:27.302320 10039 rpcz_store.cc:276] 0709 13:17:25.659102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.764258 (+1105156us) service_pool.cc:224] Handling call
0709 13:17:26.804326 (+ 40068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.804718 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.804753 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.852378 (+ 47625us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.103033 (+250655us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:27.103081 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.103149 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.255897 (+152748us) raft_consensus.cc:1685] finished
0709 13:17:27.255927 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.256095 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4191,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":207303,"threads_started":1,"wal-append.queue_time_us":299319}
I20260709 13:17:27.301899 10112 raft_consensus.cc:2889] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.292294 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:27.289529 10110 rpcz_store.cc:276] 0709 13:17:25.934708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.806883 (+872175us) service_pool.cc:224] Handling call
0709 13:17:26.807200 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.807395 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:27.021606 (+214211us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.246090 (+224484us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.246161 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:27.246225 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.247477 (+  1252us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.247618 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":323138,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":359,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2661,"thread_start_us":437225,"threads_started":2}
I20260709 13:17:27.260735 13405 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.260501 13240 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:27.268811 13613 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:27.225374 13641 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:27.325464 13683 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.608s	user 0.004s	sys 0.009s
I20260709 13:17:27.320204 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:27.287981 13724 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.320483 10107 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:27.331976 10107 pending_rounds.cc:85] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 4
I20260709 13:17:27.332240 10107 pending_rounds.cc:107] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:27.332487 10107 raft_consensus.cc:2889] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.290772 13591 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.299641 13659 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.307178 13710 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:27.318692 13613 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:27.375005 13613 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.376389 13613 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.328863 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.330160 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81681.8us
I20260709 13:17:27.316164 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.331420 10110 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:27.338449 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.341658 10188 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.013s
I20260709 13:17:27.380986 10188 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:17:27.343391 10155 leader_election.cc:336] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.776s (SENT)
I20260709 13:17:27.299144 13380 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.333300 13576 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:27.346097 10112 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:27.346930 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.341958 13558 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:27.315644 13611 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:27.326581 13722 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:27.294590 13298 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:17:27.372972 10107 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:27.319583 13240 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.462075 10037 raft_consensus.cc:1217] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[7.4-11.6]   Dedup: 7.4->[9.5-11.6]
I20260709 13:17:27.465642 10037 pending_rounds.cc:85] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 4
I20260709 13:17:27.447897 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.465937 10037 pending_rounds.cc:107] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:17:27.466197 10037 raft_consensus.cc:2889] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.407227 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.378089 10182 raft_consensus.cc:2410] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:27.384045 10187 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:27.467466 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 166067us
W20260709 13:17:27.460016 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81985.9us
W20260709 13:17:27.465546 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.460511 10036 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:17:27.471383 10036 pending_rounds.cc:85] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 4
I20260709 13:17:27.290848 13587 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:27.344537 13724 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.466146 10188 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:27.401441 10110 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:27.254421 13661 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.471608 10036 pending_rounds.cc:107] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:17:27.467181 10189 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:27.475263 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.405686 13247 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.692s	user 0.015s	sys 0.001s
I20260709 13:17:27.385068 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:27.470957 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.495126 10186 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:17:27.402294 13718 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:17:27.411904 13731 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:27.491215 10036 raft_consensus.cc:2889] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:27.474838 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 335983us
W20260709 13:17:27.512328 13728 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:17:27.512677 13501 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:27.471494 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.493410 10182 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:17:27.481630 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.497015 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:27.455396 13695 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:27.540367 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.378628 13723 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:27.417188 13656 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.412344 13615 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:27.412096 13459 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:27.533833 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:27.416501 13732 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:27.540630 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2528) took 1819 ms. Trace:
W20260709 13:17:27.545859 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 202483us
I20260709 13:17:27.546635 10036 rpcz_store.cc:276] 0709 13:17:25.721462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.792194 (+1070732us) service_pool.cc:224] Handling call
0709 13:17:26.817363 (+ 25169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.540153 (+722790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.540569 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:27.542122 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.541105 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.546902 10155 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.879s (SENT)
I20260709 13:17:27.548096 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:27.548173 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.548745 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.548913 10182 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:27.496757 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:27.416872 13710 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:27.554637 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58116.2us
I20260709 13:17:27.556866 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:27.470113 13558 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.520533 13567 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:27.572690 10155 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.896s (SENT)
W20260709 13:17:27.578900 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81953.7us
I20260709 13:17:27.579852 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.572939 10033 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:27.555647 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.560003 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:27.543442 13587 consensus_queue.cc:1243] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:27.558820 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.532372 13247 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.581583 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:27.584080 13567 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.586647 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:27.552490 13584 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:27.589519 13745 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:27.591323 13380 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:27.592159 13558 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:27.592518 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 686) took 3090 ms. Trace:
I20260709 13:17:27.606169 10184 rpcz_store.cc:276] 0709 13:17:24.491951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.492274 (+   323us) service_pool.cc:224] Handling call
0709 13:17:24.492646 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:26.809013 (+2316367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.809048 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:26.856525 (+ 47477us) log.cc:844] Serialized 52 byte log entry
0709 13:17:27.116972 (+260447us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.117012 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.117076 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.582183 (+465107us) raft_consensus.cc:1685] finished
0709 13:17:27.582203 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.582331 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2315939,"raft.queue_time_us":2316379,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":119596,"threads_started":1,"wal-append.queue_time_us":262198}
I20260709 13:17:27.608172 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.575919 13750 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:27.593101 10155 leader_election.cc:336] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.915s (SENT)
I20260709 13:17:27.609036 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:27.609395 13752 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:27.609937 13710 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:27.610498 13745 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:27.610667 10155 connection.cc:256] RPC call timeout handler was delayed by -2.4468194029998358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2859s for a response
W20260709 13:17:27.611256 10155 connection.cc:256] RPC call timeout handler was delayed by -1.8789171250000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 13:17:27.611500 13745 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.612036 13638 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:27.601137 13567 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.613206 13567 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.613431 13591 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.614413 13638 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.616679 13750 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:27.594760 13698 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.598827 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.599152 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:27.575372 13615 raft_consensus.cc:2764] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:27.578444 13420 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:27.618459 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:27.619652 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.542716 13741 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:17:27.619287 10182 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:27.555081 13695 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:17:27.595841 13501 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.566849 13732 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.633000 10184 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:27.627440 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.609877 13752 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.634768 13732 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:27.635057 13752 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.614886 13638 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.617168 13750 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.628418 13754 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.650817 10183 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:27.651382 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:27.630402 13385 consensus_meta.cc:287] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.004s
I20260709 13:17:27.630657 10110 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:27.631690 13405 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.641289 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.550134 13656 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.581374 13576 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:27.600153 13252 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.630149 13698 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:27.604314 13584 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:27.655007 13754 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.658766 13754 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.659129 13584 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.659438 13662 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.660187 13584 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.657245 13252 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.660908 13252 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.661502 13662 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:27.661791 10107 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:27.662688 10109 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:27.600883 13594 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.663774 10181 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:27.664670 13594 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:27.668591 13754 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.671207 13754 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:27.673568 13750 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:27.674779 13747 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:27.678336 10182 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:27.618883 13592 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:17:27.675181 13567 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.618242 13247 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.660233 13405 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:27.688589 13698 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:27.689597 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:27.657021 13385 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 5. Current term is 6.
I20260709 13:17:27.689224 10182 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:27.682657 13662 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.595595 13723 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.738358 10188 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
W20260709 13:17:27.737716 10155 connection.cc:256] RPC call timeout handler was delayed by -1.6538697739999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:17:27.737850 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.699518 13751 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:27.744587 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 145517us
I20260709 13:17:27.696735 13695 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.746225 10155 connection.cc:256] RPC call timeout handler was delayed by -1.6512171250001302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:17:27.752700 10155 connection.cc:256] RPC call timeout handler was delayed by -1.5747171250000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:17:27.753409 10155 connection.cc:256] RPC call timeout handler was delayed by -1.5576171249999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 13:17:27.749961 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:27.753998 10155 connection.cc:256] RPC call timeout handler was delayed by -1.4006380289999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260709 13:17:27.754705 10155 connection.cc:256] RPC call timeout handler was delayed by -1.329869773999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:17:27.755064 10155 connection.cc:256] RPC call timeout handler was delayed by -1.2656380290000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:17:27.755405 10155 connection.cc:256] RPC call timeout handler was delayed by -1.1436171249999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2543s for a response
I20260709 13:17:27.740062 13739 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:27.761512 13695 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.684485 13752 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.763646 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:27.765636 13247 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:27.771940 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.772606 13656 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:27.774299 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 536) took 2014 ms. Trace:
I20260709 13:17:27.780275 10034 rpcz_store.cc:276] 0709 13:17:25.759584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.830814 (+1071230us) service_pool.cc:224] Handling call
0709 13:17:26.831158 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.831557 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.831585 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.878436 (+ 46851us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.288704 (+410268us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.288751 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.288859 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.774070 (+485211us) raft_consensus.cc:1685] finished
0709 13:17:27.774095 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.774237 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8181,"thread_start_us":291576,"threads_started":1,"wal-append.queue_time_us":736825}
I20260709 13:17:27.783887 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:27.776430 13567 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:27.778550 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1742) took 2844 ms. Trace:
I20260709 13:17:27.785246 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:27.790302 10716 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:27.792689 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 168996us
I20260709 13:17:27.794464 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:27.788497 10040 rpcz_store.cc:276] 0709 13:17:24.934456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.762367 (+1827911us) service_pool.cc:224] Handling call
0709 13:17:26.803412 (+ 41045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.803819 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.803847 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.825786 (+ 21939us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.288096 (+462310us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.327009 (+ 38913us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.347952 (+ 20943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.348027 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.778344 (+430317us) raft_consensus.cc:1685] finished
0709 13:17:27.778364 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.778491 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62994,"prepare.queue_time_us":31726,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":135788,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6437,"thread_start_us":391676,"threads_started":1,"wal-append.queue_time_us":811605}
I20260709 13:17:27.799160 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:27.743171 13662 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.815548 13762 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:27.757464 13574 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.661s	user 0.014s	sys 0.001s
I20260709 13:17:27.831327 10712 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:27.797747 13240 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:27.817802 10713 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:27.835254 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:27.836035 10034 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.845980 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:27.846663 10040 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.733801 13698 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.839612 10716 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:27.850147 13762 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:27.858879 13762 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.778940 13739 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:27.830771 13750 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:27.893767 10040 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:17:27.870886 13570 consensus_meta.cc:287] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.000s
I20260709 13:17:27.887472 13750 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:27.854650 13574 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.910512 13739 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:27.956383 13761 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:27.976715 10711 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:27.966085 13252 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:27.967801 13755 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:17:27.972553 13750 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.869760 13758 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:17:27.863853 13659 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:27.909549 13570 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:28.018010 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.053787 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 1.2041e+06us
W20260709 13:17:28.081225 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.053741 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.054006 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.065035 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:28.082477 10183 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:28.082684 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.051343 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2743) took 1043 ms. Trace:
I20260709 13:17:28.083643 10107 rpcz_store.cc:276] 0709 13:17:27.007823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.465484 (+457661us) service_pool.cc:224] Handling call
0709 13:17:27.489807 (+ 24323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.662159 (+172352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.051123 (+388964us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400403654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:28.051284 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395085696}
I20260709 13:17:28.084610 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.000849 10035 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:28.084931 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.085289 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:28.079952 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 330079us
I20260709 13:17:28.085989 10032 raft_consensus.cc:2410] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:28.086113 10038 raft_consensus.cc:2410] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:28.068205 10108 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.085294 10036 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:28.087538 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.088508 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:28.087563 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.089509 10181 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:28.090413 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.044034 10034 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:28.091588 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:28.091605 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.092430 10181 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:28.093111 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.093593 10181 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.096181 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:28.097208 10709 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:28.097448 10032 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:28.097851 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.100828 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.101917 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.102082 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.102638 10037 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:28.103506 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:28.103763 10034 raft_consensus.cc:2368] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:28.102694 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:28.111343 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 690) took 1227 ms. Trace:
I20260709 13:17:28.111791 10187 rpcz_store.cc:276] 0709 13:17:26.884150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.884289 (+   139us) service_pool.cc:224] Handling call
0709 13:17:27.381695 (+497406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.471981 (+ 90286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.111136 (+639155us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54002d4bd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:28.111278 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068121472}
I20260709 13:17:28.113029 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.112115 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:28.115034 10034 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:28.115279 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.116787 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:28.117291 10032 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.107339 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:27.998138 13739 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.119652 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.119607 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.119014 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.122385 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.131102 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.049770 13574 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:28.032402 13758 consensus_queue.cc:1243] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:28.124450 10186 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9.
I20260709 13:17:28.123134 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:28.132232 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.049551 13714 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.124058 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.126012 10108 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:28.139623 10183 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:28.130133 10032 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:28.070979 13750 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.134057 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.140816 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.094635 13747 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.999514 13662 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:28.098224 13696 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:28.164182 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.165009 10113 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:28.139072 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:28.168138 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:28.168962 10712 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:28.053416 13638 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:28.067952 13752 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:28.136013 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:28.150106 10710 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:28.130550 13274 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.121778 13631 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.151465 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.151248 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.161808 10181 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:28.183357 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.184590 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:28.162408 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 73463.6us
I20260709 13:17:28.163004 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:28.133572 13657 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.003s
I20260709 13:17:28.172757 10031 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.153644 13565 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:28.187247 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51304.2us
I20260709 13:17:28.185225 10107 raft_consensus.cc:2376] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10. Re-sending same reply.
I20260709 13:17:28.094424 13593 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:17:28.185156 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.181656 10108 raft_consensus.cc:2376] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7. Re-sending same reply.
I20260709 13:17:28.163224 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:28.238291 13752 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:28.238696 13752 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.239040 13752 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:28.240599 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 77437.1us
I20260709 13:17:28.153103 13714 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:28.189725 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.189824 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.120177 13760 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:28.199924 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.176724 13247 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:28.201574 13723 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:28.204042 13698 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:28.204456 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.195035 13240 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:28.208216 13611 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:28.212743 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.269285 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.269979 10183 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:28.280810 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.214774  9935 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.281826 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:28.217188 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.284124 10184 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:28.218324 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.286284 10111 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
W20260709 13:17:28.221202 13744 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.709s	user 0.002s	sys 0.000s
I20260709 13:17:28.222524 13341 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:28.224088 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.282967  9935 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 8, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 8 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:28.226766 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.227129 13574 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.228165 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.293710 10114 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.228657 13765 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.231144 13724 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:28.236564 13747 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:28.237102 13252 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:28.188934 13631 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.241868 10113 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.243880 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.250018 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 701) took 1082 ms. Trace:
I20260709 13:17:28.319656 10182 rpcz_store.cc:276] 0709 13:17:27.167595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.742557 (+574962us) service_pool.cc:224] Handling call
0709 13:17:27.742845 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.743184 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.743214 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.743654 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.095360 (+351706us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:28.095401 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.095463 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.249791 (+154328us) raft_consensus.cc:1685] finished
0709 13:17:28.249814 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.249951 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2392,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":1803,"thread_start_us":287867,"threads_started":1,"wal-append.queue_time_us":445990}
I20260709 13:17:28.318513 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.321516 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:28.260138 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 122164us
I20260709 13:17:28.322562 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:28.287899 10187 raft_consensus.cc:2410] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:17:28.288578 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.289655 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.291491 10036 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:28.225291 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.293527 10110 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.281947 10183 raft_consensus.cc:2376] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10. Re-sending same reply.
I20260709 13:17:28.325857 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.326905 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.327966 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.328650 10183 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:28.329350 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.330643 10183 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:28.331190 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1719) took 1114 ms. Trace:
I20260709 13:17:28.307817 13750 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:28.309702 10078 leader_election.cc:336] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.506s (SENT)
I20260709 13:17:28.312605 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.240821 13565 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:28.317451  9935 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 7, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.264824 13659 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:28.321761 10188 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:28.261196 13760 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:28.361370  9935 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 1 to 7, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.334124 10189 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:28.305864 13574 consensus_queue.cc:1243] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:28.323480 10108 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.334676 10114 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:28.366918 10184 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:28.335003 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:28.335457 10111 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:28.337582 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.339131 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:28.342900 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.368218 10107 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.184283 13274 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.287514 13584 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:28.313731 13030 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.331485 10183 rpcz_store.cc:276] 0709 13:17:27.216570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.330120 (+1113550us) service_pool.cc:224] Handling call
0709 13:17:28.330418 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.330968 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.331139 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.389494 13030 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:28.370133 10184 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:17:28.377486 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 67831.5us
I20260709 13:17:28.240496 13657 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:28.287983 13758 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:17:28.390573 10713 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:28.287846 13593 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:17:28.316462 13747 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:28.390954 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 68486.6us
I20260709 13:17:28.390375 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1721) took 1173 ms. Trace:
I20260709 13:17:28.305510 13385 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:17:28.325066 13765 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.354578 13565 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.537981 10184 rpcz_store.cc:276] 0709 13:17:27.217180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.369577 (+1152397us) service_pool.cc:224] Handling call
0709 13:17:28.369897 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.390106 (+ 20209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.390312 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:28.508203 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 210575us
I20260709 13:17:28.558401 10113 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
W20260709 13:17:28.558949 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.406884 10188 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:28.414356 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1501) took 1565 ms. Trace:
W20260709 13:17:28.465876 10078 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.570s (SENT)
W20260709 13:17:28.406945 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.559434 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.559687 10106 rpcz_store.cc:276] 0709 13:17:26.849205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.892136 (+ 42931us) service_pool.cc:224] Handling call
0709 13:17:28.414141 (+1522005us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b540018a454. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:28.414290 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215814528}
I20260709 13:17:28.560146 10113 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.560648 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:28.561008 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1723) took 1343 ms. Trace:
I20260709 13:17:28.517517 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.547057 10110 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
W20260709 13:17:28.560312 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.394685 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.562439 10107 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
W20260709 13:17:28.563020 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 244978us
W20260709 13:17:28.563629 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97799.7us
I20260709 13:17:28.452255  9935 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 6 to 7, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:17:28.570456 10680 leader_election.cc:336] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.523s (SENT)
I20260709 13:17:28.561465 10188 rpcz_store.cc:276] 0709 13:17:27.217761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.375902 (+1158141us) service_pool.cc:224] Handling call
0709 13:17:28.406691 (+ 30789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.560733 (+154042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.560919 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.572011 10184 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:28.406313 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.572590 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1732) took 1351 ms. Trace:
I20260709 13:17:28.573941 10184 rpcz_store.cc:276] 0709 13:17:27.221144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.571535 (+1350391us) service_pool.cc:224] Handling call
0709 13:17:28.571854 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.572377 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.572540 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.574854 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.575639 10184 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:28.576126 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:28.500870 13772 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:17:28.578030 10114 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:28.391903 13659 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:28.384891 13658 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:28.579563  9935 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.582451 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:28.375756 13760 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.583250 10033 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:28.384706 13584 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:28.410372 13241 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:28.593547 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:28.594017 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.594264 10106 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:28.584729 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.587800 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 705) took 1088 ms. Trace:
I20260709 13:17:28.405927 13247 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:28.558086 13747 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.589618 10709 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.590996 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.591233 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 706) took 1003 ms. Trace:
I20260709 13:17:28.469385 13695 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:28.640591 10078 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.614s (SENT)
I20260709 13:17:28.604934 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.625291 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:28.630182 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:28.644550 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:28.623900 10107 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:28.646173 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:28.610338 10106 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:28.615590 10187 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:28.596791 10188 rpcz_store.cc:276] 0709 13:17:27.587959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.571839 (+983880us) service_pool.cc:224] Handling call
0709 13:17:28.590762 (+ 18923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.590932 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.590957 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.590996 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:28.591026 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.591076 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.591166 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.649537 10115 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.648530 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.650170 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1503) took 1800 ms. Trace:
I20260709 13:17:28.390417 13030 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.648874 13405 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:28.651034 10115 rpcz_store.cc:276] 0709 13:17:26.849699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.170228 (+320529us) service_pool.cc:224] Handling call
0709 13:17:27.170563 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.649384 (+1478821us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b5400300fa0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45fdc0 00007f3c6f4ea1c0 00007f3c6f4eb231 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c
0709 13:17:28.649939 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.650120 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217381760}
I20260709 13:17:28.572665 13656 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:28.589490 13567 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:28.392068 13714 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.653613 10106 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:28.594595 13584 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.656781 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.671449 10115 raft_consensus.cc:2376] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13. Re-sending same reply.
I20260709 13:17:28.672363 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.595830 10189 rpcz_store.cc:276] 0709 13:17:27.499030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.567136 (+1068106us) service_pool.cc:224] Handling call
0709 13:17:28.587307 (+ 20171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.587494 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.587519 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.587559 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:28.587590 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.587637 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.587725 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:28.609894 13770 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.315s	user 0.003s	sys 0.000s
I20260709 13:17:28.598023 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.683547 10108 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:28.584393 13659 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:28.594630 13631 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:28.658569 10187 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:28.647599  9935 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 5, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.596541 13247 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.660236 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.675572 10107 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:28.656004 13658 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:28.684353 10184 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:28.646927 13780 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:28.658536 13593 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:28.727957  9935 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 6, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 6 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.731685 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:28.732465 10113 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:28.733502 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.735038 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:28.735824 10114 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:28.739352 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.658118 13662 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:17:28.659571 13732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.003s	sys 0.013s
W20260709 13:17:28.745725 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.755589 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.707829 13765 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:28.764469 10078 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.641s (SENT)
I20260709 13:17:28.764972 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:28.756356 10189 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:28.704701 13247 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:28.767575 10709 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:28.777330 13690 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:28.770767  9935 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 5, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 5 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:17:28.783355 10078 leader_election.cc:336] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.064s (SENT)
I20260709 13:17:28.699167 13567 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.737846 13658 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:28.786475 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.753705 13385 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:28.790256 10187 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
W20260709 13:17:28.781502 13762 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
I20260709 13:17:28.738408 13593 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:28.796589 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.793083  9935 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 2 to 5, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 5 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:28.801745 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:28.802314 10187 raft_consensus.cc:2376] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8. Re-sending same reply.
I20260709 13:17:28.803114 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:28.800562 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 136944us
I20260709 13:17:28.821609 10187 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:28.799554 13274 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:28.829867 10036 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:28.824956 13638 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:28.780974 13659 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:28.795187 13385 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.863075 13570 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:28.864251 10036 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:17:28.864022  9935 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 5 to 8, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 8 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:28.833729 13752 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.005s
W20260709 13:17:28.871950 10680 leader_election.cc:336] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.702s (SENT)
I20260709 13:17:28.800704 13762 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:28.875697 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:28.861841 13638 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:28.872011 13659 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:28.912684 13785 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:17:28.874022 13752 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:28.916124  9935 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:28.938395 13405 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:28.877552 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:28.878211 13694 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.100059 13430 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.104056 13247 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:29.068133 10078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.226s (SENT) [suppressed 49 similar messages]
I20260709 13:17:29.068440 13385 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:29.068719 13662 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:29.106331 13247 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:29.067137 13735 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.070550 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:28.864356 13658 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.108621 13735 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:29.109669 13430 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.112233 13405 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:29.113520 10186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1417) took 1317 ms (client timeout 1506 ms). Trace:
W20260709 13:17:29.113927 10186 rpcz_store.cc:269] 0709 13:17:27.796562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.798933 (+  2371us) service_pool.cc:224] Handling call
0709 13:17:29.113328 (+1314395us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002acbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:29.113454 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746464128}
I20260709 13:17:29.114955 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:28.877230 13732 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:29.115813 10186 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:29.116202 13298 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:29.116603 13298 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:29.117347 13298 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.117724 13458 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:29.123872 13458 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:29.124714 13458 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.125905 13458 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.116758 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:29.129150 13565 consensus_meta.cc:287] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.550s	user 0.023s	sys 0.016s
W20260709 13:17:29.129797 13790 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.260s	user 0.000s	sys 0.009s
I20260709 13:17:29.129654 13565 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.131008 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1724) took 1913 ms. Trace:
W20260709 13:17:29.131881 13793 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:29.119009 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.133198 10185 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:29.118634 13584 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.131381 10181 rpcz_store.cc:276] 0709 13:17:27.218020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.380000 (+1161980us) service_pool.cc:224] Handling call
0709 13:17:28.380313 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.397509 (+ 17196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.397545 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.398077 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.717291 (+319214us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.717334 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.717411 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.129252 (+411841us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:29.130697 (+  1445us) raft_consensus.cc:1685] finished
0709 13:17:29.130718 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.130947 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7385,"raft.queue_time_us":75441,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9261,"spinlock_wait_cycles":5688192,"thread_start_us":204244,"threads_started":1,"wal-append.queue_time_us":330454}
I20260709 13:17:29.133599 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1713) took 2132 ms. Trace:
I20260709 13:17:29.120203 13752 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:29.120380 10035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 542) took 1803 ms (client timeout 1756 ms). Trace:
I20260709 13:17:29.135211 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 603) took 1009 ms. Trace:
I20260709 13:17:29.133934 10185 rpcz_store.cc:276] 0709 13:17:27.001147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.148651 (+147504us) service_pool.cc:224] Handling call
0709 13:17:28.389905 (+1241254us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:29.118918 (+729013us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3f8c 00007f3c6c3c3ef6 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:29.133526 (+ 14608us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7416576}
I20260709 13:17:29.135643 10111 rpcz_store.cc:276] 0709 13:17:28.125728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.585909 (+460181us) service_pool.cc:224] Handling call
0709 13:17:28.586210 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.586565 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:28.586590 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.587006 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.799997 (+212991us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.800034 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.800098 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.135008 (+334910us) raft_consensus.cc:1685] finished
0709 13:17:29.135027 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.135154 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2473,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4143,"thread_start_us":148000,"threads_started":1,"wal-append.queue_time_us":478529}
W20260709 13:17:29.134994 10035 rpcz_store.cc:269] 0709 13:17:27.317436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.317549 (+   113us) service_pool.cc:224] Handling call
0709 13:17:29.120163 (+1802614us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540031b0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:29.120305 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548926720}
I20260709 13:17:29.138288 13587 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.134059 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.138808 13587 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.139340 10181 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:29.140239 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.142365 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:29.143118 10115 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:29.144810 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.145535 10709 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:29.136391 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.150405 10185 raft_consensus.cc:2376] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9. Re-sending same reply.
I20260709 13:17:29.152629 13662 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.153129 10716 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:29.153717 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.153360 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.155105 10714 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:29.155325 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:29.156625 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.156536 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.157653 10184 raft_consensus.cc:2410] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:17:29.158785 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:29.159364 10033 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:29.160100 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.077631 10187 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:29.160465 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:29.086980 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.130272 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.161072 10032 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:29.161389 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.159346 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:29.160740 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:29.091372 13593 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:29.109540 13735 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.069334 13567 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:29.110244 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 232762us
I20260709 13:17:29.177397 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.072868  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:29.157210 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 86730.6us
I20260709 13:17:29.178959 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:29.103698  9935 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 6, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 6 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.164316 10111 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:29.182195 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.165940 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:29.166697 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:29.172324 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:29.175326 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 53097.8us
I20260709 13:17:29.154381 10711 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:29.185179 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.154206 13574 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.194322 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.190410 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.195181 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.196568 10185 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:29.197418 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.198369 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.198887 10185 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:29.199684 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.201192 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.201747 10185 raft_consensus.cc:2376] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8. Re-sending same reply.
I20260709 13:17:29.203107 10031 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:29.206743 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:29.228042 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.232182 10108 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:17:29.233575 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.264554 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.265324 10184 raft_consensus.cc:2376] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9. Re-sending same reply.
I20260709 13:17:29.132622 13565 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:29.221669 10078 leader_election.cc:336] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.507s (SENT)
I20260709 13:17:29.268105 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.268316 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.268918 10184 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:29.192792 10032 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
W20260709 13:17:29.273423 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 96109.6us
I20260709 13:17:29.272789  9935 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 6, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 6 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:29.278456 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.276825 10185 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:29.279068 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.279438 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.280170 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.280825 10185 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.280129 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.281809 10184 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.157467 13762 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:29.284287 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 77644.1us
W20260709 13:17:29.318089 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 96480.9us
W20260709 13:17:29.336534 10078 leader_election.cc:336] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.967s (SENT)
I20260709 13:17:29.336206  9935 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 6, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 6 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.336941 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.323549 13780 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.187451 13752 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.324295 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.325807 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:29.193773 13430 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:29.203850 13298 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:29.331950 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53307us
I20260709 13:17:29.335139 10184 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:29.266247 13739 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.276520 13631 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.341655 10185 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:29.284902 13748 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.284634 13725 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.340898  9935 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 4 to 8, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 8 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.342886 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.353334 10184 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:29.343700 10078 leader_election.cc:336] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.004s (SENT)
W20260709 13:17:29.354238 10078 leader_election.cc:336] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.658s (SENT)
I20260709 13:17:29.348219 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.354533 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:29.355012 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.351339 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.317391 13405 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.327602 13565 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:29.356691 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:29.357054 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.357810 10111 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:29.349593 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.269131 13574 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.366480 10711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:29.366814 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.367105 10711 raft_consensus.cc:606] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.359542 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.278052 13743 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:17:29.344674 13662 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.342312 13739 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:29.344872 13274 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.333561 13690 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:29.367482 10711 raft_consensus.cc:614] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:29.365422 10185 raft_consensus.cc:2410] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:29.358042 13780 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.351295 13584 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:29.335906 13677 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:29.374083 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.396238 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.283874 13638 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.351714 13725 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:29.367901 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 202016us
I20260709 13:17:29.345595 13752 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.347052 13570 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:29.396924 10186 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.364614 13587 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:29.359050 13723 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:29.403980 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:29.406152 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 153020us
I20260709 13:17:29.366101 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:29.408236 10078 leader_election.cc:336] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.718s (SENT)
I20260709 13:17:29.371316 13739 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.370832 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.426599 10184 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:17:29.427493 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.428076 10184 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:29.373042 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 165106us
I20260709 13:17:29.420198 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:29.364810 13565 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.424916 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.396677 13642 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.372973 13662 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.458978 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:29.536414 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 128210us
I20260709 13:17:29.425124 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:29.545308 10078 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.738s (SENT)
I20260709 13:17:29.545790 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:29.546960 10078 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.096s (SENT)
I20260709 13:17:29.547375 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.410594 13812 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:29.551611 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.459965 13760 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.818s	user 0.006s	sys 0.013s
W20260709 13:17:29.470306 13747 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.783s	user 0.013s	sys 0.005s
I20260709 13:17:29.551937 13274 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.554818 13565 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:29.424270 13587 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:17:29.549098 13796 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.549857 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:29.580585 10185 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:29.581590 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.582404 10185 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:29.425038 13638 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.412200 13570 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:29.570788 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 204672us
I20260709 13:17:29.397619 13780 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:29.570166 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 150045us
W20260709 13:17:29.590312 13802 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
W20260709 13:17:29.590719 13809 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:17:29.590999 13662 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:29.592767 13752 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:29.585317 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 259558us
I20260709 13:17:29.550490 13677 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:29.607928 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.617501 10184 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:29.559921 13430 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:29.633221 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:29.632511 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.607906 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.634210 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1741) took 1403 ms. Trace:
I20260709 13:17:29.640178 10184 rpcz_store.cc:276] 0709 13:17:28.230996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.633421 (+1402425us) service_pool.cc:224] Handling call
0709 13:17:29.633722 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.633898 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.633924 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.633967 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:29.633999 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.634053 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.634152 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.641747 10184 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:29.642354 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1441) took 1101 ms. Trace:
I20260709 13:17:29.642656 10184 rpcz_store.cc:276] 0709 13:17:28.540571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.641221 (+1100650us) service_pool.cc:224] Handling call
0709 13:17:29.641535 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.642122 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.642291 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.647562 10110 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:29.586913 13565 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:29.654518 13816 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:29.635269 13811 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:17:29.657294 10184 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:29.644497 13743 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.567278 13760 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.575325 13747 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.658492 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 710) took 1081 ms. Trace:
I20260709 13:17:29.647997 13752 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:29.663823 10186 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:29.666651 10184 rpcz_store.cc:276] 0709 13:17:28.577305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.643348 (+1066043us) service_pool.cc:224] Handling call
0709 13:17:29.643620 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.658184 (+ 14564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.658426 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:29.658792 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 199930us
W20260709 13:17:29.667408 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 78336.8us
I20260709 13:17:29.650455 13818 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.678697 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:29.656152 13812 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:29.557103 13725 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.692482 10036 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:29.693954 10035 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:29.646351 13814 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:17:29.658052 13587 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:17:29.702896 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 95054.9us
W20260709 13:17:29.699882 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.681588 13818 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:29.682544 13574 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:29.713311 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.698807 13725 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.720556 13824 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.720574 13565 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:29.721458 13570 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:29.721480 13824 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:29.722500 13565 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:29.710511 13818 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.727715 13574 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:29.728113 13574 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:29.728948 13574 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.699540 13819 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:29.720446 13810 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:17:29.707675 13723 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:29.737545 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58963.8us
W20260709 13:17:29.736799 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 149289us
W20260709 13:17:29.756250 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.753583 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:29.761160 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44724.3us
I20260709 13:17:29.765837 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.770584 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.700614 13430 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.783247 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:29.750244 13822 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:29.780122 13760 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:29.758041 13823 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:29.780853 13828 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:17:29.782567 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:29.767227 13723 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:29.765269 13826 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.800876 10114 raft_consensus.cc:2376] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9. Re-sending same reply.
I20260709 13:17:29.784871 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:29.802526 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 123934us
I20260709 13:17:29.790580 13819 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.801661 13830 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.801090 13780 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:29.815516 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.805626 13826 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.798328 13752 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:29.816640 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.818223 10713 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:29.809566 13828 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.824213 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.826093 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:29.829301 13827 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:17:29.832559 13824 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:29.833133 13824 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:29.765518 13812 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:29.840668 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.845777 10079 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:29.847090 13698 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.849848 13698 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:29.850710 13698 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.851049 13698 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:29.852236 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 694) took 2967 ms. Trace:
I20260709 13:17:29.851945 13698 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:29.850132 13805 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
W20260709 13:17:29.854055 13804 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.729s	user 0.000s	sys 0.001s
I20260709 13:17:29.854739 13698 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.856475 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1739) took 1626 ms. Trace:
I20260709 13:17:29.857227 13747 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:29.857894 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.858827 13714 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.856848 10189 rpcz_store.cc:276] 0709 13:17:28.230480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.769215 (+538735us) service_pool.cc:224] Handling call
0709 13:17:28.769537 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.769777 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.769806 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.782479 (+ 12673us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.862946 (+ 80467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:28.862983 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.863055 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.853376 (+990321us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:29.856189 (+  2813us) raft_consensus.cc:1685] finished
0709 13:17:29.856207 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.856411 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6765312,"thread_start_us":64117,"threads_started":1,"wal-append.queue_time_us":334509}
I20260709 13:17:29.861106 10189 pending_rounds.cc:85] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 3
I20260709 13:17:29.861351 10189 pending_rounds.cc:107] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:29.861577 10189 raft_consensus.cc:2889] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.819110 13825 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.862635 10181 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:29.862994 13825 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:29.863976 13631 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260709 13:17:29.864375 13631 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:29.865988 13801 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.739s	user 0.001s	sys 0.000s
I20260709 13:17:29.799369 13822 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.852595 10180 rpcz_store.cc:276] 0709 13:17:26.885222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.156890 (+271668us) service_pool.cc:224] Handling call
0709 13:17:27.157136 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.202431 (+ 45295us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:27.245061 (+ 42630us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.387039 (+141978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.387148 (+   109us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.387223 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.114899 (+1727676us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b18003f8020. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419
0709 13:17:29.851983 (+737084us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54002d37d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:29.852032 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.852169 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43818,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":323,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":58070,"spinlock_wait_cycles":172584704,"thread_start_us":122784,"threads_started":1,"wal-append.queue_time_us":345780,"wal-append.run_cpu_time_us":1079,"wal-append.run_wall_time_us":1002107}
I20260709 13:17:29.867877 13822 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:29.868000 10112 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:29.867893 10109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1510) took 2974 ms (client timeout 2131 ms). Trace:
W20260709 13:17:29.868633 10109 rpcz_store.cc:269] 0709 13:17:26.893577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.116053 (+222476us) service_pool.cc:224] Handling call
0709 13:17:29.867669 (+2751616us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54000b3bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:29.867821 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239177600}
I20260709 13:17:29.861488 13355 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.868152 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:29.878644 10180 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:29.880112 10180 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:29.884325 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 118916us
I20260709 13:17:29.820078 13830 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.889956 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.875914 13355 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:29.893220 13355 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:29.821760 13826 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.865257 13825 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:29.905323 10003 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:29.939371 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 168861us
W20260709 13:17:29.946171 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.897253 13830 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.947032 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:29.947311 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.948782 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:29.949589 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:29.851001 13818 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.953953 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.956830 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:29.974495 10709 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:29.948644 13298 raft_consensus.cc:2764] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:29.954972 13741 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.952468 13822 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.903038 13723 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:29.965387 13565 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:29.966030 13762 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:29.985968 13747 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.988889 13815 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:30.009312 13834 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:30.010326 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2755) took 1384 ms. Trace:
I20260709 13:17:30.010730 10108 rpcz_store.cc:276] 0709 13:17:28.625652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.684325 (+ 58673us) service_pool.cc:224] Handling call
0709 13:17:28.731818 (+ 47493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.232701 (+500883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.010017 (+777316us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540026cad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:30.010252 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149992448}
I20260709 13:17:29.956466 13828 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:29.947417 13832 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:29.956151 13587 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:30.021173 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1439) took 1705 ms. Trace:
I20260709 13:17:30.019923 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:30.052438 10185 rpcz_store.cc:276] 0709 13:17:28.316265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.637681 (+1321416us) service_pool.cc:224] Handling call
0709 13:17:29.638042 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.638322 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:29.638348 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.638862 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.794409 (+155547us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:29.795419 (+  1010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.795504 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.020924 (+225420us) raft_consensus.cc:1685] finished
0709 13:17:30.020946 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.021103 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":155204,"threads_started":1,"wal-append.queue_time_us":264285}
W20260709 13:17:30.053632 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.001232 13741 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.018401 13565 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:30.062155 13739 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:17:30.057111 13828 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:30.007655 13762 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:30.049537 13836 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:30.065941 13812 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.008313 13815 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.077723 13587 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:30.096138 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 76368.7us
I20260709 13:17:30.101433 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:30.102341 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:30.077328 13739 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.114759 13836 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.115444 13836 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.117625 13739 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:30.118247 13836 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.115383 13584 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.119059 13584 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:30.121564 13839 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:30.122009 13584 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:30.126511 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.126837 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:30.139261 13725 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:30.139895 13725 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.086362 13565 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.140677 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:30.139319 13803 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.014s	user 0.000s	sys 0.009s
I20260709 13:17:30.142024 13430 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.142554 13430 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.142987 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2756) took 1470 ms. Trace:
I20260709 13:17:30.146422 10107 rpcz_store.cc:276] 0709 13:17:28.672358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.704211 (+ 31853us) service_pool.cc:224] Handling call
0709 13:17:28.738404 (+ 34193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.738737 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.738765 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.752777 (+ 14012us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.863272 (+110495us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:28.863310 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.863375 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.079355 (+1215980us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:30.142713 (+ 63358us) raft_consensus.cc:1685] finished
0709 13:17:30.142734 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.142927 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34557,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":6301952,"thread_start_us":65417,"threads_started":1,"wal-append.queue_time_us":339774}
I20260709 13:17:30.148926 13735 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.149199 13780 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:30.149942 13780 consensus_queue.cc:1243] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:30.149910 13587 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.124495 13818 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:30.159257 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:30.129688 13584 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:30.171823 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:30.134387 13762 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.133328 13828 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.175616 13584 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.196318 13815 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.197466 13430 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:30.217366 13807 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.811s	user 0.000s	sys 0.001s
I20260709 13:17:30.217514 13584 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:30.203186 13832 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:30.220137 13832 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.222370 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:30.224731 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:30.225440 10713 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:30.227878 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:30.245450 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2744) took 3230 ms. Trace:
I20260709 13:17:30.245957 10112 rpcz_store.cc:276] 0709 13:17:27.015335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.468983 (+453648us) service_pool.cc:224] Handling call
0709 13:17:29.867823 (+2398840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.868403 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.245097 (+376694us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b54000b3bd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:30.245317 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5512997248}
I20260709 13:17:30.236759 13584 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.264261 13584 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:30.299212 13857 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:17:30.293318 13849 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:17:30.300509 13584 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:30.315639 13852 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:30.317274 13826 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.318866 13822 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.326193 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1454) took 1497 ms. Trace:
I20260709 13:17:30.326656 10181 rpcz_store.cc:276] 0709 13:17:28.829300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.159885 (+330585us) service_pool.cc:224] Handling call
0709 13:17:30.325993 (+1166108us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54003f1bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:30.326121 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614376320}
I20260709 13:17:30.339623 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1799) took 1272 ms. Trace:
I20260709 13:17:30.344477 10036 rpcz_store.cc:276] 0709 13:17:29.067255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.067416 (+   161us) service_pool.cc:224] Handling call
0709 13:17:29.067729 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.693039 (+625310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.339347 (+646308us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540031bfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:30.339550 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436230016}
I20260709 13:17:30.340724 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1793) took 1715 ms. Trace:
I20260709 13:17:30.346705 10038 rpcz_store.cc:276] 0709 13:17:28.625352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.628964 (+  3612us) service_pool.cc:224] Handling call
0709 13:17:28.629276 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.799590 (+170314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.799619 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.799666 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:28.799705 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.340482 (+1540777us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001563d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:30.340535 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.340661 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391214464}
I20260709 13:17:30.343354 13584 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.364477 13830 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.366003 13826 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:30.367040 13830 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.368323 13584 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:30.375088 13798 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.251s	user 0.000s	sys 0.004s
W20260709 13:17:30.480659 13847 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.378s	user 0.000s	sys 0.004s
W20260709 13:17:30.521368 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.523415 13789 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.699s	user 0.000s	sys 0.005s
I20260709 13:17:30.585376 13760 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.586058 13760 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.648727 13574 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:30.661703 13657 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.662632 13795 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:30.662984 13795 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:30.663758 13795 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.664523 13760 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:30.663657 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.665458 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.665095 13795 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:30.735320 13769 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.001s	sys 0.008s
W20260709 13:17:30.735826 13769 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.002s	sys 0.008s
I20260709 13:17:30.781791 13824 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.783922 13824 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:30.784327 10710 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:17:30.828986 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.829998 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.831413 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.831873 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 1.63004e+06us
I20260709 13:17:30.832701 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.833505 10181 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:30.834331 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:30.834587 13355 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.830560 13593 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.834372 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.836934 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.830823 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1456) took 1962 ms. Trace:
I20260709 13:17:30.837997 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.838845 10181 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:30.839296 13824 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:30.830933 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.839954 13824 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.835836 13593 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.838315 10186 rpcz_store.cc:276] 0709 13:17:28.868914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.679292 (+810378us) service_pool.cc:224] Handling call
0709 13:17:29.679504 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.679658 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:29.949575 (+269917us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.479978 (+530403us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:30.830471 (+350493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.830529 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:30.830577 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.830651 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.830763 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":768146,"prepare.queue_time_us":264827,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":758467,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":11826432,"thread_start_us":375507,"threads_started":2,"wal-append.queue_time_us":152271}
I20260709 13:17:30.842531 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.842696 13593 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:30.831725 10153 connection.cc:256] RPC call timeout handler was delayed by -1.6358651680000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:17:30.843703 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.844319 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:30.844934 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:30.845350 10181 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.845943 13824 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.851543 10181 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:30.852680 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:30.853139 10181 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:30.853786 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:30.854822 10181 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:30.898947 10110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 624) took 1548 ms (client timeout 1952 ms). Trace:
W20260709 13:17:30.899390 10110 rpcz_store.cc:269] 0709 13:17:29.350570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.354227 (+  3657us) service_pool.cc:224] Handling call
0709 13:17:30.898743 (+1544516us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54002b7d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:30.898879 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672374144}
I20260709 13:17:30.901032 10707 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:30.902745 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 673) took 1081 ms. Trace:
I20260709 13:17:30.903072 10707 rpcz_store.cc:276] 0709 13:17:29.821291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.821718 (+   427us) service_pool.cc:224] Handling call
0709 13:17:30.902524 (+1080806us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004362d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:30.902667 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470406528}
I20260709 13:17:30.935318 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 712) took 2305 ms. Trace:
W20260709 13:17:30.936568 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.935879 10184 rpcz_store.cc:276] 0709 13:17:28.629533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.676745 (+1047212us) service_pool.cc:224] Handling call
0709 13:17:29.677054 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.677239 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:29.807931 (+130692us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.934914 (+1126983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.934978 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:30.935029 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.935100 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.935249 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":945426,"prepare.queue_time_us":230985,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":295281,"threads_started":2,"wal-append.queue_time_us":241689}
I20260709 13:17:30.939896 13824 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:30.940492 13824 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:30.941224 13830 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:30.941778 13830 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.942682 13824 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.944196 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:30.940485 13848 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.944921 13848 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:30.947122 13848 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:30.947268 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:30.950434 13824 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:30.951031 13824 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:30.953372 13824 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:30.960678 10038 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:30.961285 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.011227 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.011938 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.012964 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 721) took 1143 ms. Trace:
I20260709 13:17:31.013617 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.017269 10711 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:31.039435 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:31.040266 10707 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.013406 10185 rpcz_store.cc:276] 0709 13:17:29.870021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.053575 (+183554us) service_pool.cc:224] Handling call
0709 13:17:30.053961 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:30.054289 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.054306 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:30.059156 (+  4850us) log.cc:844] Serialized 26 byte log entry
0709 13:17:30.098482 (+ 39326us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:30.098521 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.098589 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.012668 (+914079us) raft_consensus.cc:1685] finished
0709 13:17:31.012702 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.012891 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":39026,"threads_started":1,"wal-append.queue_time_us":53529}
I20260709 13:17:31.050087 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:31.050873 10185 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:31.051996 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:31.156504 10185 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:31.157727 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:31.158522 10185 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:31.160008 10185 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
W20260709 13:17:31.055735 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.342437 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:31.086043 13765 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:31.344162 13765 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.346441 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1720) took 4129 ms. Trace:
I20260709 13:17:31.346585 13765 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.133431 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.346865 10182 rpcz_store.cc:276] 0709 13:17:27.216878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.354459 (+1137581us) service_pool.cc:224] Handling call
0709 13:17:28.356995 (+  2536us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:28.387443 (+ 30448us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:28.663649 (+276206us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.862791 (+199142us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:28.864969 (+  2178us) log.cc:844] Serialized 52 byte log entry
0709 13:17:28.865131 (+   162us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:28.865364 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.866899 (+  1535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.866972 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.374284 (+1507312us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:30.793792 (+419508us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b180047c3e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c733bc58f 00007f3c6c3fb571 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd
0709 13:17:31.346196 (+552404us) raft_consensus.cc:1685] finished
0709 13:17:31.346223 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.346378 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1931385,"prepare.queue_time_us":107214,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":13311,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":43781,"spinlock_wait_cycles":43965056,"thread_start_us":319122,"threads_started":2,"wal-append.queue_time_us":387467}
I20260709 13:17:31.160856 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:31.053944 13830 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:31.071286 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 131646us
W20260709 13:17:31.342694 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.373448 10031 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:31.382835 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.372325 10036 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.371475 10039 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:17:31.370236 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:31.376156 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.343151 10110 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.352849 10182 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:31.357199 10184 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:31.350888 10185 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:31.668596 10040 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:31.668792 10185 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:17:31.400069 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.671118 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.380951 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 371574us
I20260709 13:17:31.672040 13780 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.672984 13780 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.339864 10707 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:31.380944 10710 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:31.675791 10680 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:31.676100 13889 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.676294 10710 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:31.676962 13889 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.677950 10710 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.679366 10710 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.379192 13298 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.440963 13405 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:31.348309 13574 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:31.394596 13577 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:31.357018 13765 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:17:31.450510 13883 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.452420 13879 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.539800 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.544593 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:31.549281 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 557) took 2390 ms. Trace:
I20260709 13:17:31.574610 13888 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.652065 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:31.583882 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 67101.1us
I20260709 13:17:31.590049 13725 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.592567 13741 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.590108 13274 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.600176 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.709128 10111 raft_consensus.cc:2410] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:31.708817 13274 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.708967 13883 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.609329 13743 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:31.710731 13459 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:31.609381 13887 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:31.712327 13887 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.713236 13274 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.609231 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.614842 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:31.691085 13891 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.713001 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.696247 13577 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.697701 10034 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.698786 13879 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.701046 13298 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.704861 13890 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:31.705297 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 860953us
I20260709 13:17:31.703603 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 708) took 3624 ms. Trace:
W20260709 13:17:31.706393 10078 leader_election.cc:336] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.756s (SENT)
I20260709 13:17:31.613325 13820 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.712819 13888 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.713986 13240 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.714790 13848 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:31.715081 13887 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:31.610703 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:31.710947 13743 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.689147 10035 rpcz_store.cc:276] 0709 13:17:29.159100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.159204 (+   104us) service_pool.cc:224] Handling call
0709 13:17:29.164027 (+  4823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.694397 (+530370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.547267 (+1852870us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540031ddd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:31.549024 (+  1757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218295040}
I20260709 13:17:31.682614 10185 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:31.695606 13567 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.679497 13889 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.691195 13405 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.725711 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.729218 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.729398 13240 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.730300 10109 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:17:31.723415 13780 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.732141 13891 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.732653 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:31.734288 13888 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.734855 13891 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.731396 13567 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.736653 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:31.737591 10033 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.722177 10188 rpcz_store.cc:276] 0709 13:17:28.078962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.746970 (+668008us) service_pool.cc:224] Handling call
0709 13:17:28.779667 (+ 32697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.779891 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:28.792512 (+ 12621us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.874773 (+ 82261us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.865345 (+990572us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:31.702823 (+1837478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.702933 (+   110us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:31.703043 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.703163 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.703385 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2828839,"prepare.queue_time_us":12550,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2742,"raft.queue_time_us":1926365,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":37276928,"thread_start_us":74810,"threads_started":1,"wal-append.queue_time_us":334409,"wal-append.run_cpu_time_us":3155,"wal-append.run_wall_time_us":1740769}
I20260709 13:17:31.741856 10036 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:31.743078 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.745826 13298 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.748253 13274 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:31.748797 13240 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.749589 13577 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.712399 13574 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.752707 13574 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.727213 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:31.750524 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:31.737090 13848 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.764820 13891 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:31.765345 10037 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.766765 13848 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.769447 13830 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:31.773519 13567 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.774014 13894 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.774580 10112 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:17:31.775074 10112 pending_rounds.cc:85] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 9
I20260709 13:17:31.775355 10112 pending_rounds.cc:107] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:31.776077 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:31.776986 13894 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.778268 13879 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.778884 10033 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:31.779868 10114 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:31.780365 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:31.780055 13274 consensus_queue.cc:1243] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:17:31.782595 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 117018us
I20260709 13:17:31.711668 13459 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.783659 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 632) took 2001 ms. Trace:
I20260709 13:17:31.775669 10112 raft_consensus.cc:2889] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.783546 13405 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:31.784348 13890 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.806042 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:17:31.807104 10113 raft_consensus.cc:606] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:17:31.808386 10106 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:31.808852 10106 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:31.809617 10186 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.810236 13820 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.811882 10112 pending_rounds.cc:107] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:31.812232 10112 raft_consensus.cc:2889] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.812744 13820 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:31.754464 13883 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:31.814378 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.801939 10115 rpcz_store.cc:276] 0709 13:17:29.781959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.865031 (+ 83072us) service_pool.cc:224] Handling call
0709 13:17:29.865333 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.428626 (+1563293us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:31.504453 (+ 75827us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.718218 (+213765us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.770706 (+ 52488us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.770896 (+   190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:31.771292 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.780392 (+  9100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.783032 (+  2640us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400189f54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:31.783084 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.783269 (+   185us) raft_consensus.cc:1685] finished
0709 13:17:31.783294 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.783461 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8830,"prepare.queue_time_us":20865,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":187374,"raft.run_cpu_time_us":541,"raft.run_wall_time_us":543,"spinlock_wait_cycles":3594264448,"thread_start_us":257588,"threads_started":3,"wal-append.queue_time_us":70116}
I20260709 13:17:31.807524 10113 raft_consensus.cc:614] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:31.808737 13459 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:31.826803 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.832170 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.834589 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:31.835346 10710 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:31.835721 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:31.809975 10106 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:31.837004 10034 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:31.845305 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.874320 10186 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:31.787952 13274 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:17:31.836615 13887 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:31.876233 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:31.877060 10184 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:31.878131 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:31.879402 10185 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:31.880285 13657 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.880872 13657 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:31.881628 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:31.882005 10078 leader_election.cc:336] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.869s (SENT)
I20260709 13:17:31.882565 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:31.882907 10106 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:31.883782 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70544us
I20260709 13:17:31.787032 13893 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:17:31.885962 13893 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:31.883445 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:31.886272 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 210909us
I20260709 13:17:31.879443 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.886874 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:31.932237 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59283.5us
I20260709 13:17:31.950467 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1761) took 1041 ms. Trace:
I20260709 13:17:31.950882 10186 rpcz_store.cc:276] 0709 13:17:30.833570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.842243 (+  8673us) service_pool.cc:224] Handling call
0709 13:17:31.779995 (+937752us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:31.874919 (+ 94924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21560064}
I20260709 13:17:31.954275 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:31.954602 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.955472 10036 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:31.956588 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.957242 10033 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:31.961367 10110 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:31.961848 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1725) took 4743 ms. Trace:
I20260709 13:17:31.927894 13820 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:31.954339 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.968329 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:31.973477 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.933723 13743 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:31.886366 13893 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:31.967891 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.975497 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.975708 13890 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.976071 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.976328 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.959285 13887 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:31.994096 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.994832 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:31.995882 10109 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:31.996802 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:31.997304 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.997725 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.998353 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.998518 10035 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:31.998646 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:31.998867 10182 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:31.999790 10714 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:32.000180 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.000957 13848 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.001550 13848 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:32.002689 13848 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.003294 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:32.003628 13567 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:32.004065 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 1.16965e+06us
I20260709 13:17:32.004384 10037 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.004813 10106 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:32.005164 10106 pending_rounds.cc:85] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 6
I20260709 13:17:32.005378 10106 pending_rounds.cc:107] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:32.005589 10106 raft_consensus.cc:2889] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.006374 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:32.007472 10039 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.008000 10185 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:32.008611 10036 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:31.999521 10033 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:31.999509 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:32.009104 13820 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.009591 13657 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.000933 10186 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:32.002864 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:31.992354 10107 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:31.992688 10034 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:32.017354 10108 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:32.017586 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.020859 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:32.010643 10040 raft_consensus.cc:2376] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9. Re-sending same reply.
I20260709 13:17:32.021466 10114 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:32.021874 10114 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:32.023168 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48369.7us
I20260709 13:17:32.024857 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.026427 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:32.029512 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 147570us
I20260709 13:17:32.030355 10114 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:32.031901 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81813.8us
I20260709 13:17:32.031584 13745 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:17:32.033097 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.034350 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.035192 10182 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:32.036186 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:32.030766 10078 connection.cc:256] RPC call timeout handler was delayed by -2.0877317220001714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:17:32.020008 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1764) took 1185 ms. Trace:
I20260709 13:17:32.031641 10114 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.036971 10112 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:32.035125 13745 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:32.039994 10078 leader_election.cc:336] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.788s (SENT)
I20260709 13:17:32.040526 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.041540 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.041827 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.042304 10107 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:32.043057 13405 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.044130 13274 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.045228 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.044934 13274 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.045619 13030 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.048391 10078 connection.cc:256] RPC call timeout handler was delayed by -1.3637388520000968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 13:17:32.049580 10078 connection.cc:256] RPC call timeout handler was delayed by -1.3466388520000692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:17:32.037276 10715 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:32.052407 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.044100 13405 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:32.055339 10078 connection.cc:256] RPC call timeout handler was delayed by -1.217038852000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:17:32.055791 10078 connection.cc:256] RPC call timeout handler was delayed by -1.1931338890001371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3289s for a response
W20260709 13:17:32.056152 10078 connection.cc:256] RPC call timeout handler was delayed by -1.1918388520000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:17:32.056496 10078 connection.cc:256] RPC call timeout handler was delayed by -1.1538501110001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.38620000000000004s for a response
W20260709 13:17:32.056872 10078 connection.cc:256] RPC call timeout handler was delayed by -1.1090388520001397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:17:32.053577 10035 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
W20260709 13:17:32.057575 10078 connection.cc:256] RPC call timeout handler was delayed by -1.0919388520001121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:17:32.057909 10078 connection.cc:256] RPC call timeout handler was delayed by -1.0152140239999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
I20260709 13:17:32.055660 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:31.962903 10183 rpcz_store.cc:276] 0709 13:17:27.218404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.389730 (+1171326us) service_pool.cc:224] Handling call
0709 13:17:28.391299 (+  1569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.391501 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:28.671160 (+279659us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.216814 (+1545654us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:31.961173 (+1744359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.961281 (+   108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:31.961392 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.961490 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.961673 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2717400,"prepare.queue_time_us":171221,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"spinlock_wait_cycles":6275456,"thread_start_us":747981,"threads_started":3,"wal-append.queue_time_us":693524,"wal-append.run_cpu_time_us":10197,"wal-append.run_wall_time_us":2017686}
I20260709 13:17:32.060597 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:32.048974 13745 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.075147 10109 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:32.071029 13745 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.037833 10181 rpcz_store.cc:276] 0709 13:17:30.834261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.873340 (+ 39079us) service_pool.cc:224] Handling call
0709 13:17:30.873649 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.873859 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:30.875810 (+  1951us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.992845 (+1117035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.019370 (+ 26525us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:32.019459 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.019565 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.019796 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939578,"prepare.queue_time_us":1869,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":2304,"thread_start_us":138959,"threads_started":3,"wal-append.queue_time_us":1253,"wal-append.run_cpu_time_us":1173,"wal-append.run_wall_time_us":1050666}
I20260709 13:17:32.083320 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.070637 13405 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.087648 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.088207 13574 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.090385 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 720) took 2221 ms. Trace:
I20260709 13:17:32.076643 13657 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.091970 13890 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.093369 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.105005 13889 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:32.068424 13888 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:32.113447 10110 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:32.121505 10107 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:32.113931 13405 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.114892 10180 rpcz_store.cc:276] 0709 13:17:29.869138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.882029 (+ 12891us) service_pool.cc:224] Handling call
0709 13:17:29.884357 (+  2328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.961873 (+2077516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.961920 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.962502 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.056871 (+ 94369us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:32.056927 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.057040 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.090010 (+ 32970us) raft_consensus.cc:1685] finished
0709 13:17:32.090031 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.090198 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1932032,"thread_start_us":122153,"threads_started":2,"wal-append.queue_time_us":125244}
I20260709 13:17:32.116545 13459 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:32.132593 10078 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.730s (SENT)
I20260709 13:17:32.130652 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.116873 13657 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.137440 13888 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.140101 13274 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:32.120525 13891 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:17:32.125125 13890 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:32.127396 13820 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:32.147866 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.148120 13459 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:32.132284 13574 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:32.154145 10078 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.921s (SENT)
I20260709 13:17:32.156278 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.157728 13657 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.158366 10109 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:32.121932 13889 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:32.140672 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0380 after lost signal to thread 8942
W20260709 13:17:32.197355 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0680 after lost signal to thread 9972
W20260709 13:17:32.197616 10078 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.013s (SENT)
I20260709 13:17:32.198145 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:32.198922 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0f80 after lost signal to thread 10064
W20260709 13:17:32.199287 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0f60 after lost signal to thread 10065
I20260709 13:17:32.198559 13893 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.132573 13405 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:32.163277 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 91076.5us
I20260709 13:17:32.200316 13893 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.201865 13274 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.202699 13274 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.203881 13831 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.204382 13831 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.204774 13831 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.205014 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 87324.3us
W20260709 13:17:32.205852 10737 debug-util.cc:398] Leaking SignalData structure 0x7b0800341ac0 after lost signal to thread 10139
W20260709 13:17:32.206247 10737 debug-util.cc:398] Leaking SignalData structure 0x7b0800378760 after lost signal to thread 10140
I20260709 13:17:32.129627 13830 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.135210 13887 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.209045 13830 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.211311 13830 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.118755 13780 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:17:32.192663 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 99451.7us
I20260709 13:17:32.213438 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:32.207926 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:32.214546 13574 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:32.215265 13907 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.073796 13894 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:17:32.215621 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:32.216792 13907 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.217186 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:32.217650 13820 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.217890 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.218130 13820 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:32.221755 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49030us
W20260709 13:17:32.222718 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.223359 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.199635 10078 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.032s (SENT)
I20260709 13:17:32.224227 13574 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:32.225601 13743 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:32.226043 13743 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:32.226591 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.226972 13743 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.225976 13574 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:32.228768 13574 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.224439 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:32.232460 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.233129 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.233464 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.233880 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.218485 13780 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.236159 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.236327 10112 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:32.236773 10111 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:32.237768 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddf60 after lost signal to thread 10187
I20260709 13:17:32.237684 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.238489 10113 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:32.239327 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:32.240125 10115 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:32.175365 13567 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.204070 13890 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:32.242365 10078 leader_election.cc:336] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.100s (SENT)
I20260709 13:17:32.242825 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.243646 13780 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.244300 13907 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.245451 13657 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.236171 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:32.249122 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:32.246889 10078 leader_election.cc:336] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.166s (SENT)
W20260709 13:17:32.251132 10078 leader_election.cc:336] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.194s (SENT)
I20260709 13:17:32.251617 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.252486 13907 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:32.253140 10078 leader_election.cc:336] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.222s (SENT)
I20260709 13:17:32.253706 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.247753 13405 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:32.238632 10737 debug-util.cc:398] Leaking SignalData structure 0x7b080013f5a0 after lost signal to thread 10213
I20260709 13:17:32.254117 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:32.254554 10737 debug-util.cc:398] Leaking SignalData structure 0x7b080037b640 after lost signal to thread 10214
I20260709 13:17:32.253487 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:32.229403 13888 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:32.257426 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7160 after lost signal to thread 10740
W20260709 13:17:32.257898 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4fe0 after lost signal to thread 13355
W20260709 13:17:32.258193 10737 debug-util.cc:398] Leaking SignalData structure 0x7b080034a240 after lost signal to thread 13458
W20260709 13:17:32.268949 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc1a0 after lost signal to thread 13593
I20260709 13:17:32.280769 10107 raft_consensus.cc:2368] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
I20260709 13:17:32.285663 10114 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:32.286823 10110 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:32.288432 10108 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:32.289414 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 67906.1us
I20260709 13:17:32.292900 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.294659 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.295079 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.295552 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.296023 10115 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
W20260709 13:17:32.303439 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.296236 10111 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:32.285854 13780 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.327987 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:32.328845 10113 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:32.333709 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:32.338285 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08001272a0 after lost signal to thread 13782
I20260709 13:17:32.337028 10109 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
W20260709 13:17:32.344866 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.256844 13459 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:32.346644 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 301538us
I20260709 13:17:32.351337 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
W20260709 13:17:32.352442 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55263us
I20260709 13:17:32.341012 13298 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.362169 13910 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.362524 13593 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.363044 13593 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:32.363674 13577 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:17:32.364043 13638 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.364563 13638 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.366876 13638 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:32.367405 13638 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:32.370929 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.346300 13848 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.322149 13820 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.359043 10710 raft_consensus.cc:606] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.359160 13298 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.360486 13879 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:32.384141 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 135092us
W20260709 13:17:32.386004 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 184683us
I20260709 13:17:32.350935 13831 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.378890 13779 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:32.396059 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 142936us
I20260709 13:17:32.378238 13910 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:32.384865 13816 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.406746 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 114278us
I20260709 13:17:32.383620 13298 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.421811 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:32.426412 10039 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.429001 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:32.429881 10034 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
W20260709 13:17:32.430584 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49248.8us
I20260709 13:17:32.384992 13879 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.395391 13779 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.438951 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:32.428133 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:32.440852 10037 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.399535 13910 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.440140 13657 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:32.447400 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.447624 13908 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:17:32.450459 10033 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:17:32.451927 10078 leader_election.cc:336] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.226s (SENT)
I20260709 13:17:32.454315 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.434891 13405 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.435182 13879 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.441458 13779 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.480510 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 128182us
I20260709 13:17:32.482558 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.433986 13816 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.487380 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.496536 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.504012 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.506034 13405 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.507473 13895 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.508741 13831 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.509765 13922 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.510217 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:32.510890 10188 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.456610 13889 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.507274 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.516417 13889 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.503057 13887 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:32.521070 10188 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:32.521499 10712 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:32.450299 13848 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:17:32.523968 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:32.524447 10712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 672) took 2704 ms (client timeout 1581 ms). Trace:
W20260709 13:17:32.524863 10712 rpcz_store.cc:269] 0709 13:17:29.819947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.820980 (+  1033us) service_pool.cc:224] Handling call
0709 13:17:32.524161 (+2703181us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b5400690d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:32.524339 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6199406848}
I20260709 13:17:32.525344 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.526105 10109 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:32.527441 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1457) took 3561 ms. Trace:
I20260709 13:17:32.527853 10187 rpcz_store.cc:276] 0709 13:17:28.875393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.781971 (+906578us) service_pool.cc:224] Handling call
0709 13:17:29.782284 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.782495 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:29.910762 (+128267us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.357109 (+2446347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.380886 (+ 23777us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:32.382817 (+  1931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.396269 (+ 13452us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.436978 (+ 40709us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2205007,"prepare.queue_time_us":205405,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1813,"raft.queue_time_us":2316424,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":332398,"threads_started":3,"wal-append.queue_time_us":172123,"wal-append.run_cpu_time_us":1262,"wal-append.run_wall_time_us":1031596}
I20260709 13:17:32.530350 13926 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:32.530965 13926 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:32.424827 13593 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:32.531936 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 799395us
I20260709 13:17:32.537380 13743 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:32.521673 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 488749us
I20260709 13:17:32.503031 10111 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:32.507375 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.547417 10115 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
I20260709 13:17:32.525473 13899 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.552568 10039 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:32.554037 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.561970 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.564577 13355 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:32.565254 13355 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.566463 13657 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.567059 13657 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:32.567993 13657 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.577423 13816 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:32.531930 13926 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.457145 13745 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.551218 10037 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:32.601553 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.510200 13922 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.612886 10031 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.613855 10110 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:32.620400 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:32.620288 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:32.621039 10710 raft_consensus.cc:606] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.621435 10710 raft_consensus.cc:614] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:32.622298 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:32.622776 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.623356 10113 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:32.621172 10715 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:32.628602 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:32.630370 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 188660us
W20260709 13:17:32.635257 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 183387us
I20260709 13:17:32.616654 13922 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.623157 13405 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:32.652025 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 204705us
I20260709 13:17:32.653766 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:32.654393 10031 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.652293 10078 leader_election.cc:336] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.231s (SENT)
I20260709 13:17:32.657858 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.638832 13895 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.648581 13915 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.664392 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:32.674674 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 112828us
W20260709 13:17:32.676258 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.667119 13252 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:17:32.678210 13252 consensus_queue.cc:1243] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:32.678347 13921 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.678751 13252 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:32.679157 13252 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:32.680078 13252 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.681342 13252 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.682158 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:32.626854 13910 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:32.677718 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.688429 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:32.657372 13638 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.688201 13910 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.691475 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:32.692140 10180 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.693463 13458 raft_consensus.cc:2764] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:17:32.692101 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:32.700258 10180 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:32.634454 13899 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.700898 13933 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.701395 13933 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.701740 13933 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.702433 13899 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:32.706269 13934 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:32.700313 10038 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:32.668480 13405 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:32.716939 13848 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:32.717329 13745 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.718302 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.720266 10037 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.708683 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:32.721767 13930 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:32.722476 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:32.703444 13355 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:32.691823 13915 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.724537 13899 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:32.724912 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.725126 13899 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:32.725598 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.726233 10111 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:32.726142 13899 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.727401 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.729667 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.733716 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:32.735013 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82751.3us
I20260709 13:17:32.738022 10031 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:32.739447 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:32.710314 13893 consensus_meta.cc:287] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.510s	user 0.003s	sys 0.005s
W20260709 13:17:32.740528 10078 leader_election.cc:336] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.613s (SENT)
I20260709 13:17:32.726135 13915 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.739881 13355 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.733597 13298 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.742774 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:32.743124 13577 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:32.747124 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.740728 13889 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.750186 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.752938 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:32.758332 10111 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.741014 13745 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.759981 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.762848 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:32.764420 13694 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:32.764879 13887 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.765306 13887 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:32.759301 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:32.767319 10184 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.766036 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.765700 13887 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.736474 13638 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.756551 13577 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:32.748144 13890 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:17:32.763445 13889 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:32.766180 13831 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.769464 13908 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:32.751807 13930 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:32.791109 13745 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:32.797612 13577 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:32.808487 13745 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.823879 13920 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:32.828163 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 91545.2us
I20260709 13:17:32.828728 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:32.828964 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 63021.8us
W20260709 13:17:32.829802 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63622.3us
I20260709 13:17:32.831950 13567 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.831846 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.832660 10114 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:32.833272 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:32.814745 13936 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:32.833882 13638 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:32.783094 13355 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.837219 13355 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:32.838734 13298 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.828529 13912 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.841004 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.801328 13889 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.832573 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.832187 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.850363 10108 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:32.852272 13355 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.852456 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.843567 13912 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.853250 10114 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:32.852767 13355 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.854439 13355 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.860074 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.860833 10186 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:32.861929 13919 raft_consensus.cc:993] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:32.862509 13919 raft_consensus.cc:1081] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:32.800755 13908 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:32.864070 13908 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:32.803129 13879 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.866386 13879 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.804291 13915 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:32.870748 13937 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 13:17:32.871981 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:32.873395 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:32.870805 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:32.765413 13405 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:32.884544 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 175585us
I20260709 13:17:32.884508 10184 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:32.874554 10183 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.885876 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:32.886582 10106 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:32.849731 10109 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
W20260709 13:17:32.889101 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 224252us
I20260709 13:17:32.890700 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:32.832566 13567 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:32.893097 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:32.853206 13912 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.904881 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.864182 13355 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:32.912545 13298 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.914134 13355 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:32.903627 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:17:32.915066 13567 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.917071 10106 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:32.921160 13745 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:32.923645 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:32.924293 10108 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:32.925196 13944 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:32.926426 13920 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.932322 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:32.939962 13779 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:32.942977 13779 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:32.945830 10712 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:32.908895 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:32.915128 10181 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.950611 10181 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.952696 10111 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:32.960098 10709 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:32.986258 10031 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:32.884168 13638 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:32.904440 13574 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.992544 10188 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:33.000159 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:33.000988 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:33.000267 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.909512 13915 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:33.015547 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.016880 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.017887 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:33.018447 10037 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.019351 10114 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:33.019999 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.021719 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 131150us
I20260709 13:17:33.024947 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.017580 10182 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:33.022745 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:32.997314 13694 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.999655 13574 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.030459 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.030923 10710 raft_consensus.cc:606] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:17:33.030071 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.036412 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.036670 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.040254 10188 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:33.040809 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:33.041532 10113 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.042287 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.047924 10108 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:17:33.050681 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 147809us
I20260709 13:17:33.036885 13298 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:17:33.038085 13458 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.051970 13889 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.096623 13889 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:33.037959 13920 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.097626 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:33.099692 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122084us
I20260709 13:17:33.100541 10108 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.101444 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.104342 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.104480 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.105803 10185 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
W20260709 13:17:33.106767 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.052690 10187 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:33.044147 13574 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.084992 10184 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:33.032104 13830 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.073119 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.031500 13899 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.014950 13638 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:33.089233 13947 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:33.090619 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1747) took 3707 ms. Trace:
W20260709 13:17:33.092949 13946 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:33.074996 13694 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.087110 13458 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.156040 13458 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.108934 10181 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:33.160214 13940 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
W20260709 13:17:33.134114 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 87770.1us
I20260709 13:17:33.135661 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.161935 10186 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:33.073302 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49386.1us
I20260709 13:17:33.046708 13915 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.153889 13927 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:33.172024 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.174209 13298 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.174736 13298 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:33.175009 13950 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:33.175114 13298 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.175650 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.176118 13913 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:33.176689 13913 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:33.177378 13694 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.177668 13913 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:33.180560 13948 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:17:33.182431 13922 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.005s
I20260709 13:17:33.182849 13922 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.115410 13355 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:17:33.180610 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:33.113397 13895 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.176867 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.133929 13593 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:33.194185 10037 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:33.197592 10032 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.201375 10712 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 12. Ops: []
I20260709 13:17:33.203120 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:33.203943 10181 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:33.204232 10031 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:33.205068 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:33.206588 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 102193us
I20260709 13:17:33.143270 13899 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.185770 13934 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.216774 10108 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.146391 10189 rpcz_store.cc:276] 0709 13:17:29.202535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.860574 (+658039us) service_pool.cc:224] Handling call
0709 13:17:29.860914 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:32.555202 (+2694288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.555246 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:32.555970 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:17:32.626925 (+ 70955us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:32.626956 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.637728 (+ 10772us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.870033 (+232305us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:32.888010 (+ 17977us) raft_consensus.cc:1685] finished
0709 13:17:32.888030 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.910359 (+ 22329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2394807,"raft.queue_time_us":2506327,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":27421056,"thread_start_us":299905,"threads_started":2,"wal-append.queue_time_us":143108}
I20260709 13:17:33.221282 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:33.227615 10709 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:33.191666 13567 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:33.228328 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.227967 10709 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:33.170694 13830 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.237097 13893 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:33.237553 10709 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.238262 10181 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:33.238520 10709 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.239765 13459 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:33.243095 13957 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:17:33.251273 13953 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:17:33.234582 10034 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:33.257098 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49727.5us
I20260709 13:17:33.209198 13831 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.254859 13274 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:33.257917 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:33.234776 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 132149us
I20260709 13:17:33.258709 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:33.260485 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.198825 13888 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:17:33.222144 13899 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.262655 10185 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.262452 10108 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:33.266319 13745 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:33.282433 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:33.231071 13934 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:33.305943 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48125us
I20260709 13:17:33.308377 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.261251 13274 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:33.307047 10711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:33.313551 10711 raft_consensus.cc:606] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:33.313952 10711 raft_consensus.cc:614] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:33.314735 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.318153 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:33.318783 10114 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.295205 13934 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.381480 10112 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:33.384140 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60106.2us
I20260709 13:17:33.295258 13745 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:33.381060 13930 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:33.428134 10078 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.642s (SENT)
W20260709 13:17:33.444887 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 137976us
W20260709 13:17:33.443138 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 266322us
I20260709 13:17:33.391285 13921 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.452476 10185 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:33.462472 10113 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:33.468570 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:33.469452 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 161155us
W20260709 13:17:33.476178 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48098.2us
I20260709 13:17:33.322867 13816 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:17:33.483196 10114 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:33.474516 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.444738 13930 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:33.455808 13890 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:33.494367 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48690.8us
I20260709 13:17:33.501574 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:33.556392 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81968.2us
I20260709 13:17:33.561024 10114 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:17:33.562839 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 180577us
I20260709 13:17:33.578791 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:33.578784 10183 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.001s
I20260709 13:17:33.561470 13935 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:33.496605 13930 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.579954 10183 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:17:33.568408 13887 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.766s	user 0.005s	sys 0.005s
I20260709 13:17:33.556094 13779 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:33.570652 13458 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.578356 13816 consensus_queue.cc:1243] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:33.571026 13922 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:33.582439 13933 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.880s	user 0.013s	sys 0.000s
I20260709 13:17:33.599054 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:33.601923 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.580591 13935 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.559433 13890 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.586719 13252 raft_consensus.cc:2764] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:33.582103 13883 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:33.607100 10187 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:33.610440 13458 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:33.609236 13935 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.604557 13933 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.581468 13745 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.622440 13961 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.598230 13779 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.640407 13922 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.624756  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:33.624745 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:33.797663 10114 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.704535 13355 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:17:33.623632 10004 leader_election.cc:400] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
I20260709 13:17:33.798669 10004 leader_election.cc:403] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.621419 13978 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:33.622699 13964 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.636746 13298 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.652096 10183 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:33.653524 13890 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.599947 13638 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:33.476848 13921 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.840080 13816 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:33.842051 13921 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.656162 13971 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:33.657645 13899 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.623844 13965 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:33.624421 13973 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.624869 13968 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:33.640136 13952 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
W20260709 13:17:33.673025 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50773.9us
I20260709 13:17:33.666446 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:33.664319 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 75473.4us
W20260709 13:17:33.665162 13908 consensus_meta.cc:287] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.003s
W20260709 13:17:33.646041 13920 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.002s
W20260709 13:17:33.663384 13574 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.000s
W20260709 13:17:33.655550 13577 consensus_meta.cc:287] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.000s
I20260709 13:17:33.559242 13274 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.590725 13887 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.881294 13887 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.662683 13930 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.883283 13930 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:33.884230 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.884786 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.887434 10716 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.889074 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 822) took 1017 ms. Trace:
I20260709 13:17:33.889422 10716 rpcz_store.cc:276] 0709 13:17:32.871271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.871849 (+   578us) service_pool.cc:224] Handling call
0709 13:17:32.872141 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.887945 (+1015804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.888807 (+   862us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400593654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:33.888991 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334204288}
W20260709 13:17:33.799131 10709 consensus_meta.cc:287] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.002s
I20260709 13:17:33.812017 13927 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:33.785831 13883 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.829460 13779 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.890740 13927 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:33.891917 13927 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.892376 13883 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.893124 13927 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.894246 13934 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:33.895331 10038 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:33.831610 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.896287 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 272830us
I20260709 13:17:33.897070 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.835173 13298 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.898240 13298 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:33.836262 13974 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.275s	user 0.001s	sys 0.007s
I20260709 13:17:33.898521 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.839938 13961 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.843607 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:33.900822 13933 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.851354 10114 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:33.902787 13899 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:33.904753 10078 leader_election.cc:336] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.842s (SENT)
I20260709 13:17:33.905222 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:33.906644 13298 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.907073 13298 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.907413 13298 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.908042 13274 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.909994 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1822) took 1518 ms. Trace:
I20260709 13:17:33.911497 10038 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:33.890703 10709 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:33.912132 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:33.845701 13657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.015s
I20260709 13:17:33.860080 13921 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.822880 13978 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:33.869165 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 367695us
I20260709 13:17:33.825030 13848 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
I20260709 13:17:33.823915 13964 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:33.854034 13780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.015s
I20260709 13:17:33.874107 10710 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:33.875960 13968 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:33.916113 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:33.934250 13657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.005s	sys 0.015s
I20260709 13:17:33.869510 13965 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:33.918293 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:33.918581 13694 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:33.918951 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:33.944118 10106 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.919731 13899 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:33.919920 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:33.911110 13574 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.955359 13574 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:33.955981 13638 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.900962 13577 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.956871 10185 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:33.958011 13577 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:33.866539 13973 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:33.958772 13973 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.873744 13908 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:33.958909 13912 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.995s	user 0.012s	sys 0.000s
I20260709 13:17:33.875126 13920 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.960224 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:33.959434 13912 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.925309 13915 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:33.910367 10035 rpcz_store.cc:276] 0709 13:17:32.391685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.399131 (+  7446us) service_pool.cc:224] Handling call
0709 13:17:32.435593 (+ 36462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:32.644231 (+208638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.644264 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:32.669253 (+ 24989us) log.cc:844] Serialized 52 byte log entry
0709 13:17:32.994881 (+325628us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:32.994918 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.994985 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.909763 (+914778us) raft_consensus.cc:1685] finished
0709 13:17:33.909783 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.909916 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13454,"raft.queue_time_us":56907,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"thread_start_us":410561,"threads_started":2,"wal-append.queue_time_us":451264}
I20260709 13:17:33.929128 13405 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:33.928982 13890 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.962877 13890 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:33.963208 13890 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:33.932353 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:33.964704 13908 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:33.965303 13908 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.932901 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:33.933911 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.967518 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.967347 13990 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:33.970458 13910 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.936007 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:33.937341 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.973311 13574 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.973585 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:33.976305 13985 raft_consensus.cc:2764] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:33.976737 10188 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:33.900826 13961 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:33.916229 13895 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:33.941710 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:33.977625 13895 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.978722 13890 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:33.979928 13890 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:33.942201 13780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.010s	sys 0.016s
I20260709 13:17:33.944357 13458 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:17:33.947181 10033 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.948275 13968 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.944722 13694 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:33.985558 13694 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.986946 13694 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.988163 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:33.988829 10186 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.989415 10710 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:33.991343 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.948688 13965 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:33.992163 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:33.940075 13978 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.942972 13355 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:33.994737 13355 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:33.995666 13355 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.939952 13921 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:33.941838 13933 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.940132 13964 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.951330 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:33.953740 10155 leader_election.cc:400] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:34.006321 10155 leader_election.cc:403] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.960337 10711 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.923018 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:33.973686 13574 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:33.982095 13458 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:33.938325 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:34.002782 10106 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:33.991233 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:33.992174 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:33.988185 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:34.010965 10187 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:34.012070 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 60802.4us
I20260709 13:17:34.005196 10186 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:34.014601 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:34.015239 13458 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:34.012858 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:33.962400 13912 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:33.935312 13274 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.021781 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:34.024919 10187 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.022415 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:34.023488 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:34.029536 10186 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:34.016978 13574 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.019299 13961 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:34.020305 13928 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.016693 13252 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
W20260709 13:17:34.033182 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 94942.1us
I20260709 13:17:34.036880 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.005924 13933 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:34.033349 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:34.040628 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 87040.3us
I20260709 13:17:34.030936 13920 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:34.019153 13935 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.046849 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.047478 10111 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.048426 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.048017 10186 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:34.046995 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.035224 13961 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:34.054720 10106 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:34.039541 13933 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.039458 13567 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.058609 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:34.059223 10111 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:34.060889 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:34.061884 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.041867 13912 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:34.062706 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.062685 10111 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:34.044843 13922 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:34.068909 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.069425 10111 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.031476 13274 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.074419 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:34.075544 10186 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:34.076241 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:34.058936 13961 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.077486 10710 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:34.056713 13920 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:34.077891 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.082571 10106 raft_consensus.cc:2368] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11.
W20260709 13:17:34.065933 13995 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:17:34.083906 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.084714 10181 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.085758 10111 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:34.062297 13567 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.039736 13928 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.074738 13252 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:34.088691 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.093815 10112 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:34.104501 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.105077 10110 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.106717 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:34.093648 10078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.074s (SENT) [suppressed 28 similar messages]
I20260709 13:17:34.107309 10115 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
W20260709 13:17:34.109666 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51974.2us
I20260709 13:17:34.099104 13978 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.083313 13912 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:34.087713 13567 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.094657 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:34.116156 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.118088 10106 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:34.117996 13910 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:34.118140 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.118687 13910 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:34.118983 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.119274 13879 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.119675 13910 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.121119 13298 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.100901 13921 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.106632 13922 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.131372 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:34.132334 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.133931 10185 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.134018 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:34.134272 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51041us
I20260709 13:17:34.134716 10115 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.135028 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.061929 13458 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.143795 13458 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.145780 13978 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:34.146097 13274 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.148653 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:34.150288 10034 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:34.150565 13928 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.151278 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:34.154754 13912 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.156692 13274 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:34.163576  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:34.162743 13274 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.171491 13405 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:34.172902 13657 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:34.173281 13657 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:34.170912 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:34.174129 13657 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.175328 13657 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.175519 13921 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.177765 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1789) took 1083 ms. Trace:
I20260709 13:17:34.178151 10182 rpcz_store.cc:276] 0709 13:17:33.094307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.097313 (+  3006us) service_pool.cc:224] Handling call
0709 13:17:34.177552 (+1080239us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400096854. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:34.177677 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982192000}
I20260709 13:17:34.180819 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.181524 10112 raft_consensus.cc:2368] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9.
I20260709 13:17:34.185148 10184 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:34.182271 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.183440 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.187670 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:34.188246 10182 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.189574 10115 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:34.189944 10153 leader_election.cc:400] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9.
I20260709 13:17:34.190245 10153 leader_election.cc:403] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:34.192601 10185 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:34.192737 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.193815 10108 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:34.195560 10106 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:34.197340 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.088258 13895 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.200619 10110 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:34.204386 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:34.211562 10183 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
W20260709 13:17:34.186302 13995 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:34.240350 10032 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:34.212946 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:34.246744 10039 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:34.197021 13593 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9.
W20260709 13:17:34.243040 13993 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:17:34.212779 13948 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:34.263466 10187 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:34.253926 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:34.201643 13978 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:34.212637 13922 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:34.282792 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 141561us
I20260709 13:17:34.284016 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:34.203855 13780 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:17:34.302145 13895 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:34.306314 13973 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.312152 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:34.322598 10187 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:34.313135 13891 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:34.201483 13920 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.328634 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:34.237542 13986 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:17:34.278509 13577 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.275619 13274 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:34.345379 10033 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.346167 13780 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:34.350699 13780 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.351797 13934 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:34.359438 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.279036 13355 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:34.337810 13577 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.344380 13831 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.353225 13780 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.336936 13567 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:34.424088 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 176201us
W20260709 13:17:34.431241 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.411250 13577 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.411538 13831 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:34.445012 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.417140 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 282168us
I20260709 13:17:34.447599 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.449985 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:34.463788 10709 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:34.449936 13831 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.470942 10112 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:34.482910 10711 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.513309 13567 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.456393 13961 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.612112 13961 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:34.577837 14008 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:17:34.578615 13574 consensus_meta.cc:287] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.005s
I20260709 13:17:34.585558 10189 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:34.586647 13920 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.586701 14007 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:17:34.587381 14004 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:34.591548 10182 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:34.608340 13973 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.468812 13964 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:34.664472 13933 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.003s
I20260709 13:17:34.636758 13574 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.638413 13920 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.690672 10111 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
W20260709 13:17:34.702733 13252 consensus_meta.cc:287] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:17:34.703330 13252 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.714164 13964 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.679699 13933 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.782034 13933 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:34.784936 13920 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:34.786302 13574 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.774636 13577 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.787797 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:34.788920 13577 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:34.789737 13831 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:34.791832 13831 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:34.838038 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 390508us
I20260709 13:17:34.839069 10004 leader_election.cc:400] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11.
I20260709 13:17:34.841464 13567 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.843111 13971 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.843513 13971 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:34.844303 13971 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:34.846922 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 397018us
I20260709 13:17:34.856771 13934 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:34.857241 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:34.858773 14006 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:34.854300 14012 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:34.859663 14006 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:34.860096 14012 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:34.861162 14013 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.861594 14013 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:34.860154 14006 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:34.858580 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:34.978263 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 119753us
I20260709 13:17:34.979610 10003 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:34.980908 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:34.986893 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 123500us
I20260709 13:17:34.987984 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:34.993942 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:34.998147 13934 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:34.999393 13973 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:35.001008 13973 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:35.001709 13973 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:35.002154 13973 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:35.005952 14006 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.986334 13567 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:34.984522 13933 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:35.022040 13933 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.022437 13933 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:35.006522 14005 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:35.224735 13920 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.003082 13973 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:35.225464 13920 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:34.861166 14012 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:35.159158 14005 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:34.862375 14013 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:35.620698 14005 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:35.744681 14013 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:35.891345 10003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.000s	sys 0.000s
W20260709 13:17:35.915545 10003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.000s	sys 0.000s
W20260709 13:17:35.901785 14006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.004s	sys 0.000s
W20260709 13:17:35.924049 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.005s	sys 0.005s
W20260709 13:17:35.961313 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.005s	sys 0.005s
W20260709 13:17:35.961971 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 974014us
I20260709 13:17:35.969358 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:35.971333 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:35.915936 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 922041us
I20260709 13:17:35.977066 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:35.960320 13830 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:35.988490 10182 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:17:35.931449 14006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.004s	sys 0.000s
I20260709 13:17:35.911849 13978 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.004382 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.005640 10189 raft_consensus.cc:2410] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:36.026279 10113 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:36.027915 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1589) took 1946 ms. Trace:
W20260709 13:17:36.032231 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 60957.9us
I20260709 13:17:35.987685 14009 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:36.046216 14009 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:36.016387 13978 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.050108 13978 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:36.050612 13978 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.051054 13978 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.052469 13920 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:36.045574 13830 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.053339 13830 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.057566 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:36.059348 10712 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:36.047211 14009 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.076795 13830 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.077698 13830 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:36.078341 13830 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:36.079378 13830 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.028434 10113 rpcz_store.cc:276] 0709 13:17:34.081514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.023362 (+1941848us) service_pool.cc:224] Handling call
0709 13:17:36.026055 (+  2693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.027131 (+  1076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.027724 (+   593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.017521 14038 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:36.104400 13920 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.113574 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.166822 10185 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.114753 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.167857 10187 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.116775 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.117311 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.171286 10181 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:36.118638 10188 raft_consensus.cc:1217] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:17:36.171914 10188 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:36.136752 14039 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:36.139104 13934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.029s	sys 0.041s
W20260709 13:17:36.143218 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.076s	sys 0.068s
I20260709 13:17:36.187597 10182 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:36.194738 10187 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:36.189527 13934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.029s	sys 0.041s
W20260709 13:17:36.198565 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.145785 14033 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:36.152601 13978 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:36.154745 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.082801 14006 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:17:36.177726 13920 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:36.187644 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.076s	sys 0.068s
I20260709 13:17:36.211963 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1587) took 2130 ms. Trace:
I20260709 13:17:36.214102 10185 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:36.145354 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.198647 10181 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:36.212378 10106 rpcz_store.cc:276] 0709 13:17:34.081226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.976489 (+895263us) service_pool.cc:224] Handling call
0709 13:17:34.983562 (+  7073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.992487 (+  8925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.992517 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.164848 (+172331us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.211465 (+1046617us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:36.211519 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.211620 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.211665 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:36.211675 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.211891 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":488,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":250,"thread_start_us":948889,"threads_started":1,"wal-append.queue_time_us":879931}
W20260709 13:17:36.205066 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55929.7us
W20260709 13:17:36.206593 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.227043 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.227864 10185 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.228777 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.198484 13934 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:36.232230 10181 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:36.232622 10181 pending_rounds.cc:85] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:17:36.232836 10181 pending_rounds.cc:107] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:36.233058 10181 raft_consensus.cc:2889] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:36.236779 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 680) took 2051 ms. Trace:
I20260709 13:17:36.237228 10106 rpcz_store.cc:276] 0709 13:17:34.185017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.227049 (+2042032us) service_pool.cc:224] Handling call
0709 13:17:36.236263 (+  9214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.236455 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.236477 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.236516 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:36.236543 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.236592 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.236714 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.241916 10185 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:36.235093 14005 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.254987 10185 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:17:36.251122 14012 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:36.258114 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.197404 14039 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.255455 10185 pending_rounds.cc:85] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 4
I20260709 13:17:36.280519 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.281750 10181 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:36.282837 14061 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.283390 14061 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.284123 13920 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:36.285775 14061 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.286208 14039 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.286329 14061 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.286859 14061 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.287408 14060 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.288089 14060 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.289398 14005 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.287447 13934 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.292589 14006 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.293156 14006 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.205744 14038 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.279626 10185 pending_rounds.cc:107] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:36.297402 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.296710 10185 raft_consensus.cc:2889] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:36.298298 10181 raft_consensus.cc:2410] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:36.300235 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.300902 14006 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.301103 10186 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:36.304586 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.218708 14033 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.317536 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.319258 10185 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:36.319731 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.320531 10186 raft_consensus.cc:2368] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9.
I20260709 13:17:36.309723 14059 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.326377 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.326424 14059 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.321450 14060 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.328361 14060 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.329028 14059 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.328857 14060 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.329572 14059 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.330060 14059 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.330914 14060 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.331446 14060 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:36.332366 13933 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.309s	user 0.013s	sys 0.001s
I20260709 13:17:36.319902 14063 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:36.334050 10115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.948s	user 0.015s	sys 0.034s
I20260709 13:17:36.335152 14059 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.342763 14059 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.343242 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.343335 14059 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:36.344367 10115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.958s	user 0.016s	sys 0.035s
I20260709 13:17:36.290565 14012 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.345265 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1574) took 2283 ms. Trace:
I20260709 13:17:36.345464 14038 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.354156 10031 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:36.357787 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1847) took 2326 ms. Trace:
I20260709 13:17:36.365597 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:36.347908 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.345714 10115 rpcz_store.cc:276] 0709 13:17:34.061967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.245174 (+183207us) service_pool.cc:224] Handling call
0709 13:17:34.287068 (+ 41894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.287308 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:34.385822 (+ 98514us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.344863 (+1959041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.344919 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:36.344979 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.345054 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.345181 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":814,"prepare.queue_time_us":98047,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":12204,"thread_start_us":1958690,"threads_started":1,"wal-append.queue_time_us":283181,"wal-append.run_cpu_time_us":1291,"wal-append.run_wall_time_us":1019428}
I20260709 13:17:36.386935 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:36.387490 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.422850 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:36.422451 10712 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:36.386930 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:36.427487 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.385982 10033 rpcz_store.cc:276] 0709 13:17:34.031005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.031127 (+   122us) service_pool.cc:224] Handling call
0709 13:17:34.040133 (+  9006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.345872 (+305739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.357480 (+2011608us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400041d54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:36.357707 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701583104}
I20260709 13:17:36.347512 14033 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.341562 14060 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.345489 14059 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.357035 14061 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.436048 10115 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:36.437450 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:36.438588 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.341790 13933 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.441115 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2778) took 1972 ms. Trace:
I20260709 13:17:36.441448 10186 raft_consensus.cc:2410] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:36.442840 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.443014 10115 rpcz_store.cc:276] 0709 13:17:34.468386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.421477 (+1953091us) service_pool.cc:224] Handling call
0709 13:17:36.435714 (+ 14237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.440649 (+  4935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.441057 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.457531 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.457281 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.458237 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.459100 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.463063 10185 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:36.457522 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.470886 10181 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:36.479876 10712 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:36.479779 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.480747 10115 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:36.489773 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.345666 14063 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.490633 10039 raft_consensus.cc:2368] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10.
I20260709 13:17:36.497246 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.497330 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.498764 10180 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:36.499356 14012 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.500375 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.500779 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.500990 10115 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:36.501490 10034 raft_consensus.cc:2368] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:36.501904 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.502277 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.456178 13933 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.502962 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.503509 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.504122 10039 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:36.504935 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.452936 14067 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.505832 14070 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.506211 14067 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.506397 14070 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.508569 14067 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.508750 14070 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.502605 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 679) took 2382 ms. Trace:
I20260709 13:17:36.454980 14060 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.490386 14064 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.505753 14063 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.451310 14059 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:36.509104 14067 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.531685 14067 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.532872 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:36.534250 13933 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.511552 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.535915 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.536931 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1575) took 2474 ms. Trace:
I20260709 13:17:36.537087 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.511236 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.537384 10108 rpcz_store.cc:276] 0709 13:17:34.062212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.242745 (+180533us) service_pool.cc:224] Handling call
0709 13:17:34.260490 (+ 17745us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.260932 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.260964 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.266936 (+  5972us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.442780 (+175844us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:34.455401 (+ 12621us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.455694 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.455787 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.862173 (+406386us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800448a20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:36.536612 (+1674439us) raft_consensus.cc:1685] finished
0709 13:17:36.536717 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.536857 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14468,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":627,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":16832,"spinlock_wait_cycles":5740928,"thread_start_us":108754,"threads_started":1,"wal-append.queue_time_us":326518,"wal-append.run_cpu_time_us":2255,"wal-append.run_wall_time_us":1002271}
I20260709 13:17:36.539331 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.540838 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.541616 10108 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.514978 14060 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.515666 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.534891 14067 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.543129 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.544325 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.544909 10186 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:36.542148 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.547230 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.547875 10107 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.517174 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:36.549646 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 289863us
I20260709 13:17:36.542012 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.550653 10187 raft_consensus.cc:2376] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12. Re-sending same reply.
I20260709 13:17:36.518801 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.552381 10033 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:36.519043 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.537994 10188 raft_consensus.cc:2410] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:36.520867 10181 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:36.526751 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.528198 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.556248 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.556730 10108 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:36.557533 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.558974 10032 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:36.528568 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.560161 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2777) took 2228 ms. Trace:
W20260709 13:17:36.523892 14035 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.508s	user 0.003s	sys 0.000s
I20260709 13:17:36.531105 14059 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.561026 14060 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.523209 14064 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.563172 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.563308 14060 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:36.510948 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.509573 10113 rpcz_store.cc:276] 0709 13:17:34.120708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.086670 (+1965962us) service_pool.cc:224] Handling call
0709 13:17:36.087072 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.087354 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.087384 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.092076 (+  4692us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.442779 (+350703us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:36.442816 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.442879 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.502399 (+ 59520us) raft_consensus.cc:1685] finished
0709 13:17:36.502418 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.502547 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":347976,"threads_started":1,"wal-append.queue_time_us":355770}
I20260709 13:17:36.565079 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.565451 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.565833 10109 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:36.566563 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:36.567319 10110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.071s	user 0.032s	sys 0.024s
I20260709 13:17:36.567728 10115 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.524339 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:36.564016 14064 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.563302 14059 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.569916 10107 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:36.523787 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 828) took 2167 ms. Trace:
I20260709 13:17:36.571971 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.572978 13935 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.573112 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.573382 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.574208 10037 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:36.571376 10107 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:17:36.574256 10078 leader_election.cc:336] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.749s (SENT)
I20260709 13:17:36.572181 10711 rpcz_store.cc:276] 0709 13:17:34.356348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.364898 (+  8550us) service_pool.cc:224] Handling call
0709 13:17:34.393528 (+ 28630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.489450 (+ 95922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.523426 (+2033976us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b5400686fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:36.523675 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205001088}
I20260709 13:17:36.575801 10107 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:36.574488 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.567438 10113 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:36.560286 10039 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10.
I20260709 13:17:36.577272 10109 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:36.574803 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:36.578976 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:36.529013 10034 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:36.580996 10110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.085s	user 0.032s	sys 0.024s
I20260709 13:17:36.581522 10107 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:36.583184 10113 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:36.580878 10115 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:36.586449 14059 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.587354 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1579) took 2524 ms. Trace:
I20260709 13:17:36.588683 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.560573 10106 rpcz_store.cc:276] 0709 13:17:34.332010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.238118 (+1906108us) service_pool.cc:224] Handling call
0709 13:17:36.238403 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.238623 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:36.429183 (+190560us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.559561 (+130378us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.559822 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.559871 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:36.559920 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.559983 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.560104 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290074,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":170,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":30355456,"thread_start_us":301652,"threads_started":2,"wal-append.queue_time_us":116450}
I20260709 13:17:36.593344 14076 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.593904 14076 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.595038 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:36.597038 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.597918 10039 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:36.598722 13830 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:36.599159 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.599891 10034 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10.
I20260709 13:17:36.600677 14005 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.602011 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:36.602780 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.587774 10110 rpcz_store.cc:276] 0709 13:17:34.063214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.298819 (+235605us) service_pool.cc:224] Handling call
0709 13:17:34.454979 (+156160us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:34.455188 (+   209us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.455540 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.455570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.461298 (+  5728us) log.cc:844] Serialized 52 byte log entry
0709 13:17:36.581621 (+2120323us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:36.581662 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.581726 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.581760 (+    34us) raft_consensus.cc:1685] finished
0709 13:17:36.581771 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.587286 (+  5515us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4174,"spinlock_wait_cycles":51096448,"thread_start_us":2085060,"threads_started":1,"wal-append.queue_time_us":318865,"wal-append.run_cpu_time_us":1915,"wal-append.run_wall_time_us":1029834}
I20260709 13:17:36.598807 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.604696 10039 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:36.600664 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.605731 10034 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:36.604873 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:36.608323 10032 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:36.603622 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.609788 10107 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:36.611327 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.611863 10712 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:36.610633 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.613363 10107 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.614187 10185 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:17:36.616278 10078 connection.cc:256] RPC call timeout handler was delayed by -1.8939782790000663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2913s for a response
W20260709 13:17:36.616726 10078 connection.cc:256] RPC call timeout handler was delayed by -1.8733455679998769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32400000000000007s for a response
W20260709 13:17:36.617034 10078 connection.cc:256] RPC call timeout handler was delayed by -1.8507325829998535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:17:36.617353 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.617806 10078 leader_election.cc:336] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.893s (SENT)
I20260709 13:17:36.618193 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:36.618862 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:36.620328 10032 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:36.621835 10032 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:36.623163 10032 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:36.625224 10034 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:36.625432 14012 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:36.626039 14012 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:36.626911 14012 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:36.629354 14076 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:36.630348 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:36.630550 10078 connection.cc:256] RPC call timeout handler was delayed by -1.8057041689999096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:17:36.631079 10078 connection.cc:256] RPC call timeout handler was delayed by -1.7949041689998921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 13:17:36.619031 10039 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:17:36.631669 10039 pending_rounds.cc:85] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
I20260709 13:17:36.632141 10039 pending_rounds.cc:107] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:36.632436 10039 raft_consensus.cc:2889] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:36.632967 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.632175 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 750) took 3306 ms. Trace:
W20260709 13:17:36.631407 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.657696 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.658210 10078 connection.cc:256] RPC call timeout handler was delayed by -1.5312041689999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2439s for a response
W20260709 13:17:36.658726 10078 connection.cc:256] RPC call timeout handler was delayed by -1.3271301090001089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 13:17:36.659081 10078 connection.cc:256] RPC call timeout handler was delayed by -1.2927041689997623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27040000000000003s for a response
I20260709 13:17:36.633659 10184 rpcz_store.cc:276] 0709 13:17:33.325782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.470898 (+145116us) service_pool.cc:224] Handling call
0709 13:17:34.184850 (+713952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.185516 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.631957 (+2446441us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400096850. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:36.632114 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638949248}
W20260709 13:17:36.649760 10112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1590) took 2565 ms (client timeout 2196 ms). Trace:
I20260709 13:17:36.644867 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.626861 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:36.627040 14064 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.660491 10112 rpcz_store.cc:269] 0709 13:17:34.083826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.182034 (+ 98208us) service_pool.cc:224] Handling call
0709 13:17:36.649344 (+2467310us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400404054. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:36.649494 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610771840}
W20260709 13:17:36.662957 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51089.1us
I20260709 13:17:36.645634 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.665681 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:36.669020 10078 connection.cc:256] RPC call timeout handler was delayed by -1.2497301089999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 13:17:36.669562 10078 connection.cc:256] RPC call timeout handler was delayed by -1.1282301090000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260709 13:17:36.669867 10078 connection.cc:256] RPC call timeout handler was delayed by -1.0466448019999461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:17:36.670157 10078 connection.cc:256] RPC call timeout handler was delayed by -1.015354249999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 13:17:36.671455 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:36.672130 10108 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:36.674711 10682 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:36.676380 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:36.631696 14067 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.639652 14060 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.679231 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:36.680382 10108 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:36.791105 10112 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:36.777801 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.679680 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:36.659497 10107 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:17:37.218765 10033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.008s	sys 0.000s
W20260709 13:17:37.240048 10033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.001s
W20260709 13:17:36.902729 10114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.572s	user 0.066s	sys 0.087s
I20260709 13:17:36.788643 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:36.683154 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.242210 10109 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:17:36.776921 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1848) took 2729 ms. Trace:
I20260709 13:17:36.784243 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:36.819386 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.245348 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.257664 10114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.927s	user 0.073s	sys 0.087s
I20260709 13:17:37.258821 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1578) took 3195 ms. Trace:
I20260709 13:17:37.259253 10114 rpcz_store.cc:276] 0709 13:17:34.062974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.295229 (+232255us) service_pool.cc:224] Handling call
0709 13:17:34.320223 (+ 24994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.320578 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.320608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.321095 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.258443 (+2937348us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:37.258493 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.258566 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.258615 (+    49us) raft_consensus.cc:1685] finished
0709 13:17:37.258627 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.258762 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4430,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5269,"thread_start_us":2927703,"threads_started":1,"wal-append.queue_time_us":443308,"wal-append.run_cpu_time_us":1883,"wal-append.run_wall_time_us":1034271}
I20260709 13:17:37.243788 10038 rpcz_store.cc:276] 0709 13:17:34.047297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.047411 (+   114us) service_pool.cc:224] Handling call
0709 13:17:34.057392 (+  9981us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.076685 (+ 19293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.076708 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.092574 (+ 15866us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.283607 (+191033us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:34.283648 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.283710 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.776651 (+2492941us) raft_consensus.cc:1685] finished
0709 13:17:36.776678 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.776849 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10914,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6326,"thread_start_us":162346,"threads_started":1,"wal-append.queue_time_us":280103,"wal-append.run_cpu_time_us":3177,"wal-append.run_wall_time_us":1368794}
W20260709 13:17:37.265672 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 499625us
I20260709 13:17:36.784487 14062 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.099125 14034 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.778457 14033 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.280062 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.765064 14059 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.512s
I20260709 13:17:36.781307 14061 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.277593 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.286396 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:36.679508 14080 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.606s
I20260709 13:17:36.683841 14081 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.737717 14077 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:36.672065 14064 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:36.682384 14079 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.734464 14060 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:37.280745 14066 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.014s	sys 0.013s
I20260709 13:17:37.292695 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.285326 14059 consensus_queue.cc:1243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:17:37.298933 10081 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.024s	sys 0.028s
W20260709 13:17:37.299455 10081 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.024s	sys 0.028s
W20260709 13:17:37.299794 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 619444us
I20260709 13:17:37.279434 14062 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:37.301916 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 623455us
I20260709 13:17:37.285172 14033 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.310232 13298 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.281909 14034 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.289424 14061 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:37.314301 14066 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.015s	sys 0.013s
I20260709 13:17:37.334019 14062 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.298583 14079 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.341583 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:37.347975 14064 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.349138 14060 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:37.349888 14033 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.356295 14034 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.361387 14064 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:37.361785 14061 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.302196 14077 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.363463 14060 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:37.365468 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.351347 14096 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:37.354524 14078 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.366889 14078 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:37.372189 10036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.018s	user 0.021s	sys 0.037s
I20260709 13:17:37.367297 14060 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.381426 14078 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.363562 14079 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.383814 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.372002 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.384677 10033 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:37.385263 14079 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:37.385511 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.365549 14077 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.386226 10033 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:37.387499 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.388293 14077 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.389567 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.390292 14077 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.391840 14077 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:37.392426 14077 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:17:37.393453 10183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 758) took 3481 ms (client timeout 2891 ms). Trace:
W20260709 13:17:37.393842 10183 rpcz_store.cc:269] 0709 13:17:33.911554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.911804 (+   250us) service_pool.cc:224] Handling call
0709 13:17:37.393257 (+3481453us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001883d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:37.393356 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264835968}
I20260709 13:17:37.395110 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:37.395654 10183 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:37.397835 10036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.043s	user 0.021s	sys 0.037s
I20260709 13:17:37.400429 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1859) took 3194 ms. Trace:
I20260709 13:17:37.401288 14033 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:37.401821 14033 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:37.402690 14033 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.402899 14077 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:37.397135 10078 leader_election.cc:336] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.513s (SENT)
I20260709 13:17:37.404275 14060 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:37.404682 14060 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:37.405680 14060 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:37.406013 10078 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.734s (SENT)
W20260709 13:17:37.407096 10078 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.828s (SENT)
I20260709 13:17:37.407783 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:37.408855 10078 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.867s (SENT)
I20260709 13:17:37.409171 14095 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:37.409468 14096 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:37.409243 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.409323 14056 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:37.410701 14056 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.410832 14096 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.411568 14095 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:37.411144 10078 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.074s (SENT)
I20260709 13:17:37.398650 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.407037 14060 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.415416 10033 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:37.416383 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:37.414449 10078 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 3.289s (SENT)
I20260709 13:17:37.418772 14064 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.419251 14064 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.400790 10036 rpcz_store.cc:276] 0709 13:17:34.205670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.352949 (+147279us) service_pool.cc:224] Handling call
0709 13:17:34.353305 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.353528 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.353551 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.354045 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.400053 (+3046008us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:37.400095 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.400179 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.400222 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:37.400233 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.400363 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":3045596,"threads_started":1,"wal-append.queue_time_us":425321,"wal-append.run_cpu_time_us":1649,"wal-append.run_wall_time_us":1029138}
I20260709 13:17:37.419878 14095 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.421330 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.421427 14095 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.422504 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:36.678956 13973 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:37.427435 14064 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.436617 10035 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:37.437289 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:37.401183 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 59687.4us
I20260709 13:17:36.964927 13934 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.432915 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.439000 13934 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.439661 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.440814 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.441289 13934 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.435492 10183 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:37.444042 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:37.445868 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:37.447038 13934 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:37.447566 13934 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:37.448483 13934 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.449283 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.449887 10183 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:37.450870 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.452450 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:37.462049 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.454617 14033 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:37.480985 14033 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.481509 14033 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.470263 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:37.484505 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.484918 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:37.485419 10183 raft_consensus.cc:2410] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:36.689359 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.486775 10182 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:37.433516  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:37.489159 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.494990 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.496176 14076 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:37.497177 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 817985us
I20260709 13:17:37.496807  9936 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 4 to 8, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.775676 14006 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.502285 14066 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.503782 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:37.498764  9936 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 6 to 11, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 11 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.506753 10106 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:37.501965 14006 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.511045  9936 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 8, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.509285 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.515465 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.506937 13973 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.517279  9936 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 7 to 11, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 11 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.520076 13973 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.523041 13973 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.524397 10039 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.527036 14006 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:37.530306 13848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.002s	sys 0.013s
W20260709 13:17:37.530725 13848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.002s	sys 0.013s
W20260709 13:17:37.533324  9935 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 285) took 35236 ms (client timeout 15000 ms). Trace:
W20260709 13:17:37.533782  9935 rpcz_store.cc:269] 0709 13:17:02.351947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.355942 (+  3995us) service_pool.cc:224] Handling call
0709 13:17:37.533089 (+35177147us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.079169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.122926 (+ 43757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.123033 (+   107us) write_op.cc:435] Acquired schema lock
0709 13:17:30.123054 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:30.192039 (+ 68985us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:30.192132 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:30.192172 (+    40us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:17:30.193541 (+  1369us) tablet.cc:701] Row locks acquired
0709 13:17:30.193601 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:17:30.193789 (+   188us) write_op.cc:270] Start()
0709 13:17:30.193969 (+   180us) write_op.cc:276] Timestamp: P: 1783603050193717 usec, L: 0
0709 13:17:30.193989 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:30.194928 (+   939us) log.cc:844] Serialized 6348 byte log entry
0709 13:17:31.403368 (+1208440us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b1800088c60. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:31.449465 (+ 46097us) op_driver.cc:464] REPLICATION: finished
0709 13:17:31.453016 (+  3551us) write_op.cc:301] APPLY: starting
0709 13:17:31.453132 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:31.453456 (+   324us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:31.453492 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:31.455278 (+  1786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:31.455620 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:17:31.455662 (+    42us) write_op.cc:312] APPLY: finished
0709 13:17:31.456119 (+   457us) log.cc:844] Serialized 113 byte log entry
0709 13:17:31.456297 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:31.456476 (+   179us) write_op.cc:454] Released schema lock
0709 13:17:31.456545 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:31.456944 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:31.456966 (+    22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":358179,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":3238,"apply.run_cpu_time_us":3863,"apply.run_wall_time_us":3910,"num_ops":16,"prepare.queue_time_us":321901,"prepare.run_cpu_time_us":10506,"prepare.run_wall_time_us":171927,"raft.queue_time_us":43306,"raft.run_cpu_time_us":1391,"raft.run_wall_time_us":3378,"replication_time_us":1255281,"spinlock_wait_cycles":43285248,"thread_start_us":279705,"threads_started":4,"wal-append.queue_time_us":46084,"wal-append.run_cpu_time_us":10840,"wal-append.run_wall_time_us":1053895}]]}
I20260709 13:17:37.539337 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1851) took 3432 ms. Trace:
I20260709 13:17:37.539716 10035 rpcz_store.cc:276] 0709 13:17:34.106664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.107196 (+   532us) service_pool.cc:224] Handling call
0709 13:17:34.117011 (+  9815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.437028 (+3320017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.539067 (+102039us) spinlock_profiling.cc:243] Waited 3.32 s on lock 0x7b5400156dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:37.539271 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7634183936}
I20260709 13:17:37.547169 10039 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:37.548292  9936 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 7 to 8, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.550179  9936 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 8, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.552136 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.553509 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.554647 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.555387 10035 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:37.562193 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.563712 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.565001 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.566051 14033 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.566694 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.571873 13973 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.547331 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.576176 10106 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:37.578214 10111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1585) took 3497 ms (client timeout 2240 ms). Trace:
I20260709 13:17:37.578455 10114 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:17:37.578646 10111 rpcz_store.cc:269] 0709 13:17:34.080875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.183228 (+102353us) service_pool.cc:224] Handling call
0709 13:17:37.577999 (+3394771us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000b5754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:37.578140 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127167872}
I20260709 13:17:37.580196 10111 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:37.567310  9936 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:17:37.592541 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 83499.7us
I20260709 13:17:37.603799 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.597266  9936 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 4 to 7, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:37.604640 10114 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:37.606243 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:37.606820 10114 raft_consensus.cc:2376] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8. Re-sending same reply.
I20260709 13:17:37.588928 13577 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.610409 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.616159 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:37.607985 13574 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:37.624287  9936 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:37.616194 14091 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.638547 13574 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.662137 13574 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.614959 13577 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.629033 14078 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:17:37.666750 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1592) took 1218 ms. Trace:
I20260709 13:17:37.617425 13973 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.667151 10115 rpcz_store.cc:276] 0709 13:17:36.448762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.516907 (+ 68145us) service_pool.cc:224] Handling call
0709 13:17:37.666569 (+1149662us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b540038f4d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:37.666668 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40463104}
I20260709 13:17:37.628815 14061 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:17:37.668572 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1849) took 3599 ms. Trace:
I20260709 13:17:37.623332 14006 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.668953 10031 rpcz_store.cc:276] 0709 13:17:34.069219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.069330 (+   111us) service_pool.cc:224] Handling call
0709 13:17:34.069592 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.385367 (+2315775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.668330 (+1282963us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400164c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:37.668501 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5253604736}
I20260709 13:17:37.670128 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:37.667181 14091 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.670744 10031 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:37.670758 14091 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.779614 14013 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.676425 13577 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.676643 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:37.628454 14034 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:17:37.677629 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:37.664426 10106 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:37.678651 14077 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.679037 14077 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.679368 14077 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.682648 10715 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:37.685101 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:37.685916 10712 raft_consensus.cc:2410] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:37.686607 10715 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.687680 14013 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.688305 14060 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:37.688743 14060 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.689114 14060 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:37.689811 14013 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.690454 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:37.690491 10038 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:37.691875 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.676853  9936 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 8 to 9, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 9 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.700680 14033 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.702771 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1809) took 1597 ms. Trace:
I20260709 13:17:37.702277  9936 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 7 to 8, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 8 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:37.703194 10189 rpcz_store.cc:276] 0709 13:17:36.105513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.105712 (+   199us) service_pool.cc:224] Handling call
0709 13:17:36.106216 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.106488 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:36.303935 (+197447us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.423477 (+119542us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.702265 (+1278788us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18004356a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:17:37.702427 (+   162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.702477 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:37.702525 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.702591 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.702710 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1271595,"prepare.queue_time_us":30211,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":1126,"raft.queue_time_us":1322190,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":2373,"spinlock_wait_cycles":5379328,"thread_start_us":279048,"threads_started":2,"wal-append.queue_time_us":35997,"wal-append.run_cpu_time_us":2154,"wal-append.run_wall_time_us":1114203}
I20260709 13:17:37.708011 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:37.708657 10715 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 5.
I20260709 13:17:37.705858 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:37.709962 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:37.711094 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:37.707926 14090 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:37.716265 14055 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:37.719337 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:37.720227 10189 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.720511 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:37.714605 14013 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.724848 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:37.726670  9936 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 5 to 7, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 7 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:37.736282 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:37.745434 14013 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:37.745988 14013 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:37.746412 14013 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:37.750046 14122 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.750597 14122 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.751027 14122 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.760356  9936 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 6 to 8, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.761483 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:37.723943 14034 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.764390 14116 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:37.748314 13298 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.721968 14033 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:37.774730  9936 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:37.777060  9936 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 6 to 7, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 7 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.725931 14006 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:17:37.766109 13574 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:37.781493 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.787266 14121 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:37.787957 14121 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:37.788972 14121 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.791041 14061 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:37.791507 14061 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:37.792064 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.792423 14061 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.793710 14061 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:37.789456 14006 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:37.796087  9936 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 2 to 7, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 7 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:37.798205 10189 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:37.766326 13973 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:17:37.801010 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.804756 10189 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:37.829057  9936 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.808145 14119 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:37.805919 14006 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:37.840647 14006 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.839462 14119 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.842026 14006 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.811331 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 688) took 2879 ms. Trace:
I20260709 13:17:37.842983 10709 rpcz_store.cc:276] 0709 13:17:33.932011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.932145 (+   134us) service_pool.cc:224] Handling call
0709 13:17:33.932444 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.473049 (+540605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.811019 (+2337970us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54004d0154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:36.811254 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221170048}
I20260709 13:17:36.674249 13935 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:37.847324 13935 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:37.829952 14122 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.848296 13935 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.849342 14013 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.850669 14122 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.803426 14091 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.808574 14079 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.883265 14079 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.885524 14079 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.889509 14060 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.804086 14121 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.775425 14116 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:37.894647 14116 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.895258 10115 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:37.897030  9936 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 4 to 5, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 5 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.898329 14060 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:37.902588 14077 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:37.904986 14077 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:36.737787 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:37.910391 10180 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.737308 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.918398 10187 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:37.918880 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1830) took 1182 ms. Trace:
I20260709 13:17:37.918995 10180 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:37.919242 10187 rpcz_store.cc:276] 0709 13:17:36.736850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.737063 (+   213us) service_pool.cc:224] Handling call
0709 13:17:37.918816 (+1181753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.921502 10112 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:37.921609 13593 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:37.922087 13593 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:37.922920 13593 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:37.924111 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71536.1us
I20260709 13:17:37.921830 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1826) took 1233 ms. Trace:
I20260709 13:17:37.926391 10180 rpcz_store.cc:276] 0709 13:17:36.688051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.688228 (+   177us) service_pool.cc:224] Handling call
0709 13:17:37.921766 (+1233538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.927770 10180 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:37.928316 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 773) took 1168 ms. Trace:
I20260709 13:17:36.734622 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.929402 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1824) took 1248 ms. Trace:
I20260709 13:17:37.929714 10184 rpcz_store.cc:276] 0709 13:17:36.680899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.681676 (+   777us) service_pool.cc:224] Handling call
0709 13:17:37.929342 (+1247666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.931097 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 774) took 1171 ms. Trace:
I20260709 13:17:37.934891 13574 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:37.928635 10180 rpcz_store.cc:276] 0709 13:17:36.759470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.927099 (+1167629us) service_pool.cc:224] Handling call
0709 13:17:37.927427 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.928085 (+   658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.928260 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.936923 13593 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:37.937453 10180 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:37.938084 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 776) took 1177 ms. Trace:
I20260709 13:17:37.938450 13985 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:36.735385 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:37.931376 10184 rpcz_store.cc:276] 0709 13:17:36.759729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.930321 (+1170592us) service_pool.cc:224] Handling call
0709 13:17:37.930630 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.930800 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.930824 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.930862 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:37.930893 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.930940 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.931034 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.935181 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 775) took 1175 ms. Trace:
I20260709 13:17:36.736918 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:37.940862 10181 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.940515 10187 rpcz_store.cc:276] 0709 13:17:36.760046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.934365 (+1174319us) service_pool.cc:224] Handling call
0709 13:17:37.934668 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.934853 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.934878 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.934918 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:37.934953 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.935000 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.935122 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.940164 10188 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:37.942653 10188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1828) took 1207 ms (client timeout 1510 ms). Trace:
W20260709 13:17:37.943002 10188 rpcz_store.cc:269] 0709 13:17:36.735006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.735152 (+   146us) service_pool.cc:224] Handling call
0709 13:17:37.942583 (+1207431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.944397 10188 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:37.945169 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1834) took 1183 ms. Trace:
I20260709 13:17:37.945451 10188 rpcz_store.cc:276] 0709 13:17:36.761749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.943672 (+1181923us) service_pool.cc:224] Handling call
0709 13:17:37.944028 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.944902 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.945117 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.938369 10180 rpcz_store.cc:276] 0709 13:17:36.760325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.936977 (+1176652us) service_pool.cc:224] Handling call
0709 13:17:37.937290 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.937830 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.938028 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.948441 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 778) took 1159 ms. Trace:
I20260709 13:17:37.948859 10187 rpcz_store.cc:276] 0709 13:17:36.789368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.947570 (+1158202us) service_pool.cc:224] Handling call
0709 13:17:37.947948 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.948136 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.948161 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.948202 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:37.948239 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.948288 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.948381 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.952246 10187 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:37.955240 10187 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:37.843510 14119 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.964111 14056 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:37.965211 10180 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:37.989015 10111 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:37.970539 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:37.991465 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.973294 10181 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:37.972245 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:37.975512 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:38.012374 10031 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:38.013420 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.014168 10031 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:38.014880 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:38.015434 10031 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:38.012271 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1829) took 1275 ms. Trace:
I20260709 13:17:37.990078 10035 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:38.011068 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.024482 10181 rpcz_store.cc:276] 0709 13:17:36.736557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.736698 (+   141us) service_pool.cc:224] Handling call
0709 13:17:38.012207 (+1275509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.043071 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.043818 10031 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:38.049033 10110 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:38.054827 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:38.059453 10039 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:38.061261 10039 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:38.062114 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:38.062885 10112 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:38.055878 14066 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:38.066845 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.068416 14013 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.053973 14006 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:17:38.069475 10031 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:38.069617 13971 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.070451 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:36.671787 13830 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:38.073527 13830 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:38.074409 13830 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.065390 14066 consensus_queue.cc:1243] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:38.077538 14091 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:38.094344 14012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.004s	sys 0.016s
W20260709 13:17:38.094743 14012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.004s	sys 0.016s
I20260709 13:17:38.096616 14095 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:38.121984 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3000 after lost signal to thread 8942
W20260709 13:17:38.123245 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2540 after lost signal to thread 9972
W20260709 13:17:38.129122 14102 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.664s	user 0.004s	sys 0.000s
W20260709 13:17:38.143916 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2f20 after lost signal to thread 10064
W20260709 13:17:38.144294 10136 debug-util.cc:398] Leaking SignalData structure 0x7b0800195240 after lost signal to thread 10065
W20260709 13:17:38.145284 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8180 after lost signal to thread 10139
W20260709 13:17:38.145572 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08003a82a0 after lost signal to thread 10140
I20260709 13:17:38.154688 10115 pending_rounds.cc:85] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:17:38.155064 10115 pending_rounds.cc:107] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:38.155303 10115 raft_consensus.cc:2889] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:37.099375 13982 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.167846 13982 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.168828 10036 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:38.177824 14117 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:38.178207 14117 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:38.180301 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1865) took 1188 ms. Trace:
I20260709 13:17:38.180831 10037 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:38.181694 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.182672 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 606) took 1405 ms. Trace:
I20260709 13:17:38.183030 10037 rpcz_store.cc:276] 0709 13:17:36.777215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.777336 (+   121us) service_pool.cc:224] Handling call
0709 13:17:36.777695 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.181189 (+1403494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.182401 (+  1212us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400276ad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:38.182611 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3226337152}
I20260709 13:17:38.184412 13848 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.180689 10038 rpcz_store.cc:276] 0709 13:17:36.992116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.289187 (+297071us) service_pool.cc:224] Handling call
0709 13:17:38.180145 (+890958us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400277ed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:38.180243 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900942720}
I20260709 13:17:38.179023 14117 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.184932 13848 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:38.193758 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.194455 14117 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:38.212030 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1869) took 1218 ms. Trace:
I20260709 13:17:38.212524 10033 rpcz_store.cc:276] 0709 13:17:36.993079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.441622 (+448543us) service_pool.cc:224] Handling call
0709 13:17:38.207564 (+765942us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400165b54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:38.211940 (+  4376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671073152}
I20260709 13:17:38.215874 13982 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.217263 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1825) took 1533 ms. Trace:
I20260709 13:17:38.217654 10185 rpcz_store.cc:276] 0709 13:17:36.683919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.684102 (+   183us) service_pool.cc:224] Handling call
0709 13:17:36.684454 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.108640 (+1424186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.108676 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.109136 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.140488 (+ 31352us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:38.140527 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.140603 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.217056 (+ 76453us) raft_consensus.cc:1685] finished
0709 13:17:38.217076 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.217207 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1423784,"thread_start_us":30994,"threads_started":1,"wal-append.queue_time_us":43915}
I20260709 13:17:38.219904 10034 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.228700 10034 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:17:38.233198 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.233911 10115 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:38.239193 13848 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.242647 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.260025 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.261730 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.262542 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.263233 14067 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:38.264355 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8740 after lost signal to thread 10213
W20260709 13:17:38.264674 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08002faa40 after lost signal to thread 10214
I20260709 13:17:38.265515 13927 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:38.265789 10136 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6640 after lost signal to thread 10740
I20260709 13:17:38.269889 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1858) took 4064 ms. Trace:
I20260709 13:17:38.269555 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.272693 14119 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:38.273088 14119 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:38.273449 14119 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.275414 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1833) took 1530 ms. Trace:
I20260709 13:17:38.274955 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1832) took 1532 ms. Trace:
I20260709 13:17:38.276326 10182 rpcz_store.cc:276] 0709 13:17:36.742635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.487498 (+744863us) service_pool.cc:224] Handling call
0709 13:17:37.487860 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.488083 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:37.585643 (+ 97560us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.273955 (+688312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.274680 (+   725us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:38.274736 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.274798 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.274900 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":653396,"prepare.queue_time_us":125187,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2288,"thread_start_us":122872,"threads_started":2,"wal-append.queue_time_us":114498}
I20260709 13:17:38.275962 10183 rpcz_store.cc:276] 0709 13:17:36.744578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.503612 (+759034us) service_pool.cc:224] Handling call
0709 13:17:37.504033 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.504271 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:37.581852 (+ 77581us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.273632 (+691780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.274408 (+   776us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:38.275092 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.275201 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.275336 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":659872,"prepare.queue_time_us":122753,"prepare.run_cpu_time_us":2850,"prepare.run_wall_time_us":24408,"thread_start_us":98515,"threads_started":2,"wal-append.queue_time_us":58612}
I20260709 13:17:38.275851 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.284297 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.270371 10040 rpcz_store.cc:276] 0709 13:17:34.205287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.205404 (+   117us) service_pool.cc:224] Handling call
0709 13:17:34.245783 (+ 40379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.246013 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:34.268907 (+ 22894us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.203135 (+3934228us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18001e4ae0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287
0709 13:17:38.203427 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.269431 (+ 66004us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.269482 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:38.269526 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.269733 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.269838 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62446,"prepare.queue_time_us":31982,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":108710,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":30713,"spinlock_wait_cycles":3216128,"thread_start_us":193749,"threads_started":2}
I20260709 13:17:38.288422 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.285148 13978 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:38.292250 13577 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:38.292815 13577 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:38.292637 13978 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.293802 13577 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.294915 13978 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:38.279078 14038 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:38.296546 14038 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.298799 14038 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:38.278709 14137 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:38.275243 14070 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:38.269636 14036 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:38.314666 14038 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.318964 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1512) took 1807 ms. Trace:
I20260709 13:17:38.315030 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1835) took 1553 ms. Trace:
W20260709 13:17:38.320842 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.320727 14038 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.323098 14038 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.292029 14087 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:38.316039 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.273779 14067 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:38.324946 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.303408 14059 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:38.319339 10186 rpcz_store.cc:276] 0709 13:17:36.511949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.545444 (+ 33495us) service_pool.cc:224] Handling call
0709 13:17:36.554739 (+  9295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.263655 (+1708916us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:38.263686 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.263730 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:38.263788 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.263848 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.318765 (+ 54917us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b54002da0d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:38.318880 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1708542,"raft.queue_time_us":1711359,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"spinlock_wait_cycles":20568320}
I20260709 13:17:38.271073 13927 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.324031 14087 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:38.324319 14036 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.319430 10188 rpcz_store.cc:276] 0709 13:17:36.762009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.946180 (+1184171us) service_pool.cc:224] Handling call
0709 13:17:37.946484 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.946698 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:37.946983 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.314661 (+367678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.314722 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:38.314776 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.314845 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.314970 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192480,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":208614,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"thread_start_us":174754,"threads_started":2,"wal-append.queue_time_us":146308}
I20260709 13:17:38.329236 14087 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:38.304392 14092 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:38.284761 14095 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:38.317907 14070 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:38.330495 13927 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.330458 14077 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:38.324644 13978 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:17:38.331104 14077 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:38.331558 13978 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:38.329823 14152 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:38.331935 13978 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:38.327350 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.333485 14151 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:38.333871 14151 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.334208 14151 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.330813 13963 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:38.335275 13963 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:38.314862 14150 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.339663 13963 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.341591 13927 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:38.339998 14070 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.343207 13927 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:38.343568 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:38.343990 13927 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:38.344344 13927 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:38.344717 10107 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:38.345249 14063 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.345706 14063 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.332777 13978 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.349231 13978 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.349138 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.335675 14059 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.350654 14059 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.350584 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.352576 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.353121 10110 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:38.353996 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.354558 10112 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:38.334507 14092 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.356086 10112 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:38.376848 10183 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:38.378926 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:38.380218 10181 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:38.381423 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:38.382247 10181 raft_consensus.cc:2410] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:38.384538 10185 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:38.356166 14092 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.387936 13593 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:38.388304 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:38.388494 13593 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:38.388070 13927 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.389488 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:38.389752 13927 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.390636 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:38.389505 13593 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.392210 10180 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:38.393776 14059 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.394073 13963 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:38.394769 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.395361 10107 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:38.400754 14067 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.403232 10188 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:17:38.405409 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 66566.6us
I20260709 13:17:38.405197 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.407030 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:38.415789 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 917893us
I20260709 13:17:38.416185 13963 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.416780 13963 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:38.417127 13963 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:38.417477 13963 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:38.419720 14077 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.421059 14077 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:38.424655 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:38.424744 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:38.425355 10106 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.414288 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.370913 14152 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:38.414466 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:38.372347 13574 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:17:38.432715 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.373382 14150 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.467506 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.409986 13927 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:38.479095 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.441772 14056 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:38.464962 14121 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:38.444715 14095 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.414867 14087 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:38.496469 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.466890 14038 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:38.499015 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.477772 13927 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.501286 10106 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:17:38.510309 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 77689.6us
I20260709 13:17:38.510490 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.512210 14087 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:38.512982 14146 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:17:38.473115 14149 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:17:38.515992 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.516963 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.517149 14038 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:38.522264 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.528723 13848 raft_consensus.cc:2764] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:38.441202 14041 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:17:38.533641 10003 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:38.544729 10115 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:38.563004 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:38.564823 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.503113 14056 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:38.589289 14041 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.590291 14153 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:38.590427 14041 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.591331 14117 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:38.592003 14117 consensus_queue.cc:1243] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:38.590888 14153 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:38.593150 14041 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.593657 14153 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.595016 14070 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:38.536638 14148 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:17:38.559695 14038 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.532090 13927 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.507073 14095 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.536880 14121 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:38.588039 14006 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:38.588747 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55199.2us
I20260709 13:17:38.589123 13593 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:38.617645 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.565972 14059 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.631632 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.643388 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.646297 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:38.624948 14145 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:17:38.648527 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.650275 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.649840 10710 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:38.659791 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:38.661585 10716 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:38.588981 14119 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.659382 13830 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:38.590385 14056 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.663787 13848 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:38.677531 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:38.669938 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.678288 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.670236 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:38.678790 10035 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.672091 10707 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:38.679206 10714 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:38.681770 10032 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:38.683085 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.679678 10707 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:38.686502 10710 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:38.686707 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.649137 14006 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:38.673077 14154 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:17:38.692994 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.673703 14150 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.645781 13593 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.673666 14119 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.699694 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.669633 14095 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.666356 14091 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:17:38.674635 13848 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:38.690905 13577 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:38.708943 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 198536us
W20260709 13:17:38.698002 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 132576us
I20260709 13:17:38.717347 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.720378 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.720695 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.721473 10032 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.707477 14081 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.668916 14121 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.698249 13922 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:17:38.698536 13982 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:38.729552 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.779320 10107 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:17:38.760337 14158 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:38.714478 13298 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:38.761469 13926 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:38.714768 14160 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.715644 13848 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.716562 13577 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.765468 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.765861 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:38.766966 14165 log.cc:927] Time spent T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:38.709772 14170 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.807277 10037 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:38.776587 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.776525 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.760484 14081 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.710879 13986 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:17:38.784999 10033 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:38.711844 14162 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:17:38.797829 10039 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:38.805500 10036 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:38.806926 14170 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.773067 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:38.809026 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 111177us
I20260709 13:17:38.811921 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:38.813423 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49377.1us
I20260709 13:17:38.814764 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.792603 13926 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:38.827492 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.804042 13577 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:38.818645 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46056.5us
I20260709 13:17:38.806944 14167 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:17:38.860073 13577 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.861145 10112 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:38.861886 14167 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.862320 14167 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.862656 14167 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.789930 14151 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.864853 14151 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:38.817842 14172 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.867966 14172 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:38.868996 13577 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.870029 14172 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:38.872551 13963 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.874496 13963 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.830246 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:38.875667 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.876686 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:38.877584 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.878650 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:38.805001 14006 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.833861 13593 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.834065 14162 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:38.814054 14149 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.906008 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.813673 14152 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:38.808633 14160 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.807094 14150 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:38.839969 14176 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.840116 14168 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:38.839529 10035 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:38.843538 14092 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.844254 13926 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.845553 14174 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:38.764569 14159 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:17:38.851171 14170 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.834590 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.853844 14063 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:38.857488 10032 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:17:38.859062 14081 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.862754 13927 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.831980 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.879693 10714 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 6.
I20260709 13:17:38.831413 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.908842 14178 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:38.928802 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:38.930327 13593 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:38.934130 10034 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:38.934978 14092 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:38.871541 14038 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.952518 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:38.960732 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 129380us
I20260709 13:17:38.955962 10713 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:38.939370 14174 consensus_queue.cc:1243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:38.963802 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.963861 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:38.954660 10716 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:38.958289 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.966188 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:38.969699 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 154989us
I20260709 13:17:38.973218 10107 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:38.974752 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:38.924726 14149 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.976953 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:38.931654 14176 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:38.983796 10188 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:38.984071 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.957775 13593 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:38.981050 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:38.964845 13574 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.977286 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:38.985221 10714 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:38.987773 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:38.989442 10037 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.982043 10035 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:38.926473 14152 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:38.969755 13982 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.974464 14092 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:17:39.011358 10180 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:39.219280 10185 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
W20260709 13:17:39.015205 10078 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.576s (SENT)
I20260709 13:17:39.218510 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:39.085439 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.096971 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:38.971104 14063 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:39.225167 10107 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:39.218566 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:38.975890 13986 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.195151 10183 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:39.010600 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:39.231688 10113 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:39.220366 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:39.218104  9927 maintenance_manager.cc:419] P a2e763e48a394cda873aa837f65da240: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033359
W20260709 13:17:39.257645 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 242469us
W20260709 13:17:39.258325 10078 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.578s (SENT)
I20260709 13:17:39.258745 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:39.260178 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 311835us
I20260709 13:17:38.985549 14095 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:39.262106 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.554s (SENT) [suppressed 27 similar messages]
I20260709 13:17:39.149159 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:39.153925 10032 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:38.989691 14012 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:39.302239 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 473979us
W20260709 13:17:39.304555 10155 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.840s (SENT)
I20260709 13:17:39.305351 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:39.217660 14185 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:39.306627 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:38.977622 13973 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.277s
I20260709 13:17:39.047034 14077 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:39.319828 10113 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:39.321355 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:39.314153 10037 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:39.311153 10707 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:39.339481 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 74057.7us
I20260709 13:17:39.309332 14169 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:39.360570 14169 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.321959 13973 consensus_queue.cc:1243] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:17:39.363238 10155 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.145s (SENT)
I20260709 13:17:39.375312 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:39.352066 14151 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:39.304757 13574 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.384375 10110 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:39.401226 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 142923us
W20260709 13:17:39.391605 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 412879us
I20260709 13:17:39.339424 14077 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:39.406711 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:39.392171 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.256649 13593 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:39.322537 14164 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.431s
I20260709 13:17:39.363788 14172 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:39.405009 10155 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.203s (SENT)
I20260709 13:17:39.418148 10037 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:39.418831 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:39.446902 10107 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:39.421867 10078 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.599s (SENT)
I20260709 13:17:39.388044 14151 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:39.390705 14160 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:39.447536 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:39.447417 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:39.401196 13927 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:39.449961 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 143406us
W20260709 13:17:39.443887 14184 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:17:39.446962 14179 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.470s	user 0.001s	sys 0.000s
I20260709 13:17:39.462720 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:39.462194 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:39.465039 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 60062.5us
I20260709 13:17:39.458652 14060 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.453557 14151 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:39.446913 14006 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.441591 14038 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:39.445109 13926 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:39.486711 10078 leader_election.cc:336] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.723s (SENT)
I20260709 13:17:39.402027 14196 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:17:39.493696 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:39.506265 10155 connection.cc:256] RPC call timeout handler was delayed by -2.1216343950000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2594s for a response
W20260709 13:17:39.506812 10155 connection.cc:256] RPC call timeout handler was delayed by -1.4889343949998874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32970000000000005s for a response
W20260709 13:17:39.507171 10155 connection.cc:256] RPC call timeout handler was delayed by -1.4376343949998045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33540000000000003s for a response
I20260709 13:17:39.506932 10110 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
W20260709 13:17:39.507573 10155 connection.cc:256] RPC call timeout handler was delayed by -1.3800343949999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34180000000000005s for a response
W20260709 13:17:39.510695 10078 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.470s (SENT)
I20260709 13:17:39.511133 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:39.451097 14172 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:39.504733 14063 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:39.521123 14181 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:39.488055 14182 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.183s
I20260709 13:17:39.522109 14169 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:39.531442 13848 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.004s
I20260709 13:17:39.477485 13574 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:39.533241 14149 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:39.554126 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:39.555294  9922 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f145536c6dbe456fb8565950244bc2a5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:39.561698 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:39.566402 14189 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.540s	user 0.000s	sys 0.008s
I20260709 13:17:39.567703 14186 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.570680 10716 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:39.571144 10716 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:39.576014 10003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.014s
W20260709 13:17:39.576417 10003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.009s	sys 0.014s
I20260709 13:17:39.578531 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:39.574257 14176 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:39.551198 13848 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:39.597954 10679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.004s	sys 0.016s
W20260709 13:17:39.598330 10679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.016s
W20260709 13:17:39.599474 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.010s	sys 0.010s
W20260709 13:17:39.599871 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.010s	sys 0.010s
W20260709 13:17:39.598565 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 711173us
I20260709 13:17:39.577775 14186 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:39.613349 10182 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:17:39.613777 10182 pending_rounds.cc:85] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:17:39.613988 10182 pending_rounds.cc:107] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:39.614212 10182 raft_consensus.cc:2889] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.612536 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:39.609568 13933 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.630412 10078 leader_election.cc:336] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.083s (SENT)
I20260709 13:17:39.631049 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:39.633736 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:39.633908 10107 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.641636 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:39.644783 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:39.679991 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:39.681420 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51060.2us
W20260709 13:17:39.682996 10078 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.167s (SENT)
I20260709 13:17:39.684662 10107 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:39.694988 14207 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:39.697669 14202 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:39.699565 14217 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:39.596581 14063 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:39.726992 10182 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:39.626904 14178 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:17:39.691663 14091 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.692574 14174 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.732549 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:39.733294 10186 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:39.644783 14160 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:17:39.734730 14190 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:17:39.719082 14036 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:39.656922 13933 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:39.738646 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59447us
I20260709 13:17:39.729157 14172 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:39.744874 10182 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:39.715910 14196 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:17:39.744470 10078 leader_election.cc:336] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.528s (SENT)
I20260709 13:17:39.746436 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:39.729631 14095 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:39.749877 14211 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:39.750690 14095 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:39.752570 14186 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:39.735179 14174 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:39.754943 14219 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:39.739409 14091 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:39.755699 14193 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:17:39.757257 14091 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:39.745304 14198 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:39.769137 13978 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:39.769619 13978 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:39.770462 13978 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:39.772601 13848 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:39.749256 14191 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:17:39.778384 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:39.743901 13574 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:39.778913 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:39.780014 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:39.785043 10111 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:39.788203 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:39.788763 10711 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:39.776757 14167 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.860s	user 0.012s	sys 0.000s
I20260709 13:17:39.776350 14174 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.791299 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:39.796116 10109 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
W20260709 13:17:39.797065 14157 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.204s	user 0.005s	sys 0.007s
W20260709 13:17:39.792078 14199 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260709 13:17:39.745301 14036 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:39.794139 13933 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:39.749161 13926 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:39.771694 13978 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:39.813750 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.808519 14151 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:39.832535 14080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.011s	sys 0.016s
W20260709 13:17:39.837649 14080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.011s	sys 0.016s
I20260709 13:17:39.844962 10180 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:39.810995 14167 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:39.843914 14153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.010s	sys 0.016s
I20260709 13:17:39.850109 14174 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:39.850821 14153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.010s	sys 0.017s
W20260709 13:17:39.852417 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.843799 14152 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:39.955842 10114 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:40.026629 10078 leader_election.cc:336] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.673s (SENT)
I20260709 13:17:39.941735 14174 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.038332 14095 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:40.124030 10078 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.704s (SENT)
W20260709 13:17:40.143050 14226 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:17:40.144755 14225 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:17:40.111943 13933 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:40.112324 14095 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.158516 14151 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.156741 13933 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.176185 14195 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:40.176721 14195 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:40.177569 14195 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.178822 14195 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.180197 13933 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.176282 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1655) took 1842 ms. Trace:
I20260709 13:17:40.180203 14178 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:40.181640 14178 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.184017 14167 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.181098 10115 rpcz_store.cc:276] 0709 13:17:38.333691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.335612 (+  1921us) service_pool.cc:224] Handling call
0709 13:17:38.335981 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.547600 (+211619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.176022 (+1628422us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000497d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:40.176216 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455587200}
I20260709 13:17:40.184165 14159 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:40.193012 14162 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:40.194855 14156 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.607s	user 0.005s	sys 0.006s
I20260709 13:17:40.197880 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 772) took 3438 ms. Trace:
I20260709 13:17:40.198251 10189 rpcz_store.cc:276] 0709 13:17:36.759146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.819846 (+1060700us) service_pool.cc:224] Handling call
0709 13:17:37.836284 (+ 16438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.383647 (+547363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.383679 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.384172 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.463098 (+ 78926us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.463137 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.463209 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.194279 (+1731070us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:40.197582 (+  3303us) raft_consensus.cc:1685] finished
0709 13:17:40.197604 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.197815 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437790,"raft.queue_time_us":453919,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":16551808,"thread_start_us":171597,"threads_started":2,"wal-append.queue_time_us":117827}
I20260709 13:17:40.190099 14095 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.190001 14159 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.210671 13934 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:40.191684 14178 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.218940 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:40.219547 10108 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.202845 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 1893) took 1735 ms. Trace:
I20260709 13:17:40.204066 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2798) took 1475 ms. Trace:
I20260709 13:17:40.220402 10112 rpcz_store.cc:276] 0709 13:17:38.728352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.728766 (+   414us) service_pool.cc:224] Handling call
0709 13:17:38.766500 (+ 37734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.861484 (+ 94984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.203720 (+1342236us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54002b9154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:40.203996 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217107840}
I20260709 13:17:40.218544 13934 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.214933 14162 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.215622 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:40.213497 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.227478 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.216849 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:40.217833 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:40.220296 10034 rpcz_store.cc:276] 0709 13:17:38.467004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.467237 (+   233us) service_pool.cc:224] Handling call
0709 13:17:40.202624 (+1735387us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400165654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:40.202758 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059769088}
I20260709 13:17:40.228762 10115 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.230090 10108 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
W20260709 13:17:40.233906 10079 connection.cc:256] RPC call timeout handler was delayed by -1.4249744179999198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:17:40.235132 10709 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:40.235520 10709 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.236294 10709 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.237236 10709 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:40.287925 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.294782 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:40.311419 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.312247 10714 pending_rounds.cc:85] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 6
I20260709 13:17:40.312556 10714 pending_rounds.cc:107] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:40.312785 10714 raft_consensus.cc:2889] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.312956 14060 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:40.312186 10079 connection.cc:256] RPC call timeout handler was delayed by -1.2298623710000811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2802s for a response
W20260709 13:17:40.319635 10079 connection.cc:256] RPC call timeout handler was delayed by -1.1875478970000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:17:40.320137 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.320809 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.321405 14060 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.325008 10115 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:40.326679 10108 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:40.329504 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.330395 10115 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:40.331264 10108 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:40.333293 10115 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.333272 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.334378 10109 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:40.323172 14063 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.324944 14198 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.336603 10112 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:40.327896 14087 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:40.338169 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.340780 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.346658 10109 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:40.353109 14175 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.565s	user 0.004s	sys 0.009s
I20260709 13:17:40.356408 10112 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:40.327527 14162 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.359076 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:40.337384 14063 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.338850 14198 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.340859 14087 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.362275 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:40.365137 13593 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.371819 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:40.375459 10109 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:40.367376 14201 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:40.376494 14060 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.375165 13577 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:40.382267 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:40.376551 13934 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.384995 14159 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.382001 13978 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.382989 14060 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:40.384635 14201 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:40.388427 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:40.388476 13978 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.394183 13978 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:40.391186 13577 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:40.395342 13577 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:40.395731 13577 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.397296 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.398145 10109 raft_consensus.cc:2410] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:40.391475 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:40.394862 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1866) took 1416 ms. Trace:
I20260709 13:17:40.402648 10184 rpcz_store.cc:276] 0709 13:17:38.978203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.978314 (+   111us) service_pool.cc:224] Handling call
0709 13:17:38.978604 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.986285 (+  7681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.986322 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.254981 (+268659us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.477908 (+222927us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:40.394112 (+916204us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b1800435040. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf
0709 13:17:40.394264 (+   152us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.394501 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.394569 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.394607 (+    38us) raft_consensus.cc:1685] finished
0709 13:17:40.394679 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.394801 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39104,"prepare.queue_time_us":114410,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1829,"raft.queue_time_us":7873,"raft.run_cpu_time_us":3011,"raft.run_wall_time_us":107033,"spinlock_wait_cycles":20825472,"thread_start_us":228987,"threads_started":2,"wal-append.queue_time_us":227532}
I20260709 13:17:40.412250 10709 raft_consensus.cc:3055] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:40.412736 10709 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.417237 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:40.418917 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:40.421480 10709 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.423662 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:40.426247 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.431977 14161 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:40.433199 14161 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:40.433909 14161 consensus_queue.cc:1243] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:40.434363 14161 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:40.434561 14231 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:40.435045 14180 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:40.424672 14167 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:40.435488 14180 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.416283 14127 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:40.436676 14231 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.436455 14180 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.437084 14231 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.437718 14180 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.420077 13927 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:17:40.440979 14194 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.958s	user 0.007s	sys 0.005s
I20260709 13:17:40.420392 14159 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:40.442468 10109 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:40.420727 14201 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:40.444175 14201 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.444715 10115 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:40.446427 14201 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.447546 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.424489 13926 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:40.426856 14076 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:17:40.449111 14177 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.660s	user 0.010s	sys 0.016s
I20260709 13:17:40.451234 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.451855 10710 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:40.452879 10716 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.453810 10716 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.456983 10707 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.458209 14167 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.458688 14160 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:40.459580 14160 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:40.458596 14167 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.463662 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:40.477121 10110 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:40.477854 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.478076 10115 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: [12.12-14.13]
I20260709 13:17:40.480564 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.481209 10115 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:40.484213 10112 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:40.485703 13930 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:40.485545 14127 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:40.497625 14127 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:40.485474 10108 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:40.489396 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.498087 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:40.488067 10106 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.498920 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.479794 14195 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:40.499560 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.499998 14195 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.500664 10711 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:40.501567 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.502096 10711 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:40.498059 14127 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:40.502902 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.497294 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2800) took 1526 ms. Trace:
I20260709 13:17:40.498411 14077 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.485484 14070 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.503407 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:40.503541 10114 rpcz_store.cc:276] 0709 13:17:38.971054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.971217 (+   163us) service_pool.cc:224] Handling call
0709 13:17:38.982426 (+ 11209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.956400 (+973974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.497061 (+540661us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54002b8c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:40.497234 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223982848}
W20260709 13:17:40.504541 14196 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:17:40.510356 10110 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 8: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:40.434700 14161 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.502044 14195 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.516213 14231 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.513032 10707 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:40.521128 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 618) took 1857 ms. Trace:
I20260709 13:17:40.521505 10707 rpcz_store.cc:276] 0709 13:17:38.663540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.663706 (+   166us) service_pool.cc:224] Handling call
0709 13:17:38.663984 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.299160 (+635176us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4c0000ea80. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6d7b4a20 00007f3c6d7c5a29 00007f3c6d78b644 00007f3c6d7b2f2d 00007f3c6d7b2b93 00007f3c6f4e318b 00007f3c6f4e3cb5 00007f3c6f4def30 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416
0709 13:17:40.456766 (+1157606us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b58007634d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4440aa 00007f3c6f4c6447 00007f3c6f4defe7 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4
0709 13:17:40.520849 (+ 64083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.521049 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554372224}
I20260709 13:17:40.520244 13743 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:40.522897 13743 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:40.474010 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:40.523514 14159 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:40.523932 14056 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:40.524618 14056 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:40.525557 14056 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.526255 13927 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.526747 13927 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.528017 13934 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:40.530200 14134 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:40.530608 14134 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.532316 10184 pending_rounds.cc:85] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 3
I20260709 13:17:40.532639 10184 pending_rounds.cc:107] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 13:17:40.532579 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 58646us
I20260709 13:17:40.533089 10184 raft_consensus.cc:2889] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.535388 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:40.539986 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.540668 10181 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:40.542372 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.542982 10183 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:40.543684 14134 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.544204 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.544811 10115 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:40.545729 14231 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.545655 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.507120 13577 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.478299 13926 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:40.547935 13926 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.548859 13926 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.550071 13926 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:40.556389 14161 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.557797 14161 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.514055 14070 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:40.560395 14070 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.561353 13577 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.562414 14070 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.563138 14063 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:40.564073 14167 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.566188 14167 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.567329 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.571471 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:40.572285 10115 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.570350 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:40.578467 10183 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:40.579260 10182 pending_rounds.cc:85] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:17:40.579594 10182 pending_rounds.cc:107] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:40.579852 10182 raft_consensus.cc:2889] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.524552 14159 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:40.544952 14134 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:40.588923 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.590852 10180 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:40.593817 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:40.596155 10181 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:40.599498 10115 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:40.604215 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:40.580833 13930 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:40.608539 10078 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.748s (SENT)
I20260709 13:17:40.586495 14174 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:40.612586 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:40.613730 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.606365 13963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.011s	sys 0.015s
I20260709 13:17:40.586944 14159 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.624140 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.623088 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:40.603317 14164 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.627027 10181 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.627262 10187 raft_consensus.cc:2410] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:17:40.627758 10078 leader_election.cc:336] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.768s (SENT)
I20260709 13:17:40.628293 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:40.590011 14195 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:40.608198 13930 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.611166 13743 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:40.622622 13963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.012s	sys 0.015s
I20260709 13:17:40.617794 14174 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.633574 14237 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:40.646715 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:40.648392 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.611366 14127 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.637882 13930 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.653489 14127 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.654845 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1904) took 1673 ms. Trace:
I20260709 13:17:40.660053 14159 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:40.662004 14234 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:17:40.645079 13743 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.634918 14164 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.641215 14174 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.655270 10031 rpcz_store.cc:276] 0709 13:17:38.981000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.981459 (+   459us) service_pool.cc:224] Handling call
0709 13:17:38.981721 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.343666 (+361945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.343694 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.343733 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:39.343871 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.654597 (+1310726us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540031c9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:40.654651 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.654781 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831966848}
I20260709 13:17:40.702234 14159 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.720297 10113 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:40.691444 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:40.727058 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.736486 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:40.742390 10712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 701) took 1971 ms (client timeout 1882 ms). Trace:
W20260709 13:17:40.743219 10712 rpcz_store.cc:269] 0709 13:17:38.767398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.771526 (+  4128us) service_pool.cc:224] Handling call
0709 13:17:40.656292 (+1884766us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:40.738377 (+ 82085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850688}
W20260709 13:17:40.747484 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.748525 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 704) took 1980 ms. Trace:
I20260709 13:17:40.738438 14180 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.754745 10181 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:40.751279 10713 rpcz_store.cc:276] 0709 13:17:38.768398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.770927 (+  2529us) service_pool.cc:224] Handling call
0709 13:17:38.955768 (+184841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.964342 (+  8574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.748314 (+1783972us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003cd550. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:40.748461 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420955392}
I20260709 13:17:40.741935 14127 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:40.769902 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.775051 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:40.775285 13927 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.737699 14170 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:40.777168 14162 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:40.780297 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.782284 14215 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:40.782718 14215 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:40.784983 10180 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.737756 14237 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:40.742039 14060 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:40.803637 10180 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:40.765095 14180 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.805460 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:40.814376 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.814103 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 241532us
W20260709 13:17:40.815220 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 117776us
I20260709 13:17:40.790859 14127 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:40.816090 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:40.817790 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:40.783591 14215 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:40.832013 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.831372 10078 leader_election.cc:336] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.950s (SENT)
I20260709 13:17:40.833266 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:40.839733 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.844465 13933 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:40.853932 14180 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:40.856138 14174 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.858582 14174 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.860158 14127 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:40.790611 13743 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.863642 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:40.865300 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:40.865408 13933 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:40.865944 13933 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:40.859210 13930 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.839612 13577 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:40.881774 13933 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:40.840934 13922 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:40.863720 14207 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:40.900799 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:40.901170 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:40.889904 13985 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.903458 10037 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:40.885133 14061 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:17:40.904469 10031 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.892076 14164 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:40.887987 14174 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:40.907349 10036 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.887701 14250 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:40.906167 13985 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:40.916363 13985 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.921986 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:40.922633 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.922799 10188 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:40.923593 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.924141 10188 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:40.924507 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:40.924952 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:40.925463 10188 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:40.931106 14087 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:40.940869 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.909410 14174 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.953061 10710 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:40.949316 14174 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:40.968904 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 102832us
W20260709 13:17:40.969067 10078 leader_election.cc:336] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.547s (SENT)
I20260709 13:17:40.970427 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:40.972064 10034 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:40.974888 10039 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:40.978032 10188 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:40.979260 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.980437 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.982191 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.984908 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:40.986779 10034 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:40.997052 10188 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:40.978375 13930 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:40.998692 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:40.999356 10110 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:41.002805 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:41.003706 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:41.005823 10113 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 6.
I20260709 13:17:41.004115 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.006495 10188 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:41.007290 10114 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:41.008041 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.009256 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.009938 10188 raft_consensus.cc:2368] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10.
I20260709 13:17:41.010087 14254 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:41.012018 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.013749 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.014267 10188 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:41.013975 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:41.021133 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.023283 10034 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:41.011905 14231 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:41.027398 14178 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:41.028263 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:41.043967 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.028959 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:41.044446 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.044821 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.045821 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:41.047051 10033 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:41.040412 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.043018 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.019816 14159 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:41.048314 14159 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.048732 14159 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:41.044878 14231 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.021407 14080 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:17:41.056146 10155 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:39164 dropped due to backpressure: service queue is full with 50 items
I20260709 13:17:41.112319 14174 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.082583 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.053606 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:41.132436 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78905.5us
I20260709 13:17:41.133895 10709 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:41.053804 14207 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:41.057902 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.057878 10031 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:41.063648 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.136765 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.137061 14061 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:41.137661 14061 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:41.137935 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.065711 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.065655 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:41.139191 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:41.051090 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 604) took 3371 ms. Trace:
I20260709 13:17:41.128234 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.054287 14210 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:41.072182 13909 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:41.204818 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 143022us
W20260709 13:17:41.166631 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.184386 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1879) took 2112 ms. Trace:
I20260709 13:17:41.067312 14127 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
W20260709 13:17:41.206140 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 67030.4us
I20260709 13:17:41.207067 10709 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:17:41.128871 14242 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:41.141249 10708 rpcz_store.cc:276] 0709 13:17:37.679293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.680372 (+  1079us) service_pool.cc:224] Handling call
0709 13:17:37.680754 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.602369 (+921615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.602401 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.445115 (+842714us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18003887e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a
0709 13:17:40.947781 (+1502666us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b2c00047828. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:17:40.948345 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.011507 (+ 63162us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:41.011544 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.011626 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.050879 (+ 39253us) raft_consensus.cc:1685] finished
0709 13:17:41.050902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.051030 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740247,"raft.queue_time_us":867720,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":40745,"spinlock_wait_cycles":36555904,"thread_start_us":225307,"threads_started":2,"wal-append.queue_time_us":94869}
W20260709 13:17:41.121824 14262 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.116s	user 0.001s	sys 0.002s
W20260709 13:17:41.189795 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.206295 10185 rpcz_store.cc:276] 0709 13:17:39.072127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.220996 (+148869us) service_pool.cc:224] Handling call
0709 13:17:39.221262 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.221641 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:40.189230 (+967589us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b1800434ce0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf 00007f3c6f502038
0709 13:17:40.386057 (+196827us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.571210 (+185153us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.571366 (+   156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.581427 (+ 10061us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.581558 (+   131us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:40.586683 (+  5125us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.056391 (+469708us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b1800434ce0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:41.131365 (+ 74974us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b1800434ce0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:17:41.183978 (+ 52613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.184075 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.184130 (+    55us) raft_consensus.cc:1685] finished
0709 13:17:41.184143 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.184307 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":569011,"prepare.queue_time_us":334210,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":122,"raft.queue_time_us":23066,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":39226,"spinlock_wait_cycles":142430720,"thread_start_us":412239,"threads_started":3,"wal-append.queue_time_us":215103}
I20260709 13:17:41.122493 10155 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:39164 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1536)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1561)
W20260709 13:17:41.223327 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 359264us
I20260709 13:17:41.222988 10155 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:39164 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1536)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1906)
I20260709 13:17:41.210148 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:41.212144 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.228675 14041 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.229877 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:41.234869 10032 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:41.227542 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.062202 13577 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:17:41.240825 13577 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:41.241191 13577 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:41.241918 13577 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.242383 14174 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:41.208891 14164 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:41.067143 14087 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
W20260709 13:17:41.250324 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.144373 14210 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:41.219265 14178 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:17:41.239518 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.246902 10036 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:41.254391 10040 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:41.254717 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.209184 14198 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:41.205184 13909 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:41.205133 14096 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:41.210703 13743 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:41.243052 13577 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.208638 14207 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:41.239696 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.283089 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.261745 14198 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:41.265965 10078 leader_election.cc:336] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.587s (SENT)
I20260709 13:17:41.284721 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:41.268174 10187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1878) took 2247 ms (client timeout 2783 ms). Trace:
W20260709 13:17:41.285404 10187 rpcz_store.cc:269] 0709 13:17:39.020723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.047884 (+ 27161us) service_pool.cc:224] Handling call
0709 13:17:41.267990 (+2220106us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002ad0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:41.268117 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3159718272}
I20260709 13:17:41.289155 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:41.268705 14178 consensus_queue.cc:1243] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:41.281219 14267 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:41.313410 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:41.255775 10153 service_pool.cc:137] ChangeConfig request on kudu.consensus.ConsensusService from 127.0.0.1:39450 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1532)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1536)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1906)
I20260709 13:17:41.318608 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:41.318975 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:41.288017 14056 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.325918 10111 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:41.327200 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:41.328060 10107 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.296363 14087 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:41.324903 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:41.335448 10709 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:41.302356 13922 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:41.335847 10709 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:41.338001 10107 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:17:41.339207 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 111746us
I20260709 13:17:41.310178 13934 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:41.344166 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.346764 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:41.347370 10710 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.352631 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.353346 10189 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:41.356339 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.268244 14096 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.311097 14267 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:41.360023 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.363226 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.364096 10184 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:41.365001 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.365756 10184 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:17:41.367429 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.330793 14245 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.376892 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.376528 14207 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.289996 14061 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.398317 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.401153 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.402974 10184 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:41.403723 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.405614 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.406802 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.407390 10189 raft_consensus.cc:2376] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10. Re-sending same reply.
I20260709 13:17:41.407472 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.409901 10184 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:41.357110 14280 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.411494 10710 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:41.412266 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.358619 13934 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:41.419905 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.314657 14210 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.422168 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.426028 10189 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:41.428200 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.429150 10180 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:41.430051 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.418081 13934 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.436906 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.438536 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.438889 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.439374 10184 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:41.439800 10180 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:41.444576 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.445225 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:41.446159 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 64368.4us
I20260709 13:17:41.446473 10180 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:41.447600 10189 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:41.447441 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.448149 10180 raft_consensus.cc:2376] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10. Re-sending same reply.
I20260709 13:17:41.448700 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:17:41.449473 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.449946 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:41.446156 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.452055 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.452232 14278 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:41.452679 14238 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:41.453161 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.455456 14278 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.432227 13927 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.344249 13909 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:41.461926 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.465534 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.466136 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.466748 10184 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:41.466957 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 148432us
I20260709 13:17:41.466351 10180 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:41.473690 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.476387 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.476619 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.463644 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:41.453846 10189 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:41.468971 10036 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:41.477779 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.480512 10180 raft_consensus.cc:2376] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9. Re-sending same reply.
I20260709 13:17:41.481390 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.485051 10184 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:41.400017 14245 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.486423 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.491065 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.491561 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:41.488068 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.492681 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.496798 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:41.495977 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.476346 13593 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:41.482595 13927 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.459724 14159 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.506541 10708 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:41.509526 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.510247 10186 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:41.511008 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.512349 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:41.514205 14159 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:41.520305 14070 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:41.520901 14070 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.522087 14245 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:41.522025 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.523661 14070 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:41.484593 14087 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:17:41.532600 10180 raft_consensus.cc:2410] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:41.470292 14060 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:41.483037 14274 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:41.493541 14279 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:41.527866 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.528203 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.545202 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.502668 14151 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.505291 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:41.520171 14277 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:17:41.491071 13933 consensus_meta.cc:287] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.001s
I20260709 13:17:41.535032 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.537675 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.553386 10038 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:41.539763 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1884) took 1003 ms. Trace:
I20260709 13:17:41.555119 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.555862 10189 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.554462 10182 rpcz_store.cc:276] 0709 13:17:40.535996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.537634 (+  1638us) service_pool.cc:224] Handling call
0709 13:17:40.579021 (+ 41387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:40.752454 (+173433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.752487 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:40.753072 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.904572 (+151500us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:40.912275 (+  7703us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.513166 (+600891us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18004359a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287
0709 13:17:41.513512 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.533191 (+ 19679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.533271 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.539539 (+  6268us) raft_consensus.cc:1685] finished
0709 13:17:41.539559 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.539692 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":491560,"prepare.queue_time_us":25108,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":77,"raft.queue_time_us":974879,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":47366,"spinlock_wait_cycles":7256448,"thread_start_us":317758,"threads_started":3,"wal-append.queue_time_us":187723}
I20260709 13:17:41.545795 10186 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.546399 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.529398 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:41.559011 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:41.497233 14284 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:41.560201 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:41.536244 13927 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:41.561388 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:41.562501 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.539645 14255 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.540575 13985 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:41.541326 14245 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.568712 10184 raft_consensus.cc:1217] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[7.4-11.6]   Dedup: 11.6->[]
I20260709 13:17:41.645632 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:41.708691 10184 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: [7.4-11.6]
I20260709 13:17:41.642784 10189 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:17:41.649518 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.464485 14267 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.552686 14238 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:41.654088 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 234691us
I20260709 13:17:41.710749 10184 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 10. Ops: []
I20260709 13:17:41.712184 10186 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:41.570894 14278 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:41.718989 14278 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:41.719393 14278 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.719549 10040 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:41.719583 14207 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.720697 14207 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.721870 10184 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:17:41.690164 14277 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:17:41.722494 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 156457us
I20260709 13:17:41.638374 13593 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:41.726892 10184 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:17:41.561041 13933 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:41.725957 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.710611 14151 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:41.715061 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 144878us
W20260709 13:17:41.731181 10078 leader_election.cc:336] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.071s (SENT)
I20260709 13:17:41.711956 13986 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.609635 14279 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
W20260709 13:17:41.741371 10078 leader_election.cc:336] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 3.651s (SENT)
I20260709 13:17:41.746074 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:41.748057 14198 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:41.748787 14279 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:41.749164 14279 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:41.749897 14279 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.751080 14279 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.730257 14284 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:41.752194 14284 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:41.752509 14151 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:41.753111 14284 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.753472 14151 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.743032 14060 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:41.761297 14060 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.765436 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:41.765990 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:41.766528 10039 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:41.725065 14287 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:41.768488 10036 raft_consensus.cc:1217] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 13:17:41.735687 14267 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.776233 10036 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:17:41.772887 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 205138us
I20260709 13:17:41.763527 14060 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:41.779604 14081 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.8, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:41.780541 14081 consensus_queue.cc:1243] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:41.711031 13985 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.777752 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.788826 13985 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:41.689155 14255 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:41.769477 14288 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:17:41.790593 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.731858 14245 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:17:41.795601 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.804715 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 276579us
I20260709 13:17:41.805708 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.776084 14287 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:41.789641 14080 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.818157 14087 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.818717 14087 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.820963 14087 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:41.826167 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.826010 14303 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:41.811250 13593 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.833174 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:41.837984 10078 leader_election.cc:336] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:39164 dropped due to backpressure: service queue is full with 50 items
W20260709 13:17:41.844054 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.849982 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:41.856083 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.858302 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 66043.9us
I20260709 13:17:41.860110 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:41.816870 14245 consensus_queue.cc:1243] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:41.862479 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:41.816350 14287 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:41.865108 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:41.868021 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:41.852200 13985 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:41.872205 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.851020 13933 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:41.866113 13930 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.835995 14080 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.866943 14087 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.864229 14056 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.869602 14245 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.869261 14198 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:41.852398 13934 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.874156 14299 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.874058 14207 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:41.896081 13922 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.003s
I20260709 13:17:41.888640 14274 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:41.913362 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 53341.2us
I20260709 13:17:41.891659 13985 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:41.908371 13743 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.001s
I20260709 13:17:41.916172 13922 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:41.889206 13927 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:41.913220 13577 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 13:17:41.913894 14245 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:41.910284 14198 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:41.892349 13930 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.901798 14056 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.916703 14278 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:41.946910 14290 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:41.942696 14255 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:41.962118 14301 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:41.962716 14301 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:41.965934 14278 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:41.967137 14276 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.491s	user 0.000s	sys 0.001s
W20260709 13:17:41.975106 14312 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:17:41.977089 14272 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.737s	user 0.000s	sys 0.001s
W20260709 13:17:41.979027 14285 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.544s	user 0.004s	sys 0.000s
I20260709 13:17:41.963656 14301 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:41.980533 14301 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.987106 14287 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:41.893031 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 54593.9us
W20260709 13:17:42.040027 10079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.022s
W20260709 13:17:42.040688 10079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.011s	sys 0.022s
I20260709 13:17:42.045545 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 1906) took 1069 ms. Trace:
I20260709 13:17:42.046283 10039 rpcz_store.cc:276] 0709 13:17:40.976006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.976867 (+   861us) service_pool.cc:224] Handling call
0709 13:17:40.982249 (+  5382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:41.770076 (+787827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.044823 (+274747us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540031d3d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:42.045280 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803341056}
W20260709 13:17:42.076974 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 156394us
W20260709 13:17:42.079047 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.079972 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1896) took 1444 ms. Trace:
I20260709 13:17:42.080569 10183 rpcz_store.cc:276] 0709 13:17:40.628295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.631620 (+  3325us) service_pool.cc:224] Handling call
0709 13:17:40.632000 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.237383 (+605383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.237411 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.245909 (+  8498us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.295011 (+ 49102us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:41.295049 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.295118 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.966489 (+671371us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:42.071419 (+104930us) raft_consensus.cc:1685] finished
0709 13:17:42.071466 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.072758 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":579605,"raft.queue_time_us":621717,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":3321088,"thread_start_us":48707,"threads_started":1,"wal-append.queue_time_us":181808}
I20260709 13:17:42.082238 13930 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:42.084183 14279 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:42.085577 14279 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.924935 13743 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:42.088514 10189 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:42.090692 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1532) took 1150 ms. Trace:
I20260709 13:17:42.092500 13985 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.098126 14080 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.102365 14151 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.104081 14267 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.104887 14267 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.119956 13922 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:42.120946 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.121143 13922 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.121937 10183 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:17:42.122692 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.091140 10189 rpcz_store.cc:276] 0709 13:17:40.940619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.709465 (+768846us) service_pool.cc:224] Handling call
0709 13:17:42.087940 (+378475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.089042 (+  1102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.090410 (+  1368us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400096350. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:42.090600 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832427520}
I20260709 13:17:42.103299 14151 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.104362 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:42.142858 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:42.092680 14287 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:42.147807  9922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54795.3us
I20260709 13:17:42.154536 14056 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.155017 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.155576 13927 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.160271 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1534) took 1219 ms. Trace:
I20260709 13:17:42.160985 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1561) took 1141 ms. Trace:
I20260709 13:17:42.162207 13934 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.163089 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.163436 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.165031 14279 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:42.160027 14270 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:42.155630 10039 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:42.164759 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:42.177000 10712 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:42.177806 13922 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:42.180794 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:42.182649 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.184037 10181 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:42.185374 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.185608 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.186772 10035 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:42.188010 10188 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
W20260709 13:17:42.188666 10188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1549) took 1171 ms (client timeout 1553 ms). Trace:
I20260709 13:17:42.189201 14274 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.190156 14274 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:41.931180 14198 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.178503 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.187638 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:42.189105 10188 rpcz_store.cc:269] 0709 13:17:41.016745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.162365 (+1145620us) service_pool.cc:224] Handling call
0709 13:17:42.188586 (+ 26221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.196090 10189 raft_consensus.cc:2410] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:42.196491 10181 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:42.197762 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.198510 10188 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:42.199898 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.200312 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.202306 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:42.200753 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 60325.1us
I20260709 13:17:42.203359 10031 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:42.206063 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.207259 10036 raft_consensus.cc:2368] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
W20260709 13:17:42.208648 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 340562us
I20260709 13:17:42.208693 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.210191 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.211112 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.212201 10189 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:42.167985 10184 rpcz_store.cc:276] 0709 13:17:41.018883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.728169 (+709286us) service_pool.cc:224] Handling call
0709 13:17:41.728615 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.728906 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:41.782622 (+ 53716us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.858867 (+ 76245us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.867368 (+  8501us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.867523 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:41.867809 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.867983 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.868057 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.971996 (+103939us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b1800252160. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:42.138790 (+166794us) raft_consensus.cc:1685] finished
0709 13:17:42.141522 (+  2732us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.160764 (+ 19242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35013,"prepare.queue_time_us":54951,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1935,"raft.queue_time_us":108217,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":4698,"spinlock_wait_cycles":10197248,"thread_start_us":33418,"threads_started":1,"wal-append.queue_time_us":75226}
I20260709 13:17:42.213809 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.214743 14198 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.167640 10186 rpcz_store.cc:276] 0709 13:17:40.941112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.718845 (+777733us) service_pool.cc:224] Handling call
0709 13:17:41.719171 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.728388 (+  9217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:41.740689 (+ 12301us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.800270 (+ 59581us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.800789 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.800959 (+   170us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:41.803791 (+  2832us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.804011 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.804084 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.954592 (+150508us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b18000b4a00. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:17:42.140171 (+185579us) raft_consensus.cc:1685] finished
0709 13:17:42.142704 (+  2533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.160067 (+ 17363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8840,"prepare.queue_time_us":57894,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":33484,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":11730432,"thread_start_us":35493,"threads_started":1,"wal-append.queue_time_us":105257}
I20260709 13:17:42.216428 14151 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:42.217221 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:42.219805 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.221335 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.222177 10037 raft_consensus.cc:2368] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9.
I20260709 13:17:42.224261 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.224848 10108 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:42.225262 10036 raft_consensus.cc:2368] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10.
I20260709 13:17:42.226486 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.227386 10035 raft_consensus.cc:2368] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10.
I20260709 13:17:42.228276 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:42.229534 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 82266.2us
I20260709 13:17:42.230396 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:42.232209 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1555) took 1214 ms. Trace:
I20260709 13:17:42.232730 10114 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:42.232963 10111 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:42.236203 14095 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:42.237567 14134 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.238837 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.238631 14134 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.214769 14267 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:42.238868 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.241003 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:42.242056 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.216665 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.243253 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.243477 10185 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
W20260709 13:17:42.244062 10185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1570) took 1221 ms (client timeout 1553 ms). Trace:
I20260709 13:17:42.244129 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:42.244501 10185 rpcz_store.cc:269] 0709 13:17:41.022442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.192349 (+1169907us) service_pool.cc:224] Handling call
0709 13:17:42.243999 (+ 51650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.245636 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.242605 14167 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:42.245923 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.219491 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.248909 10038 raft_consensus.cc:2368] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11.
I20260709 13:17:42.252092 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:42.253244 14134 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.253716 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:42.232695 10180 rpcz_store.cc:276] 0709 13:17:41.017939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.481155 (+463216us) service_pool.cc:224] Handling call
0709 13:17:42.231769 (+750614us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54002ad0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:42.232014 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115552128}
I20260709 13:17:42.213910 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.256291 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.256649 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.257795 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.258832 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.259171 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.259673 14163 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.260952 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.263589 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.253091 10115 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:42.283255 10034 raft_consensus.cc:2368] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:42.247344 14167 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:42.291292 10185 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:42.431524 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.299816 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:42.396814 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.305001 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.355400 10182 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:42.280180 14267 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.437438 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1701) took 1124 ms. Trace:
W20260709 13:17:42.432930 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 223016us
I20260709 13:17:42.444983 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.444097 10113 rpcz_store.cc:276] 0709 13:17:41.313094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.315166 (+  2072us) service_pool.cc:224] Handling call
0709 13:17:41.315493 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.336866 (+ 21373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.336903 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.373079 (+ 36176us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b1800364300. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a
0709 13:17:42.054526 (+681447us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b2c000bbbd8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:17:42.068237 (+ 13711us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.137520 (+ 69283us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.140242 (+  2722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.151256 (+ 11014us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.436994 (+285738us) raft_consensus.cc:1685] finished
0709 13:17:42.437014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.437233 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39671,"raft.queue_time_us":24207,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":18130,"spinlock_wait_cycles":15585536,"thread_start_us":45157,"threads_started":1,"wal-append.queue_time_us":175896}
I20260709 13:17:42.446432 10182 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:42.446588 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.446995 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:42.439323 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 91307.7us
I20260709 13:17:42.447868 14127 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.448184 10182 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:42.448429 14321 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:42.448871 10113 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:42.293473 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:42.360057 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:42.454619 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.419466 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.355306 14195 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:42.288162 14167 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:42.351922 14134 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.456975 10109 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:42.457331 14134 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:42.458128 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.459863 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:42.456548 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 199111us
I20260709 13:17:42.464715 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:42.435531 14096 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.471698 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.309602 14231 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.473285 14161 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:17:42.474922 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.475430 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.464234 14198 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:42.483530 14198 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:42.490970 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.360278 14163 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.493105 10040 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:42.483974 14198 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:42.493587 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:42.493664 10110 raft_consensus.cc:2376] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8. Re-sending same reply.
I20260709 13:17:42.514277 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.502820 14134 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.509423 14305 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.517241 14096 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:42.520330 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 173758us
I20260709 13:17:42.510936 14231 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:17:42.507859 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.510890 14161 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.530771 14198 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.532513 14198 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.536258 14096 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:42.537533 14096 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:42.540396 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.547194 10115 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 7.
W20260709 13:17:42.550549 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 90753.8us
I20260709 13:17:42.551378 10707 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:42.557533 10114 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:42.559087 10186 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:42.562049 14167 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.563105 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.563642 14167 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.563966 10108 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:42.564436 14305 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.565234 14305 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.568985 14152 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.569821 14152 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.572351 10106 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:42.574754 10188 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:42.575780 14305 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:42.576399 14320 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.378s	user 0.000s	sys 0.002s
I20260709 13:17:42.577276 10188 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:42.578859 10188 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:17:42.554068 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:42.587894 10040 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:42.591044 10182 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:42.590580 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:42.594025 14322 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.396s	user 0.004s	sys 0.001s
I20260709 13:17:42.595479 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.596103 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1909) took 1056 ms. Trace:
I20260709 13:17:42.591671 14161 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:42.596660 10187 rpcz_store.cc:276] 0709 13:17:41.539656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.778851 (+239195us) service_pool.cc:224] Handling call
0709 13:17:41.779209 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.780157 (+   948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.780189 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.780982 (+   793us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.287208 (+506226us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:42.290656 (+  3448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.297823 (+  7167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.521260 (+223437us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:42.595609 (+ 74349us) raft_consensus.cc:1685] finished
0709 13:17:42.595632 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.595905 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":433,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":7065472,"thread_start_us":415149,"threads_started":1,"wal-append.queue_time_us":408060}
I20260709 13:17:42.598254 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:42.599053 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.598256 10038 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:42.599947 10032 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:42.599246 10187 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:42.596175 10034 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:42.572664 14163 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:42.599633 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72688us
I20260709 13:17:42.610613 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.611304 10035 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:42.612229 13927 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.613545 13927 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.613009 14152 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:42.596743 14161 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.619951 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.623636 10040 raft_consensus.cc:1217] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[12.8-12.8]   Dedup: 12.8->[]
W20260709 13:17:42.625545 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.635075 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 88280.2us
I20260709 13:17:42.636560 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.637564 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:42.637739 14041 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.638489 14041 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.640261 14196 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:42.640898 14196 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:42.641268 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.621731 14161 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.642184 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:42.642014 14196 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.638028 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.644826 14087 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:42.645380 14087 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:42.645543 14041 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.646556 14087 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:42.650596 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.652318 14325 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.454s	user 0.003s	sys 0.000s
I20260709 13:17:42.634857 14163 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:42.655092 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.639106 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.624356 10040 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:17:42.668953 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 76718.7us
I20260709 13:17:42.681989 14305 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.683846 13927 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:42.684062 14305 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.687933 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:42.694200 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.694809 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.699990 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.701476 14041 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.701998 14041 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.702240 14211 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.702355 14060 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:42.707827 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:42.709513 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.709349 10031 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:42.713661 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.707862 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:42.714620 10038 raft_consensus.cc:1217] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
W20260709 13:17:42.702314 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.714761 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.715162 10038 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:42.715502 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:42.716236 10115 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
W20260709 13:17:42.716987 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.701932 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:42.717849 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57623.5us
I20260709 13:17:42.718171 14096 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.719019 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:42.719869 13922 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.720266 13922 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.720320 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:42.720727 13922 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.721000 14270 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:42.718613 14096 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:42.722050 14096 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.718652 10711 raft_consensus.cc:1275] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:42.714443 10109 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:42.717789 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:42.686944 14305 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.737603 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:42.719019 14211 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.729352 14041 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:42.751014 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.751601 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.737288 14231 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:42.757330 14331 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:42.763386 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.775058 14180 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:42.775341 14333 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:17:42.774801 10709 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.764693 14198 raft_consensus.cc:2764] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:42.776423 10709 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.777272 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:42.779320 14060 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.772045 14305 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.779698 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:42.774873 14329 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:17:42.784025 14198 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:42.779834 14060 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:42.786049 14060 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.786123 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.787582 14198 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.848941 13922 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.849298 14087 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.850186 14087 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.851351 13922 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:42.854782 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.852741 14087 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:42.860776 14334 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:17:42.865461 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 123287us
W20260709 13:17:42.866592 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63157.3us
W20260709 13:17:42.871853 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 115892us
W20260709 13:17:42.871241 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 133655us
I20260709 13:17:42.873428 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:42.875191 14196 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:42.840049 14041 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:42.886353 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:42.900159 13978 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.900986 13978 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.902582 14169 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.903263 14169 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:42.907385 14041 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.880858 14231 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.882575 14196 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.911777 14198 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:42.915006 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.886065 14211 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:42.903334 13978 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:42.924876 10709 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:42.912006 14169 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:42.917871 14196 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:42.936034 14069 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:17:42.937690 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 633) took 1594 ms. Trace:
I20260709 13:17:42.943723 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.944588 14344 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:42.945319 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:42.945233 14344 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:42.948206 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71432.2us
I20260709 13:17:42.939487 10709 rpcz_store.cc:276] 0709 13:17:41.334906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.335036 (+   130us) service_pool.cc:224] Handling call
0709 13:17:41.335323 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.526028 (+1190705us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4c0000ea80. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6d7b4a20 00007f3c6d7c5a29 00007f3c6d78b644 00007f3c6d7b2f2d 00007f3c6d7b2b93 00007f3c6f4e318b 00007f3c6f4e3cb5 00007f3c6f4def30 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416
0709 13:17:42.767358 (+241330us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400754a20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f46606f 00007f3c6f4def60 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62
0709 13:17:42.925505 (+158147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.929241 (+  3736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53998208}
W20260709 13:17:42.978247 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.017375 14210 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:43.019887 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 159645us
I20260709 13:17:43.020043 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:43.020565 14060 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.022133 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:43.022761 14060 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:42.959450 14344 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:43.039779 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 140948us
I20260709 13:17:42.936700 14231 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.056131 14342 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.059005 14349 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:43.062536 14349 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:43.072345 14228 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.075721 14228 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.067719 14096 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.079161 14096 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.076715 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:43.085196 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.082576 14274 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:43.111505 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.112113 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.112455 14231 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.056790 14342 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.114714 14196 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.118300 14211 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:43.120853 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:43.122334 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:43.123416 14305 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:43.124091 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.089212 14087 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:43.131494 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.132843 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83454.6us
I20260709 13:17:43.133742 10185 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:43.138754 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.137708 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.138193 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.125223 14196 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:43.144371 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 120854us
I20260709 13:17:43.130611 14087 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.124217 14305 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:43.148447 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:43.150740 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:43.151546 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:43.152035 14087 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.154059 14231 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:43.170022 14196 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.170806 10032 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
W20260709 13:17:43.174806 14328 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.556s	user 0.006s	sys 0.006s
I20260709 13:17:43.171253 14231 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:43.190804 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.191234 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.184304 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:43.183568 14231 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:43.184850 14161 consensus_meta.cc:287] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.006s
I20260709 13:17:43.174022 14196 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.200806 14351 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:43.201393 14351 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:43.201808 14351 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.210167 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.211287 10184 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:43.212541 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.213337 10184 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:43.194748 14274 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:17:43.220297 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.221340 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.224777 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:43.225677 14336 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 13:17:43.226107 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.226759 10185 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:43.227638 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.233496 10185 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:43.199712 14161 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.240367 14305 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:43.240403 14347 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.216s	user 0.003s	sys 0.000s
I20260709 13:17:43.241096 14305 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.242547 14196 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:43.243443 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.236395 14271 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:43.244534 14271 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.246811 14271 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.248303 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.249378 10184 raft_consensus.cc:2410] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:43.288014 14271 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.293824 10184 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:43.287575 14228 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.294903 10184 pending_rounds.cc:85] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 5
I20260709 13:17:43.289131 14305 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.296355 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:43.296204 10184 pending_rounds.cc:107] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:43.306536 10184 raft_consensus.cc:2889] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.332114 14305 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:43.332664 14305 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.333038 14305 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.333711 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:43.334956 14231 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.335570 14351 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.336967 14161 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.337673 14313 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.338258 14313 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.295997 14271 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.342010 14351 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.344259 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.342494 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.348068 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:43.348887 14231 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.349932 14060 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:43.350369 14060 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.350371 14313 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.346844 14274 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.351142 14060 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.352370 14271 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:43.354403 10155 leader_election.cc:336] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.537s (SENT)
I20260709 13:17:43.350373 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:43.356905 13978 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:43.360935 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:43.362027 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.362650 10183 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.363996 10184 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:43.365463 14095 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:17:43.373349 10155 leader_election.cc:336] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.554s (SENT)
W20260709 13:17:43.375686 14338 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.451s	user 0.003s	sys 0.000s
I20260709 13:17:43.365826 14274 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:43.382789 14198 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:43.366140 14271 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:43.402696 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.471892 14340 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.624s	user 0.000s	sys 0.003s
I20260709 13:17:43.472810 10184 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:43.388167 14274 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.473742 14274 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:43.476436 10183 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:43.478863 14060 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:43.572567 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.605412 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.608995 10107 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:43.610124 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:43.613276 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.587563 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:43.616753 10709 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:43.618884 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:43.620086 10108 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:43.615828 10155 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.635s (SENT)
I20260709 13:17:43.620822 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:43.624361 10106 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:43.627414 10109 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:43.612185 14095 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.630036 10707 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.619990 14161 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:43.632794 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:43.633724 14360 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:43.616101 14087 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.648435 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:43.648012 14161 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:43.662166 14060 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.661520 14360 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.634491 14095 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.662854 14360 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.665283 14095 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:43.665858 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.666203 14360 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.666823 14360 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:43.660148 10107 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:43.681000 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.681981 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 806) took 1392 ms. Trace:
I20260709 13:17:43.682287 10189 rpcz_store.cc:276] 0709 13:17:42.289922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.299945 (+ 10023us) service_pool.cc:224] Handling call
0709 13:17:43.680851 (+1380906us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:17:43.681882 (+  1031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8380800}
I20260709 13:17:43.684772 13909 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.686096 14095 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.686717 14095 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.690907 14087 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.667402 14360 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.691277 14095 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.695715 14161 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.708050 14274 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.716307 10715 raft_consensus.cc:2410] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:43.717021 14162 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.717518 14162 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.737214 14313 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.737962 14313 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.740479 14360 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.733922 14274 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.757593 14305 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.759277 10115 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:43.761464 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 154204us
I20260709 13:17:43.764320 14274 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:43.772764 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:43.770880 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:43.775360 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:43.774474 10155 leader_election.cc:336] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.684s (SENT)
I20260709 13:17:43.776198 10713 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:43.776091 10708 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:43.768311 14313 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.772346 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:43.775708 10707 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:43.774369 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:43.766836 14305 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.799495 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:43.800276 10114 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:43.801347 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:43.802024 10107 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.793726 14095 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.804289 14095 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.806442 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:43.810982 14360 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.811676 14360 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.812500 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:43.813166 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.811523 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:43.814597 14360 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.815054 10110 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:43.815928 14087 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:43.823544 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:43.824536 10112 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.826745 14095 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.832027 10107 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
W20260709 13:17:43.834589 10155 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.724s (SENT)
I20260709 13:17:43.835089 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:43.820461 14305 consensus_queue.cc:1048] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:17:43.838523 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.007s	sys 0.012s
W20260709 13:17:43.838944 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.007s	sys 0.012s
I20260709 13:17:43.839895 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 734) took 1133 ms. Trace:
I20260709 13:17:43.840253 10716 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:43.840622 10716 pending_rounds.cc:85] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 7
I20260709 13:17:43.840862 10716 pending_rounds.cc:107] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:43.841094 10716 raft_consensus.cc:2889] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.840286 10715 rpcz_store.cc:276] 0709 13:17:42.706688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.717375 (+ 10687us) service_pool.cc:224] Handling call
0709 13:17:43.839612 (+1122237us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400593654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:43.839813 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262590848}
I20260709 13:17:43.843842 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:43.846788 13978 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:43.847270 14366 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:43.847703 14366 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.848218 14366 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.848120 14215 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:43.852469 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 639465us
W20260709 13:17:43.854209 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47671.4us
I20260709 13:17:43.854326 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:43.858318 10112 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
W20260709 13:17:43.861511 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 648629us
I20260709 13:17:43.861316 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:43.866044 13985 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:43.864773 13978 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.868770 13978 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.871191 13978 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:43.872486 14332 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.214s	user 0.003s	sys 0.010s
I20260709 13:17:43.874148 10186 raft_consensus.cc:1217] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 13:17:43.875805 10186 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:43.878708 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1911) took 2337 ms. Trace:
I20260709 13:17:43.882822 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:43.882718 14370 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:43.883764 14349 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:43.884547 14349 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:43.885679 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 801) took 1659 ms. Trace:
I20260709 13:17:43.886163 10186 rpcz_store.cc:276] 0709 13:17:42.225958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.579916 (+353958us) service_pool.cc:224] Handling call
0709 13:17:43.874001 (+1294085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.876191 (+  2190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.885404 (+  9213us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400096850. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:43.885598 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948508416}
I20260709 13:17:43.875412 14360 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.887832 14360 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.890282 14360 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:43.879292 13978 raft_consensus.cc:2764] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:17:43.892601 13978 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:43.893074 13978 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.893433 13978 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.899516 14298 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.900233 14298 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.903970 10714 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:43.908047 14341 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:43.911659 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:43.912748 13922 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:43.914299 13922 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.915010 13922 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:43.915325 13922 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:43.915031 14095 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:43.916684 14095 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.919037 14095 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:43.926527 10182 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:43.928351 10189 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:43.930310 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.931656 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:43.931401 13922 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:43.932319 10186 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:43.932801 13922 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.933082 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.932319 13978 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.880218 10181 rpcz_store.cc:276] 0709 13:17:41.541269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.259495 (+718226us) service_pool.cc:224] Handling call
0709 13:17:42.260243 (+   748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:42.262358 (+  2115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.262394 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:42.263161 (+   767us) log.cc:844] Serialized 52 byte log entry
0709 13:17:42.348282 (+ 85121us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:42.348329 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.348414 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.871851 (+1523437us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:43.873704 (+  1853us) raft_consensus.cc:1685] finished
0709 13:17:43.873726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.878624 (+  4898us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"spinlock_wait_cycles":28391168,"thread_start_us":84609,"threads_started":1,"wal-append.queue_time_us":321321}
I20260709 13:17:43.948160 13978 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.948752 13978 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:43.949175 10155 leader_election.cc:336] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.824s (SENT)
I20260709 13:17:43.949287 13978 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:43.950381 10155 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.831s (SENT)
I20260709 13:17:43.950817 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:43.943464 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:43.951560 13978 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:43.952061 10110 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:43.952221 13978 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:43.944512 10111 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:43.948639 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:43.945137 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:43.945802 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:43.042562  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.956983 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:43.967693 10185 pending_rounds.cc:85] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 4
I20260709 13:17:43.968058 10185 pending_rounds.cc:107] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:43.968291 10185 raft_consensus.cc:2889] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.980129 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:43.984099 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:43.984823 10037 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:43.985806 10031 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:43.986620 14371 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:17:43.987483 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:43.989274 14095 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:43.989708 14095 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.990072 14095 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.945593 14366 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:43.992609 14366 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:44.000710 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1919) took 2217 ms. Trace:
I20260709 13:17:44.001335 10180 rpcz_store.cc:276] 0709 13:17:41.783715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.289109 (+505394us) service_pool.cc:224] Handling call
0709 13:17:43.999640 (+1710531us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:43.999963 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.000273 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.000300 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:44.000348 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:44.000398 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.000465 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.000627 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8187648}
I20260709 13:17:44.685524 14095 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.287034 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.695937 14385 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.696784 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.287827 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.696913 14385 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.314568 13985 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.313740 14060 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.765170 14060 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.766865 14386 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:44.767273 14060 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.312712 14305 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.770779 14305 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.150838 14356 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:44.773180 14356 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.479223 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.480671 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.345602 14162 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.779982 14305 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:44.780265 10112 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:44.780961 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.781831 10033 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:44.496106 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.524117 14195 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:44.783974 14195 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.785408 14356 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:44.579864  9926 thread.cc:641] dir /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.008s	sys 0.033s
W20260709 13:17:44.786607  9926 thread.cc:608] dir /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.009s	sys 0.034s
I20260709 13:17:44.788878 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:44.639055 10714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 638) took 2555 ms (client timeout 3312 ms). Trace:
W20260709 13:17:44.797425 10714 rpcz_store.cc:269] 0709 13:17:42.083352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.103777 (+ 20425us) service_pool.cc:224] Handling call
0709 13:17:44.638781 (+2535004us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54003ce1d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:44.638924 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4037367552}
I20260709 13:17:44.649781 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.799211 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.800565 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.801107 10039 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:44.658017 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.659180 14365 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.806238 14365 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.660425 14376 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.812492 14376 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.661520 14377 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.672700 14164 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.674571 14198 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:44.682368 14383 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:44.814306 14377 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.815207 14383 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.286195 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.817104 10038 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:44.818145 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.819336 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:44.692258 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 209113us
I20260709 13:17:44.692988 14349 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:44.693914 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:44.820780 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 126942us
I20260709 13:17:44.694754 14346 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:44.696784 14388 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.821094 14349 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:44.821565 14388 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.821926 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:44.288343 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.814819 14198 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.287240 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.700629 14385 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.821596 14349 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:44.824309 14349 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:44.701921 14095 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:44.825093 14095 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.705469 14313 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:44.825534 14095 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:44.714937 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.825874 14313 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.731915 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:44.826792 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.831252 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:44.851727 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:44.858176 14162 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:44.859625 14162 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:44.860018 14162 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:44.860527 14060 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.861368 14162 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.719889 14387 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.754575 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 859) took 1271 ms. Trace:
I20260709 13:17:44.762269 14341 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:44.763427 13985 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.778466 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.888688 10111 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:44.786166 14195 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:44.574539 14370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.007s	sys 0.010s
I20260709 13:17:44.888991 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:44.889377 14370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.008s	sys 0.010s
I20260709 13:17:44.889644 13985 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.889757 10037 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:44.792389 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:44.791443 14305 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:44.793843 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:44.824352 14385 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:44.832512 10186 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:44.891685 10111 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:44.887939 10716 rpcz_store.cc:276] 0709 13:17:43.482907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.483055 (+   148us) service_pool.cc:224] Handling call
0709 13:17:43.839764 (+356709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.841497 (+  1733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.754342 (+912845us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400593650. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:44.754509 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603713920}
I20260709 13:17:44.894220 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:44.894340 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.894842 10186 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
W20260709 13:17:44.734282 10709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.005s	sys 0.030s
I20260709 13:17:44.865453 14383 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:44.895915 10709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.007s	sys 0.030s
I20260709 13:17:44.865443 14388 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.896799 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 864) took 1259 ms. Trace:
W20260709 13:17:43.952773 10155 leader_election.cc:336] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.878s (SENT)
I20260709 13:17:44.891510 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:44.898411 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 945604us
W20260709 13:17:44.899127 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.882s (SENT) [suppressed 39 similar messages]
I20260709 13:17:44.897143 10709 rpcz_store.cc:276] 0709 13:17:43.637107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.637645 (+   538us) service_pool.cc:224] Handling call
0709 13:17:43.657939 (+ 20294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.658226 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:43.668303 (+ 10077us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.965843 (+297540us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800322de0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:17:44.896435 (+930592us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:44.896500 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:44.896554 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.896618 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.896722 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9753,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":1509,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":26695424,"thread_start_us":930285,"threads_started":1,"wal-append.queue_time_us":964513}
I20260709 13:17:44.887817 10112 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:44.866511 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.904774 14305 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.906510 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.861292 14060 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.907534 14305 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:44.752681 14390 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:44.869632 14198 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:44.870949 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.026s	sys 0.028s
W20260709 13:17:44.908996 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.026s	sys 0.028s
I20260709 13:17:44.908718 14390 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:44.909339 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 1.02655e+06us
I20260709 13:17:44.873648 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:44.910354 14060 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:44.911028 10189 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:44.877509 10181 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:44.877916 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2831) took 1254 ms. Trace:
I20260709 13:17:44.887460 14387 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.913292 10115 rpcz_store.cc:276] 0709 13:17:43.623092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.623228 (+   136us) service_pool.cc:224] Handling call
0709 13:17:44.877672 (+1254444us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540010ead4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:44.877827 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283526400}
I20260709 13:17:44.886890 14162 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.907598 10036 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:44.868912 14164 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.924508 14164 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.868516 14376 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:44.925001 14303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.071s	sys 0.051s
W20260709 13:17:44.925395 14303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.071s	sys 0.051s
I20260709 13:17:44.926492 14303 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:44.926870 14303 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:44.866431 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.879904 14365 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:44.884100 14298 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:44.865904 14095 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:44.886852 10184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.011s	sys 0.025s
W20260709 13:17:44.882583 14187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.040s	sys 0.054s
I20260709 13:17:44.927724 14303 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.931806 14303 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.792510 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:44.891570 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99268.1us
I20260709 13:17:44.932861 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:44.933663 14195 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:44.934356 14195 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:44.934578 14360 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:44.935048 14360 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:44.935243 14195 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:44.936683 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:44.937350 10715 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.935694 14195 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:44.941042 14195 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.942297 14195 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:44.930346 10184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.012s	sys 0.026s
I20260709 13:17:44.899073 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.951092 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1943) took 1025 ms. Trace:
I20260709 13:17:44.934392 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:44.950110 14298 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.890105 14370 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:44.930516 14187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.041s	sys 0.056s
I20260709 13:17:44.955307 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.956184 10039 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:44.956751 13985 raft_consensus.cc:2764] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:44.956995 14370 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:44.930323 10032 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:44.960561 10107 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:44.960338 14360 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.892884 14377 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:44.902289 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:44.963101 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60895.7us
I20260709 13:17:44.903039 13926 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:44.893158 14385 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.830617 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.973299 14385 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:44.974077 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.952617 14298 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:44.976971 14298 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:44.977962 10182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.008s	sys 0.008s
W20260709 13:17:44.978322 10182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.008s	sys 0.008s
W20260709 13:17:44.749629 13922 consensus_meta.cc:287] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.004s
I20260709 13:17:44.984318 10031 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:44.979656 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1949) took 1008 ms. Trace:
I20260709 13:17:44.890390 14341 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:44.987010 10182 rpcz_store.cc:276] 0709 13:17:43.970930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.971074 (+   144us) service_pool.cc:224] Handling call
0709 13:17:43.971429 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:43.971865 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.971892 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:43.972488 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:17:44.978735 (+1006247us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:44.979078 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.979321 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.979410 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.979448 (+    38us) raft_consensus.cc:1685] finished
0709 13:17:44.979459 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.979591 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":1369,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":798,"thread_start_us":1005854,"threads_started":1,"wal-append.queue_time_us":650006}
I20260709 13:17:44.989835 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:44.878827 14313 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:44.895607 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.951504 10184 rpcz_store.cc:276] 0709 13:17:43.925463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.927679 (+  2216us) service_pool.cc:224] Handling call
0709 13:17:43.927996 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.928225 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:43.928892 (+   667us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.950733 (+1021841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:44.950789 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:44.950829 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.950912 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.951033 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":151,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1364,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1021393,"threads_started":1,"wal-append.queue_time_us":759470}
I20260709 13:17:44.952013 13909 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:44.950110 14342 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:45.032591 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 210824us
I20260709 13:17:44.965236 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:44.969502 10715 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:44.956426 14384 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:44.956702 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.970538 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:45.035907 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 125673us
I20260709 13:17:44.834262 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.036132 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.974809 10038 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:45.037227 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:44.912505 14390 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:45.007536 14385 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.009339 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:44.991791 10182 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:44.954533 14346 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:44.971187 10037 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:45.039450 14313 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:45.042483 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 88434.2us
I20260709 13:17:44.961828 14360 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.042294 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:45.042694 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 168818us
W20260709 13:17:45.038455 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 139033us
I20260709 13:17:45.038388 10036 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:45.046576 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:45.049075 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 83262.9us
I20260709 13:17:45.050644 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.051258 10035 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:44.987943 14341 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:45.052407 10186 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.057156 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:44.929826 14365 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:17:44.965036 14370 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:45.062836 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.066443 10035 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:45.068432 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.074150 10183 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:17:45.075541 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 109505us
I20260709 13:17:45.076643 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:45.086664 14096 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:45.042600 14215 raft_consensus.cc:2764] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:45.068840 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.090107 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.053061 14342 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.039919 14385 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:45.087154 14271 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:45.065611 14390 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:45.100930 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.053300 13909 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.066140 14346 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.100848 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.124258 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.090193 14298 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:45.063406 14313 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:17:45.087260 14096 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:45.118669 10707 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:45.119760 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:45.094735 10155 leader_election.cc:336] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.898s (SENT)
I20260709 13:17:45.127884 14346 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.129701 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.129873 10708 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:17:45.131036 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.137610 14411 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:45.138079 13909 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:45.140393 14396 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:45.123409 14388 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.210690 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:45.210891 14388 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.101866 14271 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:45.141791 10185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.172s	user 0.005s	sys 0.005s
I20260709 13:17:45.148124 14341 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.202858 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.102584 14370 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:17:45.216358 10708 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:45.102047 14305 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.207635 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.206250 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.211308 10113 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.119902 14390 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:45.213831 10185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.006s	sys 0.005s
I20260709 13:17:45.213943 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:45.219681 10114 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.216028 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.221510 10112 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:45.131686 14298 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.209877 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:45.218438 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 117655us
I20260709 13:17:45.103694 14095 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:17:45.208262 14162 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.227454 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.225628 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.227190 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.229358 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.215803 14271 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.222576 14390 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.240229 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.234468 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.236034 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.231129 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.235247 10035 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:45.246740 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.215238 14387 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:45.219779 14384 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:45.222558 14298 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.256877 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1948) took 1290 ms. Trace:
I20260709 13:17:45.257596 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:45.271863 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.240581 13978 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.233819 14412 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.217552 14349 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:45.241374 14162 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:45.237365 14388 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:45.301255 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 171638us
I20260709 13:17:45.307073 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:45.308434 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 77533us
I20260709 13:17:45.309214 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.307816 13909 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:45.316231  8944 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd80 after lost signal to thread 10153
W20260709 13:17:45.317855 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 229505us
I20260709 13:17:45.318569 14384 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:45.320363 14410 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:45.327338 13909 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.247326 14365 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:45.248804 14399 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
W20260709 13:17:45.211807  9922 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f145536c6dbe456fb8565950244bc2a5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:45.355569 14399 consensus_queue.cc:1243] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:45.355140 14407 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:45.356155 14399 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:45.356570 14399 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:45.240882 14404 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:17:45.356323 14407 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.357548 14365 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:45.330017 14349 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:45.358558 14342 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:45.355767  9922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 203645us
W20260709 13:17:45.358566 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51566.1us
I20260709 13:17:45.360342 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.281023 14376 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:17:45.308954 14162 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.362876 14365 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:45.363794 14365 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.365029 14365 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.359040 14407 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:45.274853 14096 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:45.368407 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59280us
I20260709 13:17:45.321772 14384 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.361868 14417 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:45.368263 14407 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.370709 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.357816 14385 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:45.374249 14385 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.374881 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.376047 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.369403 14346 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.359104 14342 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:45.377190 14387 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:45.377777 14387 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:45.377955 14342 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:45.379952 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.371529 14417 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:45.352257 14406 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:45.381520 14387 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:45.381448 14417 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.380188 14060 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:45.382544 14060 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.382936 14060 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.384123 14385 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:45.387485 14406 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:45.372804 14399 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.338788 14419 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.370183 14414 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:17:45.391033 14060 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.263831 10185 rpcz_store.cc:276] 0709 13:17:43.966929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.967074 (+   145us) service_pool.cc:224] Handling call
0709 13:17:43.967464 (+   390us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:43.969002 (+  1538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.969033 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:43.969676 (+   643us) log.cc:844] Serialized 78 byte log entry
0709 13:17:45.219200 (+1249524us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:45.245350 (+ 26150us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.245813 (+   463us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.251894 (+  6081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.252006 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.252051 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:45.252064 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.256793 (+  4729us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5763,"prepare.queue_time_us":26588,"raft.queue_time_us":3515,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":13975,"thread_start_us":1249097,"threads_started":1,"wal-append.queue_time_us":662124}
I20260709 13:17:45.390969 14399 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:45.374770 10155 leader_election.cc:336] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.997s (SENT)
W20260709 13:17:45.394836 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 303933us
I20260709 13:17:45.352381 10113 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
W20260709 13:17:45.402119 10155 leader_election.cc:336] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.054s (SENT)
I20260709 13:17:45.402628 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:45.393653 14060 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:45.407444 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 254973us
W20260709 13:17:45.407279 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 148403us
I20260709 13:17:45.414752 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.416213 14423 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:45.416898 10114 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:45.417303 14403 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:45.417729 14403 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:45.418627 14403 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.420027 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:45.421542 14376 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.421952 14376 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:45.422310 14376 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.426708 10114 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: [12.12-15.13]
W20260709 13:17:45.429847 10061 debug-util.cc:398] Leaking SignalData structure 0x7b080037be20 after lost signal to thread 8942
W20260709 13:17:45.430787 10061 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9040 after lost signal to thread 9972
I20260709 13:17:45.430959 14383 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:45.431578 14383 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.430783 10114 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: [9.9-10.10]
W20260709 13:17:45.432191 10061 debug-util.cc:398] Leaking SignalData structure 0x7b080039e280 after lost signal to thread 10064
W20260709 13:17:45.433458 10061 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0040 after lost signal to thread 10139
W20260709 13:17:45.433771 10061 debug-util.cc:398] Leaking SignalData structure 0x7b08003a52c0 after lost signal to thread 10140
I20260709 13:17:45.432219 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:45.434957 10061 debug-util.cc:398] Leaking SignalData structure 0x7b0800335060 after lost signal to thread 10213
I20260709 13:17:45.435137 14313 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.434664 14383 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:45.436223 10061 debug-util.cc:398] Leaking SignalData structure 0x7b0800205fa0 after lost signal to thread 10740
I20260709 13:17:45.436581 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.437387 14313 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:45.437942 14313 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:45.437471 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.438977 14313 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:45.436522 10061 debug-util.cc:398] Leaking SignalData structure 0x7b08003ede40 after lost signal to thread 10741
W20260709 13:17:45.443904 10061 debug-util.cc:398] Leaking SignalData structure 0x7b080010dc20 after lost signal to thread 14276
W20260709 13:17:45.444227 10061 debug-util.cc:398] Leaking SignalData structure 0x7b080034a1a0 after lost signal to thread 14282
W20260709 13:17:45.444550 10061 debug-util.cc:398] Leaking SignalData structure 0x7b08003576e0 after lost signal to thread 14327
I20260709 13:17:45.439584 13978 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:45.444836 10061 debug-util.cc:398] Leaking SignalData structure 0x7b080033ff40 after lost signal to thread 14334
W20260709 13:17:45.447335 10061 debug-util.cc:398] Leaking SignalData structure 0x7b08003a85a0 after lost signal to thread 14335
I20260709 13:17:45.459869 14396 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:45.463094 13978 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:45.465431 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49773.8us
I20260709 13:17:45.466739 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:45.467262 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52503.1us
I20260709 13:17:45.468845 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.469619 10708 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:45.464294 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.393703 14187 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:45.466738 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:45.481040 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.483127 10713 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:45.484057 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.483688 13978 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:45.406211 14271 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:45.480202 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 422236us
I20260709 13:17:45.482057 10712 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:17:45.412902 14360 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.497430 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.500553 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.414192 14418 raft_consensus.cc:2764] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:45.498886 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:45.499109 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:45.480836 14187 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:45.501754 10106 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:45.504558 10155 leader_election.cc:336] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.091s (SENT)
I20260709 13:17:45.501211 10712 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:45.505683 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.508291 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.396657 14419 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.511487 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.513129 14419 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.513625 14187 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:45.514446 10155 leader_election.cc:336] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.125s (SENT)
I20260709 13:17:45.500639 14427 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.494709 14384 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:17:45.516242 10110 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:45.516461 10712 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:45.517091 10109 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.517542 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.515439 10115 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:45.520813 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.521405 10111 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:45.464931 13985 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:45.461161 14396 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.528751 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:45.533075 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.514736 14187 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.533916 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.526473 14427 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.540158 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.543237 14427 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.545629 14427 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.546691 14390 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.549367 14162 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.550473 14390 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.551090 14384 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.551594 14384 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:45.553596 14384 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:45.554430 10155 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.181s (SENT)
I20260709 13:17:45.554862 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:45.556057 10155 leader_election.cc:336] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.187s (SENT)
W20260709 13:17:45.557340 10155 leader_election.cc:336] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.193s (SENT)
W20260709 13:17:45.559011 10155 leader_election.cc:336] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.226s (SENT)
I20260709 13:17:45.559935 14365 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.560951 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:45.562150 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.542126 14298 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.564595 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:45.573983 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.580047 14376 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.582084 14298 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:45.553506 14271 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:45.583328 10712 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:45.583734 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:45.574808 14162 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:45.584434 10185 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.585394 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:45.585973 10710 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.587709 14376 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.622754 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.590682 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:45.592401 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.624483 10713 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:45.624826 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:45.596553 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.625466 10715 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.597569 10111 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:45.625238 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:45.628577 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.601161 10140 heartbeater.cc:646] Failed to heartbeat to 127.8.186.254:36577 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.186.254:36577 timed out after 15.000s (SENT)
I20260709 13:17:45.604995 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.606781 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.616415 10106 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:45.630390 10108 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:45.631776 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:45.632027 10155 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.232s (SENT)
I20260709 13:17:45.627019 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.634581 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.635908 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:45.636583 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.637043 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:45.634135 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:45.638418 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.639079 14423 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.644825 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.646533 10710 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:45.647876 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:45.648923 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:45.650719 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.651238 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.653203 10715 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:17:45.669816 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 164004us
I20260709 13:17:45.671964 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:45.625306 14162 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.670271 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:45.644181 14419 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.675700 10180 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.675966 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:45.680464 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.680604 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.681176 10040 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:45.681949 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.678473 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:45.683471 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.648229 14390 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.649935 14412 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.683876 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.687204 14356 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:45.692346 10185 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:45.692513 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.693775 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.694415 10039 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:45.687498 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.650498 14298 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:45.689862 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:45.671451 14376 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:45.702090 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:45.697003 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.696740 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:45.703343 10031 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.697598 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:45.703682 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.698925 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.700529 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:45.700852 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:45.705715 10188 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.702845 10039 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.698446 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.706945 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:45.698086 14356 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:45.679216 14419 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.670683 14417 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:45.710774 10035 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:45.710907 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:45.690363 14390 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:45.715628 10038 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.716619 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:45.718838 10034 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.708238 14383 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:45.710163 14162 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:45.724061 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:45.710685 14356 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.713266 14419 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.700428 14425 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:45.710317 14376 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:45.740854 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.746342 10039 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:45.733368 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:45.747848 10038 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.719086 14390 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:45.753511 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.770757 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:45.770949 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53088.7us
I20260709 13:17:45.741909 14353 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.776796 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.777756 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.749481 14383 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:45.778455 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.805940 14403 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.788702 14342 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:45.806782 14342 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:45.806917 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.805787 14406 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:45.807957 13909 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.808403 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:45.808611 13909 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.809264 13909 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:45.774703 14162 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:45.810081 14383 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.811235 14415 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:45.800726 10189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.025s	sys 0.036s
W20260709 13:17:45.811921 10189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.026s	sys 0.036s
I20260709 13:17:45.813227 14415 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:45.810915 14162 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.817543 10180 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:45.779165 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 644) took 1213 ms. Trace:
I20260709 13:17:45.799372 10183 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
W20260709 13:17:45.818686 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 43490.6us
I20260709 13:17:45.798173 10031 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:45.819168 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:45.795395 10034 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:45.818554 10707 rpcz_store.cc:276] 0709 13:17:44.566214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.793584 (+227370us) service_pool.cc:224] Handling call
0709 13:17:45.778978 (+985394us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54005dff54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:45.779083 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495496064}
I20260709 13:17:45.834748 10034 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:45.836409 10188 raft_consensus.cc:2410] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:45.835604 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:45.837342 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:45.836246 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.841038 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.836030 10038 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:17:45.849931 14435 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:45.854238 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.860622 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:45.860961 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.836947 14271 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.778846 14396 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:17:45.864842 14396 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:45.865206 14396 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:45.866060 14396 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:45.861320 10181 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:45.840787 14060 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.844810 14427 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.873631 10107 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:45.803926 14164 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:17:45.883682 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 180080us
I20260709 13:17:45.862073 10188 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:45.862092 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:45.908345 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46339.2us
I20260709 13:17:45.850920 13909 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:45.869235 14341 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:45.867244 14396 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.868647 14298 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:45.921571 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.922297 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.919756 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:45.914184 14418 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:45.943398 10113 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:45.924185 14298 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.948199 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.929921 13926 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:45.867998 14342 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.901181 14376 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.961745 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.963469 14303 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:45.966887 14390 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.949544 14418 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:45.844201  9926 maintenance_manager.cc:643] P a2e763e48a394cda873aa837f65da240: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.484s	user 0.164s	sys 0.091s Metrics: {"bytes_written":29372,"cfile_init":1,"dirs.queue_time_us":785429,"dirs.run_cpu_time_us":641,"dirs.run_wall_time_us":39379,"drs_written":1,"lbm_read_time_us":398,"lbm_reads_lt_1ms":4,"lbm_write_time_us":273216,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":4,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":63,"thread_start_us":981871,"threads_started":2,"wal-append.queue_time_us":27949}
I20260709 13:17:45.951963 13926 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:45.987334 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:45.971510 14419 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:45.992370 14419 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:45.979179 14303 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:46.012493 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:46.012893 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 65612.3us
I20260709 13:17:46.088333 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:46.103937 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 144612us
I20260709 13:17:46.107038 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:46.109285 10108 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:46.110212 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.113235 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.115099 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:46.106451 14444 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:46.116668 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.121815 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:46.106714 14418 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.114032 14425 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.132565 10106 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:46.116433 14446 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.111238 14420 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.140738 14187 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:46.177183 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47097us
I20260709 13:17:46.180047 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.177974 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.180819 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.182803 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.113200 14411 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:17:46.185760  9927 maintenance_manager.cc:419] P a2e763e48a394cda873aa837f65da240: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10183 bytes on disk
I20260709 13:17:46.194077 14453 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.117288 13926 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.197048 14187 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:46.197969 14187 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.200366 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.202387 14424 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.205546 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:46.206187 10188 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.205482 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.206533 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:46.195518  9926 maintenance_manager.cc:643] P a2e763e48a394cda873aa837f65da240: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":343,"lbm_reads_lt_1ms":4}
W20260709 13:17:46.188781 14451 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:17:46.206975 10186 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.209859 13922 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:46.210244 13922 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:46.211082 13922 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.207917 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:46.212023 13922 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.174031 14303 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.207604 14419 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:46.220577 14419 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.221707 10188 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:46.222424 14419 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:46.219347 14356 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.224647 10038 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:46.226424 10110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0be325f96e974db28d904978cd65157d"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:17:46.227070 10110 raft_consensus.cc:606] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.227401 10110 raft_consensus.cc:614] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.231906 14390 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:46.233866 14407 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:46.234350 14407 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:46.235351 14407 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.236516 14407 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.234038 10189 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:46.239125 14096 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.241906 14413 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:46.242568 14413 consensus_queue.cc:1243] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:46.243547 10189 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:17:46.243925 10189 pending_rounds.cc:85] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 9
I20260709 13:17:46.244131 10189 pending_rounds.cc:107] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:46.244338 10189 raft_consensus.cc:2889] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.246578 10184 raft_consensus.cc:2410] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:46.248102 14413 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:46.234553 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.249404 10180 raft_consensus.cc:2410] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:46.251127 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:46.252471 14377 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:46.253508 14365 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:46.253863 14365 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:46.254686 14365 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.255400  9934 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:46.258208 10189 raft_consensus.cc:1217] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.11->[12.12-16.14]   Dedup: 12.12->[14.13-16.14]
I20260709 13:17:46.259135 10032 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:17:46.259922 10032 pending_rounds.cc:85] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
I20260709 13:17:46.260133 10032 pending_rounds.cc:107] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:17:46.260383 10032 raft_consensus.cc:2889] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.261006 10189 pending_rounds.cc:85] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 12
I20260709 13:17:46.261343 10189 pending_rounds.cc:107] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:17:46.261646 10189 raft_consensus.cc:2889] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.264325 10186 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:46.268144 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:46.268771 10712 raft_consensus.cc:606] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.270431 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.181509 14420 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:46.296082 14356 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:46.297487 14365 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.311525 10110 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:46.274734 14403 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.313778 10113 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:46.316673 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:46.317241 10707 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.280771 14370 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.323549 10712 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:46.284027 14420 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.327153 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:46.329027 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.329483 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:46.330991 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 128325us
W20260709 13:17:46.336046 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.336664 10038 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:46.300583 14413 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:17:46.312824 13978 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.343410 10707 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:46.343571 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:46.345198 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:46.346350 14383 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:46.346897 14383 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:46.347874 14383 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.311929 14162 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:17:46.366592 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 651) took 1411 ms. Trace:
I20260709 13:17:46.332636 14164 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:46.372341 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:46.368467 10032 rpcz_store.cc:276] 0709 13:17:44.954751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.959430 (+  4679us) service_pool.cc:224] Handling call
0709 13:17:44.959768 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.272188 (+1312420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.366341 (+ 94153us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540031abd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:46.366533 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987481856}
I20260709 13:17:46.387430 10712 raft_consensus.cc:606] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.387979 10712 raft_consensus.cc:614] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.398226 10111 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:46.366492 14370 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:46.402796 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93491us
W20260709 13:17:46.409497 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 82432.7us
I20260709 13:17:46.409639 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.410301 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.410661 10707 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.355274 14390 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:17:46.415781 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:46.356851 14305 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:46.366037 13978 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.425055 10185 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.431890 10707 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:46.422014 14303 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:17:46.436088 14303 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.436477 14303 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:46.386526 14164 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.385489 14423 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:17:46.439075 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:46.434170 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 112422us
I20260709 13:17:46.437672 10707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:46.474613 10707 raft_consensus.cc:606] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.408996 14427 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.476163 10707 raft_consensus.cc:614] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.415508 14411 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.480665 14427 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.494004 14164 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:46.437752 14399 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.499984 13978 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:46.501411 14453 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.501928 14453 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:46.503489 14298 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.003s
I20260709 13:17:46.503942 14298 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.504148 14303 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.505336 14303 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.506278 14298 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:46.473469 14385 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:46.509956 14376 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:46.510381 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:46.511492 14376 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:46.512110 14370 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.512794 14377 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:46.513209 14377 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:46.514130 14377 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.515340 14377 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.520200 10709 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:46.521157 10707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:46.521749 10707 raft_consensus.cc:606] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.522075 10707 raft_consensus.cc:614] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.524444 14360 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:46.525450 10713 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.527124 10713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:46.528520 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.527642 10713 raft_consensus.cc:606] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:17:46.529541 10713 raft_consensus.cc:614] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.531093  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:46.531167 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.532099 14404 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:46.532543 14060 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:46.532917 14060 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:46.533773 14060 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.535032 14060 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:46.512221 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93667.2us
I20260709 13:17:46.538337 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:46.538789 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:46.540336 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:46.543169 14342 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.539475 10034 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:46.544679 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:46.539498 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.545948  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.483521 14427 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:46.552726 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.551548  9934 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 5 to 7, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:46.563205 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:46.558358 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 227042us
I20260709 13:17:46.563934 10112 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:17:46.568529 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 131194us
I20260709 13:17:46.529636 14403 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.533699 14404 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.573364 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.544332 13978 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.578743 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:46.569646 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:46.546957 14441 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.535359 14420 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.602576 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.605329  9934 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 10, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 10 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.602587 14360 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.596386 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:46.551864 14385 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.512053 14376 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:46.616374 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:46.551308 14423 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:17:46.594651 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.699131 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 102825us
W20260709 13:17:46.702615 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 133049us
W20260709 13:17:46.703697 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 82890us
W20260709 13:17:46.701246 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 98761.4us
I20260709 13:17:46.704946 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:46.709726 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 92310.8us
W20260709 13:17:46.709188 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 108659us
W20260709 13:17:46.748600 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45100.6us
I20260709 13:17:46.581411 14404 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:46.759433 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54586.4us
I20260709 13:17:46.605175 14370 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.760872 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:46.762344 13978 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:46.762751 13978 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:46.763708 13978 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.764715 14453 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:46.765497 14365 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.765689 14431 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.768231 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.768852 10189 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:46.772608 14423 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.773116 14423 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.775169 14423 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:46.776490 14404 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.777179 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:46.777731 13926 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.753440 14360 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:46.780043 14360 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.780421 14360 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.777825 10713 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:46.785215 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:46.786134 14365 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.786481 14407 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.786940 14431 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.787048 14407 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.793241 14417 raft_consensus.cc:993] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:46.793840 14417 raft_consensus.cc:1081] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:17:46.794574 10189 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:46.709035 14403 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:46.804621 14467 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:17:46.749377 14387 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:46.806515 14387 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:46.806945 14387 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.602787 14305 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
W20260709 13:17:46.813962  9936 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 292) took 17029 ms (client timeout 15000 ms). Trace:
I20260709 13:17:46.767624  9934 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.786530 14365 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.765043 13978 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.833695 14407 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:46.827226 14365 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.838985 14376 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:46.770771 14162 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.842185 14162 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:46.844412 14162 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:46.845314 14449 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:46.845947 14404 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.821379 14385 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:46.853307 14420 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:46.854614 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.855269 10183 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:46.856632 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:46.876132  9934 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:46.878466  9934 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:46.883700 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 140897us
W20260709 13:17:46.883496 14479 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:17:46.891140 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.896140 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:46.898741 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:46.899448 10189 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:46.900053 14096 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.900544 14096 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.900892 14096 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.901296 10182 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:46.814390  9936 rpcz_store.cc:269] 0709 13:17:29.728234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.728556 (+   322us) service_pool.cc:224] Handling call
0709 13:17:46.746206 (+17017650us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:38.147000 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:38.166271 (+ 19271us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:38.166325 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:17:38.166346 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:38.201804 (+ 35458us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:38.201893 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:38.201918 (+    25us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:17:38.203236 (+  1318us) tablet.cc:701] Row locks acquired
0709 13:17:38.203285 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:38.203462 (+   177us) write_op.cc:270] Start()
0709 13:17:38.203609 (+   147us) write_op.cc:276] Timestamp: P: 1783603058203396 usec, L: 0
0709 13:17:38.203631 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:38.232441 (+ 28810us) log.cc:844] Serialized 7099 byte log entry
0709 13:17:38.807473 (+575032us) op_driver.cc:464] REPLICATION: finished
0709 13:17:39.047052 (+239579us) write_op.cc:301] APPLY: starting
0709 13:17:39.148718 (+101666us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:39.407783 (+259065us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:39.466821 (+ 59038us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:39.554705 (+ 87884us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:39.555086 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:17:39.555132 (+    46us) write_op.cc:312] APPLY: finished
0709 13:17:39.555560 (+   428us) log.cc:844] Serialized 125 byte log entry
0709 13:17:39.556616 (+  1056us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:39.556755 (+   139us) write_op.cc:454] Released schema lock
0709 13:17:39.556807 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:39.557219 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:39.557330 (+   111us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":352759,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":151816,"apply.run_cpu_time_us":7395,"apply.run_wall_time_us":577399,"num_ops":18,"prepare.queue_time_us":44434,"prepare.run_cpu_time_us":21390,"prepare.run_wall_time_us":117146,"raft.queue_time_us":133760,"raft.run_cpu_time_us":24493,"raft.run_wall_time_us":217607,"replication_time_us":573765,"spinlock_wait_cycles":1009920,"thread_start_us":287331,"threads_started":4,"wal-append.queue_time_us":87914,"wal-append.run_cpu_time_us":19180,"wal-append.run_wall_time_us":2229518}]]}
I20260709 13:17:46.916178 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:46.920266  9934 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 5 to 8, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 8 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:46.927254 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70728.2us
I20260709 13:17:46.912195 14420 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.931247  9934 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:46.960184  9934 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 5 to 9, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 9 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.961382 10187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:17:46.962034  9934 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 12, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 12 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.928838 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:46.962069 10187 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.967324 10187 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:46.974648 10106 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.035s	sys 0.087s
I20260709 13:17:46.975085  9934 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 9, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:17:46.975714 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.976817 10106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.035s	sys 0.087s
W20260709 13:17:47.006156 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 77383.9us
I20260709 13:17:47.014763 10714 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:46.977353 14418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.066s
I20260709 13:17:47.019430  9934 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 10, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 10 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.051551  9934 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:47.053035 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:47.054701 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45740.4us
I20260709 13:17:46.975445 14476 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:47.019783 14303 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.511s	user 0.016s	sys 0.001s
I20260709 13:17:47.012197 13909 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.968487 14420 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:47.065555  9922 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f145536c6dbe456fb8565950244bc2a5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:17:47.022078 14418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.014s	sys 0.066s
I20260709 13:17:47.069896  9934 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:17:47.067663 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 306856us
I20260709 13:17:47.068841 10186 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.155469 10182 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:47.152449 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 81535.6us
I20260709 13:17:47.168148  9934 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 11, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 11 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:17:47.066046 14476 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.066156 14414 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:47.215549 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 196614us
I20260709 13:17:47.190737  9934 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:47.070092 13909 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.227996 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.052318 14360 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:47.241345 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 169708us
I20260709 13:17:47.242884 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:47.245262 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:47.250155 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 272226us
I20260709 13:17:47.148291 14391 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:47.288496 10038 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:47.288630 10039 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:47.291580 10031 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:47.292387 14442 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.292940 14442 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.293243 14420 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.294955 14442 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.183219 14476 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:47.296607 14486 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:17:47.298626 14484 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:47.250454 14399 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:47.148962 14365 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.300479 14384 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:47.203847 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.302030 14365 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:47.303303 14481 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:17:47.175370 14271 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:17:47.272766 14377 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.218600 14436 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.230850 13909 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.305883 10034 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:17:47.237893 14478 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:17:47.302762 14391 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.308873 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.326493 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.327216 10189 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:47.309615 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.327802 10181 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:47.312242 10038 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:47.328578 10186 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:47.312479 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:17:47.315191 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 63253.5us
I20260709 13:17:47.320621 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.329468 10714 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.329921 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.257197 14474 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.331837 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.336994 10106 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:47.346292 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.346954 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:47.348376 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.349951 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.350713 10106 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:47.365299 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:47.370893  9934 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 6 to 8, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 8 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.335143 14396 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:47.379514 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.381692  9934 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 8, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 8 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:17:47.382777 14491 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
I20260709 13:17:47.383153 14419 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:47.387951 14349 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:47.388535 14349 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.390309 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.390544 14349 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:47.392369 14472 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:17:47.393550 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 850) took 1143 ms. Trace:
I20260709 13:17:47.393896 10180 rpcz_store.cc:276] 0709 13:17:46.250247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.252650 (+  2403us) service_pool.cc:224] Handling call
0709 13:17:46.252935 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.256035 (+  3100us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:46.256067 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.256529 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.580998 (+324469us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:46.581040 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.581295 (+   255us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.393335 (+812040us) raft_consensus.cc:1685] finished
0709 13:17:47.393367 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.393489 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6306,"raft.queue_time_us":316,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":324172,"threads_started":1,"wal-append.queue_time_us":702161}
I20260709 13:17:47.325872 14436 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.397850 14436 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.401661 10714 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:47.325470 14164 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:17:47.352241 13978 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:17:47.347587 14406 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:47.407931 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:47.351292 14060 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.351096 14365 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:47.410811 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43579.7us
I20260709 13:17:47.375597 14474 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.426471 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:47.428073 14470 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.428639 14470 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.429844 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.431116 14470 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:47.432485 14493 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:47.433301 14386 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.378543 14399 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:47.435588 14399 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.437814 14399 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:47.438392 14399 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.439267 14487 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:47.440002 14412 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.440514 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:47.440742 14487 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.444224 14360 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:47.444849 14360 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:47.445256 14360 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:47.422250 13978 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:47.446094 14360 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.447733 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:47.448405 10107 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.451613 10714 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:47.466243 10187 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.407258 14396 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.483121 10187 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:47.422271 14427 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:17:47.422705 14060 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:47.496366 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 116937us
I20260709 13:17:47.498719 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.499332 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.499646 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.499995 10039 raft_consensus.cc:2376] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13. Re-sending same reply.
I20260709 13:17:47.500438 10040 raft_consensus.cc:2376] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12. Re-sending same reply.
I20260709 13:17:47.504758 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:47.506212 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.418900 14406 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.440546 14412 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.515666 10039 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:47.515023 10107 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:47.520923 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.540576 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.541318 10039 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:47.547535 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.549120 10040 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:47.550861 10039 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:47.554149 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.554968 10187 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:47.555183 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:47.526634 14096 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.003s
I20260709 13:17:47.557793 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:47.557379 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 149506us
I20260709 13:17:47.559413 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.560815 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.483536 14476 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.561474 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.561437 10186 raft_consensus.cc:2376] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11. Re-sending same reply.
I20260709 13:17:47.562489 10709 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:47.558468 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.563997 10187 raft_consensus.cc:2368] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15.
I20260709 13:17:47.565469 10033 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:47.567538 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.569232 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.571240 10180 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:47.572119 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.573002 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.571699 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.574994 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.580804 10187 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:47.585448 10715 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:47.585839 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:47.586445 10036 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.588342  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:47.576365 14387 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.003s
I20260709 13:17:47.600986 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:47.607105 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.612967 10187 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:47.607854 14399 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.635228 14492 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:47.635948 14492 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.638199 14492 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:47.635473 14497 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:17:47.639942 14060 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.640045 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 767) took 1048 ms. Trace:
I20260709 13:17:47.640532 10112 rpcz_store.cc:276] 0709 13:17:46.591153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.595061 (+  3908us) service_pool.cc:224] Handling call
0709 13:17:46.595544 (+   483us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:47.063338 (+467794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.063383 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:47.064568 (+  1185us) log.cc:844] Serialized 78 byte log entry
0709 13:17:47.346004 (+281436us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:47.346083 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.346212 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.639808 (+293596us) raft_consensus.cc:1685] finished
0709 13:17:47.639830 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.639983 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152077,"raft.queue_time_us":256013,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":437948,"threads_started":2,"wal-append.queue_time_us":315765}
I20260709 13:17:47.641647 14412 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.642788 14377 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.606191 14387 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.640620 14391 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:47.654799 10036 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:17:47.570099 14096 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.615532 13909 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:47.657954 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45455.6us
I20260709 13:17:47.660313 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.666674 10712 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:47.668805 14503 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:47.669443 14503 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.677307 14096 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:47.689551 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.671293 14474 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.692575 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.687212 14096 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.686038 14406 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:47.696061 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.696185 14503 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:47.688380 14387 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.699361 10189 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:47.707309 14476 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:47.693758 14499 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:17:47.698704 14377 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.721966 14470 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:47.723208 13909 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.726258 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:47.734524 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.730475 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:47.732021 14476 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.735707 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:47.709587 14096 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.741758 13985 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.748507 13985 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.741590 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:47.754550 14485 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
I20260709 13:17:47.752473 14482 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.753454 13985 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.760710 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 768) took 1182 ms. Trace:
I20260709 13:17:47.765623 14482 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.743942 14349 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:47.755721 14377 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:47.762357 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.761844 14441 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.765973 10707 rpcz_store.cc:276] 0709 13:17:46.578312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.578411 (+    99us) service_pool.cc:224] Handling call
0709 13:17:46.578795 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.579159 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.579186 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.597806 (+ 18620us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.924389 (+326583us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:46.924432 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.924500 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.753954 (+829454us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:47.755520 (+  1566us) raft_consensus.cc:1685] finished
0709 13:17:47.755548 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.760639 (+  5091us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2155,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9390,"spinlock_wait_cycles":44171008,"thread_start_us":318378,"threads_started":1,"wal-append.queue_time_us":626425}
I20260709 13:17:47.769838 10189 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:47.769083 14441 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.770664 14396 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:47.767970 14482 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:47.772979 14441 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.759768 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.768370 14377 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.774791 10183 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.761951 14096 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:47.777326 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.777912 14377 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:47.778066 10035 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:47.730611 14470 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:47.781164 14470 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.782851 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:47.783282 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.735653 14476 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.784691 14461 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.785166 14461 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:47.785420 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:47.786921 14461 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.787710 14470 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.788203 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:47.788833 10709 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:47.790242 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:47.787011 14476 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:47.792464 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 381001us
I20260709 13:17:47.796541 14377 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.796990 14377 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:47.797389 14377 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.797134 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:47.799764 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:47.800498 10707 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:47.800889 10707 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:47.801703 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.803043 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.803683 10186 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:47.804008 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:47.804818 10714 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:47.805347 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.805997 10182 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:17:47.804634 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.806272 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.806438 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.795462 10040 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:47.807044 10035 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:47.807933 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:47.800163 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.812698 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.817965 10183 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:17:47.813378 10108 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:47.810521 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.820930 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.824092 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.824759 10032 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:47.825814 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:47.822299 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:47.824882 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:47.828107 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.824275 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:47.831773 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.831915 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:47.832393 10182 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:47.828027 10709 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:47.833329 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.834115 10182 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
W20260709 13:17:47.835516 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.837538 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.801755 10707 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.839178 10707 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.840205 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.837056 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:47.840520 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.840205 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.841706 10189 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:47.842726 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.845566 14407 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:47.846009 14407 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.846359 14407 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.846789 14488 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:47.847014 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:47.847681 10038 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:47.850162 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:47.850214 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.851275 10188 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:47.828915 14492 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.818837 14425 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.843320 10184 raft_consensus.cc:2376] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13. Re-sending same reply.
I20260709 13:17:47.847395 14483 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:47.866771 14483 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.867234 14483 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.830112 14396 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.869451 14396 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.869858 14396 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.847512 14412 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.861500 14476 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:47.862435 14488 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:47.881345 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:47.873600 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:47.874253 14412 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.885788 14489 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.886623 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:47.910954 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:47.886626 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:47.893296 14446 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:47.885740 14406 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.879685 14418 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.878180 14476 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.902911 14377 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:47.906744 14488 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.913554 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:47.919620 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.901239 14424 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:47.925976 14353 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:47.928272 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:47.932947 10707 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:47.936905 10184 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.918715 14412 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.940201 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:47.873040 14425 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.917531 14383 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.917431 14489 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.949427 10078 leader_election.cc:400] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15.
I20260709 13:17:47.950732 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.927842 14418 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:47.958293 10715 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:47.959311 14386 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:47.960403 14353 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:47.935108 14424 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.948113 14346 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:47.938304 14487 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.962827 14476 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:47.970381 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:47.990154 10185 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:47.997648 14506 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 13:17:47.999681 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.999995 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.004279 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.005993 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:47.957144 14498 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:48.011973 14360 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:48.014947 14427 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.150947 14427 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.017113 14501 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:48.017943 14365 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:48.153180 14427 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.018752 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.020371 14470 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:48.154434 14470 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.156589 14470 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.021620 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.158468 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:48.159045 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.159690 10115 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:48.160575 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.161649 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.162165 10115 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.025892 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.165230 10106 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:48.166055 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:48.135891 14198 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:48.169919 14198 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.030128 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.032262 14461 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.129592 14489 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.039179 13985 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:47.926298 14407 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.045368 14341 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:48.048359 14474 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.144392 14453 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.077301 14483 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.201196 14407 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:48.201913 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:48.202102 14483 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.202513 10034 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:48.204382 10036 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:48.212468 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:48.212826 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:48.213390 10032 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.181320 14501 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:48.129580 10078 leader_election.cc:403] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:48.132424 14418 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.147002 10108 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:17:48.147105 10109 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:48.147722 10113 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:48.225641 10112 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:48.198114 14341 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.133857 14386 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.228302 14386 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:48.139330 14505 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:17:48.154143 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 135483us
I20260709 13:17:48.235769 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:48.136699 14060 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:48.236470 14391 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:48.236943 14060 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.239265 14060 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.209159 14487 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:48.239895 14360 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:48.180249 14365 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.139542 14353 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:48.242856 14353 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.244297 14353 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.248189 13985 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.250283 14461 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.257019 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.257639 14341 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.258258 14341 raft_consensus.cc:2764] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:48.163460 14498 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:48.261559 14498 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.204289 14474 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.140777 14424 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:48.243408 14412 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.264284 14474 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.265813 14412 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.209323 14453 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.083544 14396 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.267990 14453 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.268769 10039 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:17:48.269644 14396 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.194213 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:48.268699 14386 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.270476 10715 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:48.271457 14501 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:48.272519 14501 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.274529 14377 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:48.275702 14493 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:48.276491 14487 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.182088 14390 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.278165 14386 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.278776 14487 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.283319 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:48.186806 14198 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.237033 14391 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.284294 10715 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:48.284716 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:48.285339 10039 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:48.285635 14391 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.286363 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:48.084321 10188 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:48.283644 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:48.295498 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:48.262635 14498 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.298458 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:48.299124 10038 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:48.296902 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:48.303810 10034 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:48.300856 10032 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:48.208444 10106 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:48.300791 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:48.339607 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:48.343086 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 406401us
I20260709 13:17:48.344033 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.345917 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.346823 10106 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 7.
I20260709 13:17:48.349377 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.351189 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.351954 10106 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:48.352445 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.336994 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:48.354580 10115 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
W20260709 13:17:48.355068 10111 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.021s	sys 0.044s
W20260709 13:17:48.355893 10111 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.022s	sys 0.044s
W20260709 13:17:48.355278 10713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.033s	sys 0.033s
W20260709 13:17:48.356566 10713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.033s	sys 0.033s
I20260709 13:17:48.357131 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:48.363816 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 429160us
W20260709 13:17:48.299314 14164 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.024s	sys 0.025s
I20260709 13:17:48.340433 10114 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:48.368674 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:48.369961 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.370628 10112 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.373178 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:48.374053 10040 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:48.366376 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.376880 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.382118 10106 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
W20260709 13:17:48.373356 14164 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.024s	sys 0.025s
I20260709 13:17:48.299724 14474 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:48.328680 14391 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:48.386991 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 211430us
I20260709 13:17:48.357650 14487 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:48.356356 14483 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:48.402228 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:48.363953 14060 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.356884 14490 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.364723 14396 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:48.407761 10181 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.409546 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:48.384166 14383 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:48.381026 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:48.411455 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.010s
I20260709 13:17:48.420666 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:48.357929 14377 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:17:48.421423 10188 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:48.425680 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:48.426345 10188 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:48.426962 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60701.4us
I20260709 13:17:48.396646 14391 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.428264 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.441200 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:48.441999 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:48.442453 10707 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:48.447165 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:48.447975 10185 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:48.410897 14360 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:48.407271 14483 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:48.452872 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.454684 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:48.455276 10185 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.461047 10112 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:48.462677 10715 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
W20260709 13:17:48.463932 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54495.9us
W20260709 13:17:48.416059 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.014s	sys 0.010s
W20260709 13:17:48.468885 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 584090us
I20260709 13:17:48.415355 14383 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:48.428710 14387 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.404422 14474 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.475198 10188 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:48.475226 10713 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:48.505944 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:48.508301 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.517290 10712 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:48.451131 14391 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:48.522924 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 142158us
I20260709 13:17:48.523729 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.531316 10712 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:17:48.534385 10185 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:48.451011 14346 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:48.462762 14483 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.422494 14490 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.557574 14490 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:48.562983 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 92305.9us
I20260709 13:17:48.566702 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:48.475966 14492 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:48.568727 10181 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:48.473196 14360 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:48.509465 14383 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.575947 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:48.521577 14488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.017s	sys 0.011s
W20260709 13:17:48.577911 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 241002us
I20260709 13:17:48.564823 14198 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.547019 14096 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:48.574779 14497 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:48.596485 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.631729 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.573909 14387 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:48.635198 10679 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:48.587595 14488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.017s	sys 0.011s
W20260709 13:17:48.637952 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 114298us
I20260709 13:17:48.639106 14390 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:48.639197 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.640185 14482 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.640762 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.642093 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.642884 14482 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:48.644624 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:48.644519 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.643090 14390 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.559645 14346 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.588800 14492 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:48.650498 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:48.593307 14501 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:48.603979 14412 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.657245 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:48.602636 14365 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:48.620127 14096 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:48.665351 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 186747us
I20260709 13:17:48.644838 14503 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.658663 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 94787.8us
W20260709 13:17:48.660812 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 190430us
I20260709 13:17:48.675158 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.653523 14490 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:48.660313 14407 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:48.759791 14520 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:17:48.753600 14477 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:48.760562 14477 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.760941 14477 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:48.737519 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62444.2us
I20260709 13:17:48.757303 14490 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.763068 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.763525 14490 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.766968 14470 raft_consensus.cc:2764] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:48.763979 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:48.769624 14446 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:48.770128 14446 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:48.771020 14446 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.663161 14488 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:48.671700 14096 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:48.753929 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 77697us
I20260709 13:17:48.654052 14427 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:48.673593 14538 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:48.756847 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.653380 14377 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:17:48.782539 10112 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:48.783753 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 126583us
I20260709 13:17:48.785910 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.800494 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:48.731187 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 166747us
I20260709 13:17:48.803376 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:17:48.802357 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 167244us
I20260709 13:17:48.734036 14546 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:48.673847 14365 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.765041 14195 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:48.859843 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52130.4us
W20260709 13:17:48.790184 14353 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.001s
I20260709 13:17:48.682730 14503 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.862613 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.803589 14470 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:48.871176 14544 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:17:48.806720 14528 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:48.876811 14525 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 13:17:48.878628 10712 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:48.879407 14487 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15.
I20260709 13:17:48.665597 14501 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:48.892174 14424 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.001s
I20260709 13:17:48.893529 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:48.894008 14503 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.880663 14546 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:48.897254 14489 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.000s
I20260709 13:17:48.858704 14425 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.809346 14407 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:48.775449 14477 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:48.902966 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97327.8us
I20260709 13:17:48.734791 14360 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.928145 10111 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:48.803959 14492 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.911854 14427 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.907685 14528 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:48.940465 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.947129 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:48.950539 14377 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.950878 14528 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:48.951125 14377 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.951531 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:48.953269 14377 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:48.954782 14501 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:48.924455 14483 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.957494 14483 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:48.894462 14558 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:17:48.962633 14490 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.924439 14474 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:48.928937 14424 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:48.936224 14489 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.970577 10107 raft_consensus.cc:2368] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
I20260709 13:17:48.970117 14528 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:48.971097 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.970293 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:48.972431 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:49.036877 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89840.6us
I20260709 13:17:49.057884 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2041) took 1230 ms. Trace:
I20260709 13:17:49.058756 10183 rpcz_store.cc:276] 0709 13:17:47.827649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.828789 (+  1140us) service_pool.cc:224] Handling call
0709 13:17:47.829358 (+   569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.829676 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.829709 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.871006 (+ 41297us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.329182 (+458176us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:48.329232 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.329309 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.876255 (+546946us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:48.972070 (+ 95815us) raft_consensus.cc:1685] finished
0709 13:17:48.972088 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.057629 (+ 85541us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4542,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":20622,"spinlock_wait_cycles":19567360,"thread_start_us":441325,"threads_started":1,"wal-append.queue_time_us":646377}
W20260709 13:17:49.038570 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 227837us
I20260709 13:17:49.061548 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:49.062969 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.063230 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.064494 14195 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:49.065465 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.065626 14195 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.066769 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.067458 10188 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:49.069000 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.069800 10188 raft_consensus.cc:2368] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12.
I20260709 13:17:49.077243 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.077163 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.078085 10185 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.079142 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:49.080051 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 157127us
I20260709 13:17:49.083619 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.084765 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.091331 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1798) took 1090 ms. Trace:
I20260709 13:17:49.082329 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.095446 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.091692 10107 rpcz_store.cc:276] 0709 13:17:48.000811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.005760 (+  4949us) service_pool.cc:224] Handling call
0709 13:17:49.091127 (+1085367us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b5400362754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:49.091271 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891929856}
I20260709 13:17:49.097311 10180 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:48.970355 14365 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.106166 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:49.102141 10185 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:48.931293 14391 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.104487 14407 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:49.110844 14383 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:17:49.110700 14407 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.111519 14391 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:49.114405 10110 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:49.115962 14546 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.055351 14538 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:49.117563 14528 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:49.118496 14538 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.120321 14490 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.111315 14383 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.123168 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:49.129878 10713 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.056718 14427 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:49.136742 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 333437us
I20260709 13:17:49.126871 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.117429 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:49.130759 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:49.138814 10106 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:49.085493 14498 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.759s	user 0.016s	sys 0.000s
W20260709 13:17:49.149449 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70407.4us
I20260709 13:17:49.150669 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:49.038941 14399 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:49.149781 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 88559.7us
I20260709 13:17:49.080396 14545 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:49.155273 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:49.164786 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.160351 14474 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:49.168653 14474 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.169456 14383 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:49.170656 14527 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:49.170840 14474 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.173135 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:49.174979 10078 leader_election.cc:400] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12.
I20260709 13:17:49.175261 10078 leader_election.cc:403] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:49.178444 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 256661us
I20260709 13:17:49.181062  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.185261 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:49.197933 14477 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:49.087932 14096 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:49.207386 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52188.5us
I20260709 13:17:49.216939 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:49.155131 14387 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:49.229364 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44214us
I20260709 13:17:49.230108 14492 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.231772 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:49.233058 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:49.234622 14556 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.241282 14556 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.241842 14556 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.244295 14556 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.246349 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.247443 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.248169 10184 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.171307 14527 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:49.250177  9922 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f145536c6dbe456fb8565950244bc2a5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:49.201833 14060 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:49.180994 14470 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:49.201030 14391 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.256319 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:49.257090 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.271144 10180 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.255400 10182 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:49.276000 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.218238 14425 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:49.277940 14425 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:49.278402 14425 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:49.269747 14553 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:49.284360 14553 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.288136 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:49.288237 14553 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:49.289312 14391 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12.
I20260709 13:17:49.290182 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:49.283624 10184 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:17:49.306924 14489 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.227907 14424 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:49.228158 14545 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:49.360478 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:49.367471 10709 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.357847 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:49.197485 14399 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:49.368019 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 189877us
W20260709 13:17:49.366096 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 90746.1us
W20260709 13:17:49.375823 10081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.024s
W20260709 13:17:49.376250 10081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.024s
I20260709 13:17:49.302485 10180 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:49.381438 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:49.376564 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 507259us
I20260709 13:17:49.384203 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:49.394646 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:49.395460 10710 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:49.416690 14540 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:17:49.425536 13909 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:49.426113 13909 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:49.428951 14096 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.431896 14399 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.433492 14545 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.450763 10713 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:49.451915 10709 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
W20260709 13:17:49.376006 14418 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.140s	user 0.012s	sys 0.005s
I20260709 13:17:49.455423 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:49.427024 13909 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.377275 14553 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:49.534694 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 78227.6us
I20260709 13:17:49.400446 14470 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:49.398097 14570 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.562014 10713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:49.562676 10713 raft_consensus.cc:606] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:49.563041 10713 raft_consensus.cc:614] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:49.566313 10183 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:49.535786 14387 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.398228 14425 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.560343 14572 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.590533 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:49.645848 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54332.2us
I20260709 13:17:49.536574 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:49.649000 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 183912us
I20260709 13:17:49.653394 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:49.458122 14418 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.545843 14564 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.657790 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:49.658046 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:49.659392 10032 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:49.567790 14470 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:49.660465 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:49.661940 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:49.578310 14387 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.574189 14563 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:49.691696 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:49.688100 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:49.655313 14474 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:49.720220 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1819) took 1372 ms. Trace:
I20260709 13:17:49.650494 14566 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.722002 10110 rpcz_store.cc:276] 0709 13:17:48.347939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.349102 (+  1163us) service_pool.cc:224] Handling call
0709 13:17:49.716502 (+1367400us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54002b8c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:49.720154 (+  3652us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757481728}
I20260709 13:17:49.564170 14570 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.676698 14482 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:49.690172 14387 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.654942 14492 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:49.701737 14427 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.699420 14568 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.729063 14060 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.734305 14483 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.644526 14572 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.755950 14482 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:49.713675 14470 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.752641 14474 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:49.781499 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:49.769793 14353 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.786020 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 61693.3us
I20260709 13:17:49.806962 10187 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:49.783854 14305 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.713308 14563 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.773789 14568 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.787832 14483 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:49.868286 14573 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:17:49.877471 14482 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:49.813781 14574 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.004s
I20260709 13:17:49.872237 14474 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.740319 14566 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.781293 14060 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:49.880734 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 65690.2us
I20260709 13:17:49.771142 14427 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.882400 14549 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.812284 14353 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:49.953253 10031 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:49.886607 14383 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:49.889250 14305 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:49.971103 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 226846us
W20260709 13:17:49.981797 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 200382us
I20260709 13:17:49.983703 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:49.972893 14418 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.003546 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:49.969507 14425 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:49.970412 14383 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:49.968562 14549 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.046537 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:50.048888 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:50.050699 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.052122 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.052693 10112 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:50.054179 10112 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:50.055414 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:50.056763 10115 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:50.058053 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.059275 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.032717 14588 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.033672 14547 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.041863 14550 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:50.071720 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:50.075126 14490 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:50.038856 14560 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.188s
W20260709 13:17:50.074572 14589 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:17:50.085364 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 89709.1us
I20260709 13:17:50.067874 14598 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:50.095130 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:50.140533 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45479.6us
W20260709 13:17:50.076098 14571 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 13:17:50.141957 14492 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.139084 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:50.147106 14609 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:50.076282 14593 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.144397 14492 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.153083 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:50.148067 14609 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:50.186476 10004 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.966s (SENT) [suppressed 26 similar messages]
I20260709 13:17:50.149267 10115 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:50.089870 14594 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.184792 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.089191 14490 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:50.138065 14483 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.072834 14588 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:50.075196 14561 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 13:17:50.075958 14576 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:17:50.193186 14569 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:17:50.148357 14418 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.137862 14602 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.146626 14353 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:50.080615 14582 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:17:50.070961 14565 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.144409 14568 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.075281 14604 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:50.075372 14595 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.195340 14593 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.075510 14581 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.076056 14586 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.207873 14563 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.159368 14060 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.071568 14572 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:50.209070 14584 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:17:50.190683 14305 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.138988 14562 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:17:50.183496 14598 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:50.213119 14595 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.195892 14490 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.223255 14588 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.206368 14566 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:50.212524 14599 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:17:50.214430 14383 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.262934 14595 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.265267 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.225008 14549 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.219007 14607 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:50.075065 14547 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:50.281900 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 265696us
I20260709 13:17:50.217010 14609 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.284240 14607 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:50.284809 14609 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.285446 14607 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.286195 14547 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.200915 14594 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.287057 14609 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.288383 14594 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.294595 14383 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:50.295181 14383 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.214495 14586 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.225059 14598 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.213749 14581 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.075075 14550 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.300226 10187 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:50.300727 10182 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:50.216593 14565 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.303149 14586 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.308874 14365 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.315703 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.316465 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.306538 10183 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:50.205461 14418 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.207451 14602 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:50.281199 14582 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:50.314570 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.319926 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.322857 10183 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:50.304427 14492 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.308223 14562 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.308632 14547 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.314659 14566 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.351310 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.344314 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.309063 14572 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.309556 14609 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.353786 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.315724 14365 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.355930 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.359031 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.359669 10039 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:50.347121 14406 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.363853 14563 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.370003 14565 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.356972 14609 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.373973 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.375322 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.378551 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.379289 10032 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:50.359637 14492 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.348255 14593 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.355648 14566 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.386361 14550 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.405330 14581 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.406713 14365 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.407349 14365 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.388942 14407 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.408291 14407 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.374907 14406 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.410490 14407 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.410616 14406 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.412616 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.413249 10181 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:50.414126 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:50.414692 10034 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.353588 14547 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.402415 14492 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.416158 14609 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.416508 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:50.377327 14563 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.417948 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:50.418120 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 231666us
I20260709 13:17:50.448086 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:50.351714 14562 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.450240 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:50.458848 10032 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:50.455193 10034 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:17:50.386778 14418 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.456290 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.466859 14618 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:50.358055 14572 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.468223 10036 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:50.474845 14614 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.385246 14613 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.476425 10109 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:50.478649 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:50.482093 10032 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:50.493067 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:50.481289 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150933us
I20260709 13:17:50.499547 10183 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:50.420050 14365 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.503826 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.477855 14474 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.481732 14618 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:50.519934 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 167158us
I20260709 13:17:50.532793 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.499302 14602 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.537014 10032 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:50.540098 14562 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.540745 14562 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.541198 14562 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.543323 14562 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.530550 14618 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.489904 14614 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:50.558547 14387 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.803s	user 0.008s	sys 0.004s
I20260709 13:17:50.529902 14474 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.569155 14490 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.572341 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.550980 14562 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.610108 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.610848 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:50.611027 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:50.605485 14547 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.620630 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.621394 10108 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:50.622802 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:50.624127 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.625386 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.625509 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.627007 10110 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:50.628607 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.492427 14613 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.641279 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.642117 10107 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:50.577737 14387 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.595366 14570 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.644670 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.648866 14572 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.649581 14572 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.650092 14572 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.652396 14631 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.628925 14563 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.597998 14562 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.657737 10108 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:50.635098 14598 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:50.667465 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.644598 14624 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:50.653923 14365 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.661967 14570 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:50.683988 14621 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:17:50.693280 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.653038 14631 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.683230 14570 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.702447 14614 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.674431 14613 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.676453 14598 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.703164 14547 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.705560 14570 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.719123 10039 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:50.718006 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.718633 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.708921 14490 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.734345 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.678753 14624 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.702962 14631 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.737865 14566 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.748200 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:50.734038 14632 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.738119 14474 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.721737 14547 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.753993 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.765443 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:50.765333 10112 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:50.766059 10709 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.767385 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:50.768492 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 145776us
I20260709 13:17:50.777642 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:50.771441 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 305376us
I20260709 13:17:50.779038 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:50.797405 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:50.795841 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:50.796568 14365 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:50.800819 10038 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:50.801419 14547 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.756347 14632 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.776628 14474 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:50.764213 14387 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.775816 14562 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:50.780572 14629 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:17:50.808703 14390 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:50.804692 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:50.796677 14622 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:17:50.824066 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:50.817468 10709 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:50.804884 14547 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.803468 14555 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:50.828102 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:50.830168 14555 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.830608 14555 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.781328 14566 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:50.811623 14406 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.833175 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2870) took 1864 ms. Trace:
I20260709 13:17:50.836072 14387 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:50.836567 14624 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.818957 14631 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.836897 14635 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:50.839337 14633 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:17:50.839978 14612 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:50.831269 14547 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:50.840554 10714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 795) took 1402 ms. Trace:
I20260709 13:17:50.866793 10714 rpcz_store.cc:276] 0709 13:17:49.437847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.438009 (+   162us) service_pool.cc:224] Handling call
0709 13:17:49.438280 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.567761 (+129481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.567796 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.567842 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:49.567871 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.840310 (+1272439us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54006103d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:50.840358 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.840498 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297234176}
I20260709 13:17:50.841117 14598 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.837708 10114 rpcz_store.cc:276] 0709 13:17:48.968695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.971687 (+  2992us) service_pool.cc:224] Handling call
0709 13:17:48.972011 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.155907 (+183896us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:49.155942 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.156465 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.684452 (+1527987us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b180024bce0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:17:50.808316 (+123864us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:50.808352 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.808432 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.827787 (+ 19355us) raft_consensus.cc:1685] finished
0709 13:17:50.827807 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.833113 (+  5306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130055,"raft.queue_time_us":117764,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":40866,"spinlock_wait_cycles":9886080,"thread_start_us":123676,"threads_started":1,"wal-append.queue_time_us":1665619}
I20260709 13:17:50.806949 14618 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.855325 14498 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:50.881265 14618 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.882354 14632 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.856969 14387 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:50.831334 14627 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:50.891124 14627 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.893004 14476 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.893553 14476 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.863363 14626 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:17:50.878890 14529 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.566s	user 0.005s	sys 0.000s
I20260709 13:17:50.887344 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:50.887590 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:50.888970 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.909029 10709 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:50.889519 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.900226 14476 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.900602 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.910555 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:50.911226 10708 raft_consensus.cc:2393] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:50.899847 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.895329 14406 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.905982 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.905838 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.911947 10716 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:50.915024 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.885878 14598 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:50.918474 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:50.916056 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.916774 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.917809 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:50.919660 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:50.920447 10708 raft_consensus.cc:606] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:50.920782 10708 raft_consensus.cc:614] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:50.918854 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.921340 10716 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:50.921624 10709 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:50.923772 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:50.911247 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 132276us
I20260709 13:17:50.924405 10707 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:50.918292 14406 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.927211 14476 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.927305 14387 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.928581 14406 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:50.931059 10711 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:50.932826 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.933775 10034 raft_consensus.cc:2410] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:50.939127 14406 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.939977 14406 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:50.942878 14406 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.942919 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 874) took 1785 ms. Trace:
I20260709 13:17:50.943819 10185 rpcz_store.cc:276] 0709 13:17:49.158008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.161492 (+  3484us) service_pool.cc:224] Handling call
0709 13:17:49.161818 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.430022 (+268204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.430052 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.430093 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:49.430133 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.942694 (+1512561us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002acbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:50.942741 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.942863 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616273664}
I20260709 13:17:50.947449 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:50.948123 10039 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:17:50.952863 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:50.947052 14572 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:50.969719 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:50.969218 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:50.959532 14412 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.935885 14631 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.974018 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49261.5us
I20260709 13:17:50.975124 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:50.971568 14412 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.985905 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:50.980685 14572 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.983558 14412 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:50.992703 14627 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:50.992045 14488 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:51.017477 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 164208us
I20260709 13:17:50.979930 14631 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.024989 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.016721 14626 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.021318 14412 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.037708 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.025307 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:51.026340 14638 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:17:51.000340 14570 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.027896 14547 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.052611 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.026278 14492 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.025214 14488 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:51.069599 14580 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.334s	user 0.003s	sys 0.017s
I20260709 13:17:51.070813 14488 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.039592 14641 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:51.021605 14572 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.073589 14612 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.074421 14572 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.075002 14572 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:51.070814 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 796) took 1262 ms. Trace:
I20260709 13:17:51.077052 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.059309 14570 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:51.060910 14592 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.946s	user 0.002s	sys 0.000s
W20260709 13:17:51.085011 14578 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.374s	user 0.002s	sys 0.002s
I20260709 13:17:51.064781 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:51.086849 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:51.087612 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.088338 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.088366 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1674) took 2003 ms. Trace:
I20260709 13:17:51.037983 14640 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.088037 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.089351 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.071512 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 884) took 2118 ms. Trace:
I20260709 13:17:51.077994 10713 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.076944 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.079728 14602 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:51.079927 10716 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:51.077294 10710 rpcz_store.cc:276] 0709 13:17:49.808224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.808533 (+   309us) service_pool.cc:224] Handling call
0709 13:17:49.808862 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.939157 (+130295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.939192 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.939236 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:49.939267 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.070578 (+1131311us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54004362d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:51.070623 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.070751 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299091840}
I20260709 13:17:51.081475 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.087998 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:51.093144 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.092756 10184 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.082396 14555 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.088909 10186 rpcz_store.cc:276] 0709 13:17:49.085352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.085459 (+   107us) service_pool.cc:224] Handling call
0709 13:17:49.085792 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.086128 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.086158 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.561340 (+475182us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b2c000bbb28. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:17:49.572406 (+ 11066us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.734747 (+162341us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:49.756260 (+ 21513us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.769442 (+ 13182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.769523 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.930256 (+1160733us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:51.083653 (+153397us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4800240258. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:17:51.088145 (+  4492us) raft_consensus.cc:1685] finished
0709 13:17:51.088168 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.088307 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12916,"prepare.queue_time_us":21494,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":49792,"raft.run_cpu_time_us":3505,"raft.run_wall_time_us":1959254,"spinlock_wait_cycles":60110208,"thread_start_us":161863,"threads_started":1,"wal-append.queue_time_us":322493}
I20260709 13:17:51.092249 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.092724 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.090160 10712 rpcz_store.cc:276] 0709 13:17:48.953280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.953495 (+   215us) service_pool.cc:224] Handling call
0709 13:17:48.953824 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.124268 (+170444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.124301 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.136373 (+ 12072us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.357025 (+220652us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:49.358002 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.358076 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.559820 (+201744us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4800120558. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:17:51.068981 (+1509161us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:51.071257 (+  2276us) raft_consensus.cc:1685] finished
0709 13:17:51.071281 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.071411 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":230874,"raft.queue_time_us":182928,"raft.run_cpu_time_us":2584,"raft.run_wall_time_us":411116,"spinlock_wait_cycles":18437632,"thread_start_us":220325,"threads_started":1,"wal-append.queue_time_us":526892}
I20260709 13:17:51.093014 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.101302 10111 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:51.102003 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.104730 10186 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
W20260709 13:17:51.106437 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78875.2us
I20260709 13:17:51.107429 10184 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:51.109170 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.049018 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:51.114739 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 65817us
I20260709 13:17:51.116478 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:51.101969 14503 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:51.105681 14627 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.125031 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.103693 14501 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:51.122608 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:51.125756 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.130182 10716 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:51.120980 14607 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:51.121136 14406 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.118882 14548 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.131003 10184 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.133025 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.141194 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.133812 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.133859 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.134770 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.075515 14572 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.139832 10034 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:51.148648 10036 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.106041 14602 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.145252 14535 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.149206 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.150247 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.155138 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.142686 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.151280 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.150581 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.152601 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.157258 10186 raft_consensus.cc:2410] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:51.123129 14503 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.161581 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.162029 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.129884 14501 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.124001 14627 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.169656 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.160033 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.170186 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:51.180047 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.180274 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.180814 10115 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:51.182807 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.183836 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.164166 14503 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.190752 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.163208 14631 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.191411 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.177616 14627 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.192768 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.195623 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.169704 14501 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.164486 14535 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.198015 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.198767 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.203934 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.148756 14406 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.247406 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.177870 14399 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.251513 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.251659 10184 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:51.253865 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.157342 14548 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.258378 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:51.260118 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 56246.6us
I20260709 13:17:51.260434 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.262874 10036 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.263422 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.270179 10111 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:51.252199 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 132428us
I20260709 13:17:51.274031 10110 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.246932 14538 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.274895 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:51.250335 14535 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.275528 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.281028 10034 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:51.216434 14558 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:17:51.279094 14532 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.282718 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.281337 10106 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:51.283355 10110 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.276654 14164 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:51.284672 14652 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:51.285033 14652 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:51.263900 14570 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.268702 14631 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.267920 14634 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.280433 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.256742 14624 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:17:51.296116 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:51.296200 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:51.301442 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.301990 14548 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.264430 14399 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.305536 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.310402 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.285597 14558 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:17:51.309306 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.303844 14164 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.321061 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:51.324262 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:51.328904 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.330440 14631 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.307157 14555 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.331030 14631 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.320564 14164 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:51.332741 14164 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.333317 14631 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.303803 14564 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.334884 14564 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.335261 14564 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.294592 14570 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:51.336211 14653 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:17:51.337755 14570 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.318678 14412 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.340902 10707 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:51.341583 14412 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.345604 14602 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.346406 14572 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.347222 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:51.318702 14600 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.348770 10111 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:51.349536 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.352964 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.355840 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:51.330750 14656 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:17:51.388010 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 57859.4us
I20260709 13:17:51.360677 14631 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.283133 14538 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.303066 14563 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:17:51.329399 14590 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.421288 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.347447 14527 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.424432 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.425838 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.475243 10182 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:51.476305 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.477545 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.478693 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.426668 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.413841 14425 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:51.351269 14461 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.492730 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:51.363104 14555 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.376313 14600 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.353857 14657 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.505857 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:51.511408 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 190435us
I20260709 13:17:51.490237 14489 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.516477 10182 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:51.513722 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.515061 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.518616 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.519270 10187 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:51.497174 14461 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:51.528559 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.529364 10038 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:17:51.523782 14461 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.544111 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:51.498363 14572 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.512439 14600 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.555567 14501 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.555509 14461 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.562332 14503 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.481670 14631 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.528028 14657 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.523823 14489 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.576130 14383 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.593837 14406 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.596709 14482 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:51.590839 14662 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:51.575455 14572 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.625031 14399 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:51.650100 10109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 793) took 1301 ms (client timeout 1647 ms). Trace:
W20260709 13:17:51.665251 10109 rpcz_store.cc:269] 0709 13:17:50.348901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.349084 (+   183us) service_pool.cc:224] Handling call
0709 13:17:51.649861 (+1300777us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002b8254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:51.650024 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266406272}
I20260709 13:17:51.628547 14488 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.626642 14470 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.643832 14482 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:51.663390 14591 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.631s	user 0.000s	sys 0.011s
I20260709 13:17:51.672739 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2887) took 1081 ms. Trace:
I20260709 13:17:51.675305 10107 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:51.678192 10108 rpcz_store.cc:276] 0709 13:17:50.591727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.633352 (+ 41625us) service_pool.cc:224] Handling call
0709 13:17:51.672515 (+1039163us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540010ead4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:51.672668 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24081280}
W20260709 13:17:51.675166 10183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 887) took 1326 ms (client timeout 1647 ms). Trace:
W20260709 13:17:51.683357 10183 rpcz_store.cc:269] 0709 13:17:50.348378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.350414 (+  2036us) service_pool.cc:224] Handling call
0709 13:17:51.674949 (+1324535us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400096854. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:51.675088 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339344768}
I20260709 13:17:51.655165 14662 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:51.697088 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.698079 10183 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:51.705902 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.679322 14482 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.717568 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.719691 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:17:51.724601 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 231946us
I20260709 13:17:51.685137 14488 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.728523 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.692543 14470 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.729096 10187 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:17:51.722546 14461 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.743460 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.747807 14427 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.751597 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.751991 14631 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.752575 14631 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:51.753072 14631 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.755134 14631 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.756932 14528 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:51.757321 14528 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.757697 14528 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.759895 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.762503 14635 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:51.763164 14635 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:51.764277 14572 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.740796 14501 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.765548 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.766358 10189 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:51.784360 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:51.768988 14627 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:17:51.772478 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.778358 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.733901 14503 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.780548 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.784997 10189 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:51.785107 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.788727 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.788764 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.792325 14501 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:51.792783 14501 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.793141 14501 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.800084 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.800987 14503 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.801406 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.801731 14503 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:51.802553 14635 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.803996 14664 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.776492 14600 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.807536 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.807452 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.813587 10113 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:51.814651 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.815515 14488 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.785326 14341 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:51.820894 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:51.820472 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.815683 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.823661 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.824206 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.824872 10111 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:51.825696 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.819628 14341 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:51.826872 14341 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:51.831439 14503 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.786739 14489 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.836748 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.839347 14624 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.841567 10035 raft_consensus.cc:2368] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:17:51.819911 14565 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.818652 14572 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.819133 14538 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.851308 14572 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.854408 14572 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.854971 14424 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:51.855573 14424 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.833408 14664 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.860647 14600 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.838055 14635 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.777987 14662 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:51.863627 10031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2656) took 2207 ms (client timeout 1817 ms). Trace:
W20260709 13:17:51.864125 10031 rpcz_store.cc:269] 0709 13:17:49.656767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.656926 (+   159us) service_pool.cc:224] Handling call
0709 13:17:51.863356 (+2206430us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400165b54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:51.863505 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651459456}
I20260709 13:17:51.865554 10032 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:51.808082 14627 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.842931 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:51.873601 10113 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.845023 10713 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.835942 14631 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:51.877491 14631 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.877933 14631 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:51.879464 14661 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 13:17:51.844568 14399 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:17:51.847160 14503 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:17:51.834805 14341 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.880311 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:51.881001 10713 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.881150 14341 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.848893 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:51.841742 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.784559 14164 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.884059 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:51.884423 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2103) took 1050 ms. Trace:
I20260709 13:17:51.885190 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.886137 14572 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:51.886466 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.886629 14572 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:51.887532 14572 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.888965 14470 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.884819 10180 rpcz_store.cc:276] 0709 13:17:50.834138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.834307 (+   169us) service_pool.cc:224] Handling call
0709 13:17:51.675831 (+841524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.676024 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.676051 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.676092 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:51.676131 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.676185 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.884232 (+208047us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400096850. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:51.884357 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934604032}
I20260709 13:17:51.891178 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.892330 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:51.892598 10180 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:51.854619 14535 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
I20260709 13:17:51.898699 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.900520 10180 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 7.
I20260709 13:17:51.901840 14538 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:51.902048 14399 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.920076 14399 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.920514 14399 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.921258 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:51.901641 14503 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.903070 14528 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.905262 14664 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.889811 14624 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.908107 14535 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.910653 14470 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.913620 14607 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:51.913686 14564 consensus_meta.cc:287] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.578s	user 0.000s	sys 0.010s
I20260709 13:17:51.944797 14564 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.914533 10713 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:51.946836 14627 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.947227 10185 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:51.885300 14164 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:51.937352 14501 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.924101 10113 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:17:51.907835 14424 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:51.930423 14652 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:51.935020 10709 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:51.940128 10181 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:51.921258 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:51.925365 14559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.911s	user 0.027s	sys 0.007s
I20260709 13:17:51.921988 10188 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:51.951210 10187 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:51.940199 14572 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.898550 14482 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.952790 10707 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:51.956651 10039 raft_consensus.cc:2368] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:17:51.922312 14538 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:51.924606 14503 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.959908 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.946859 14564 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:51.958163 10112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 2876) took 1903 ms (client timeout 1653 ms). Trace:
W20260709 13:17:51.993053 10112 rpcz_store.cc:269] 0709 13:17:50.055113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.055211 (+    98us) service_pool.cc:224] Handling call
0709 13:17:51.957934 (+1902723us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540010dbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:51.958079 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488710912}
I20260709 13:17:51.994439 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:51.995215 10112 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 7.
I20260709 13:17:51.962637 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:51.964648 10114 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:51.951557 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:51.963629 14559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.956s	user 0.028s	sys 0.007s
I20260709 13:17:52.052848 14559 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:52.053280 14559 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:52.054183 14559 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:52.052035 14638 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:51.955914 14501 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.952751 14631 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.973337 14538 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.083083 14631 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:51.973157 14503 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.027370 14572 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.962447 14624 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:52.090135 14624 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:52.090544 14624 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.952355 14607 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:51.950265 14470 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:52.090898 14572 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:52.098060 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:52.099395 13985 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:52.113886 10188 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.114301 13985 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.096850 14482 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:52.116479 14640 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:52.101668 14535 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.103022 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:52.118837 10715 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.069208 14652 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.139778 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.099011 14424 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:52.142007 14424 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.119984 14607 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:52.096124 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:52.144361 14470 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:52.165639 10188 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:52.128523 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:52.138813 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.102582 14528 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:52.117061 14640 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.145112 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:52.145355 14559 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.128563 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:52.176079 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:52.177480 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:52.150970 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:52.151584 13985 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:52.151899 10184 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:52.184523 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.157541 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.160351 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:52.160328 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.161974 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:52.187824 10037 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.162690 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:52.160214 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:52.190537 10715 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:52.190959 10180 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:17:52.163430 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:52.164129 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.169755 10040 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:17:52.149659 14424 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.178943 10112 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.180613 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:52.200103 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:52.199980 10153 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:52.193259 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:52.194712 10033 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:52.202411 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.204509 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.206590 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.207533 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.208222 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.209233 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:52.202312 10033 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:52.210031 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.216089 10106 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:52.217535 10106 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:52.176169 10081 connection.cc:256] RPC call timeout handler was delayed by -1.3400523609998345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:17:52.219686 10081 connection.cc:256] RPC call timeout handler was delayed by -1.267152360999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 13:17:52.223030 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.224160 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.228366 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:52.230098 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:52.210804 10033 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.260246 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.171259 14564 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:52.260955 14602 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:52.268024 14564 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.267519 14412 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.270185 14564 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.229664 14565 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:52.230487 14609 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.276021 10713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:52.276723 10713 raft_consensus.cc:606] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:52.277069 10713 raft_consensus.cc:614] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:52.286727 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:52.264243 10106 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:52.288652 10108 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:52.257426 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47967.3us
I20260709 13:17:52.263610 10033 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.265316 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.241793 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:52.218048 14096 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.406579 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2675) took 1157 ms. Trace:
W20260709 13:17:52.416913 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 151683us
I20260709 13:17:52.418844 10112 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:52.409030 10035 rpcz_store.cc:276] 0709 13:17:51.138180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.142459 (+  4279us) service_pool.cc:224] Handling call
0709 13:17:52.294992 (+1152533us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540031b0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.295136 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576050560}
I20260709 13:17:52.267627 14470 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:52.424420 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.424491 10109 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.426977 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:52.261689 14424 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.439357 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1841) took 1348 ms. Trace:
I20260709 13:17:52.439845 10107 rpcz_store.cc:276] 0709 13:17:51.090952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.091083 (+   131us) service_pool.cc:224] Handling call
0709 13:17:51.674960 (+583877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.680137 (+  5177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.439105 (+758968us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540010ead0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.439275 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301768064}
I20260709 13:17:52.443347 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:17:52.444660 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 140996us
I20260709 13:17:52.448350 14662 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.448976 14662 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.221793 14501 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:52.204792 14627 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:52.460453 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 218743us
I20260709 13:17:52.267618 14657 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
I20260709 13:17:52.519282 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:52.519718 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 216644us
I20260709 13:17:52.526885 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.217824 14671 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.425959 14412 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.531185 10182 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.531092 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1699) took 1102 ms. Trace:
I20260709 13:17:52.539108 10187 rpcz_store.cc:276] 0709 13:17:51.428364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.731848 (+303484us) service_pool.cc:224] Handling call
0709 13:17:52.530849 (+799001us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540019b9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.531025 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376277760}
I20260709 13:17:52.553371 10714 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:52.556463 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:52.477402 14548 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:52.483604 14662 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:52.517323 14341 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.463194 14501 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:52.503773 14470 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:52.516462 14528 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:52.572266 14399 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 13:17:52.537503 14492 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:52.610595 14492 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.539291 14635 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.613867 14164 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:52.614431 14164 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:52.587239 14640 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.589233 14501 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:52.591809 14624 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:17:52.583619 14548 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:52.523128 14577 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:52.614526 14503 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.001s
I20260709 13:17:52.614825 14528 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.619582 14624 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.623399 14503 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:52.672242 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.674470 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:52.677739 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 158383us
W20260709 13:17:52.682305 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 238951us
I20260709 13:17:52.684226 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:52.693025 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.570657 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.696612 10189 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:52.698840 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:52.701637 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:52.702641 10187 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.705411 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:52.626972 14548 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.762717 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2056) took 2211 ms. Trace:
I20260709 13:17:52.766449 14482 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:52.766855 10032 rpcz_store.cc:276] 0709 13:17:50.551678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.551860 (+   182us) service_pool.cc:224] Handling call
0709 13:17:51.865174 (+1313314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.865980 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.755716 (+889736us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400165b50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.762442 (+  6726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019421952}
I20260709 13:17:52.767508 14482 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.769414 14543 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:52.771042 14489 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:52.749305 14538 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
W20260709 13:17:52.772620 10037 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.572s	user 0.018s	sys 0.001s
I20260709 13:17:52.766495 14490 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:52.773399 14624 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.628378 14470 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.774545 14652 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:52.774878 14490 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.775607 14652 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.776070 14577 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:52.778882 14652 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:52.779134 14360 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:52.779441 14396 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:52.778637 14490 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:52.780457 14396 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.782385 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2888) took 1620 ms. Trace:
I20260709 13:17:52.618621 14164 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.762733 14598 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.765739 10187 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:52.772467 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1850) took 1415 ms. Trace:
I20260709 13:17:52.790731 10188 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:52.789619 14575 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:52.773149 10037 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:17:52.791952 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86877.4us
I20260709 13:17:52.788919 10114 rpcz_store.cc:276] 0709 13:17:51.161375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.161503 (+   128us) service_pool.cc:224] Handling call
0709 13:17:51.964191 (+802688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.996266 (+ 32075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.781949 (+785683us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540010dbd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.782189 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764018176}
I20260709 13:17:52.789475 14418 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.794858 10110 rpcz_store.cc:276] 0709 13:17:51.356673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.356844 (+   171us) service_pool.cc:224] Handling call
0709 13:17:51.755845 (+399001us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:51.805162 (+ 49317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.805193 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:51.805793 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 13:17:51.926586 (+120793us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:51.926634 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.926709 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.936901 (+ 10192us) raft_consensus.cc:1685] finished
0709 13:17:51.936923 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.771884 (+834961us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540026cad0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.772213 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48923,"raft.queue_time_us":50156,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":916703488,"thread_start_us":120405,"threads_started":1,"wal-append.queue_time_us":120822}
I20260709 13:17:52.772908 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:52.793691 14528 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:52.820502 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.615144 14399 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.806231 14482 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.772549 14538 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.808243 14396 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.809113 14575 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.819139 14360 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:17:52.842322 10106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.014s	sys 0.023s
W20260709 13:17:52.842741 10106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.015s	sys 0.023s
I20260709 13:17:52.843811 10180 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:52.839013 14610 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.845105 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.845963 10187 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:52.839893 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:52.829268 14598 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.851167 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.852913 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1685) took 1429 ms. Trace:
I20260709 13:17:52.854105 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1690) took 1428 ms. Trace:
I20260709 13:17:52.858156 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.860569 10184 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:52.863689 10038 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:52.865515 14390 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:52.866477 14390 consensus_queue.cc:1243] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:52.867048 14482 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:52.867573 14482 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:52.869104 14482 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.871065 14482 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:52.872221 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44594.5us
I20260709 13:17:52.873239 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:52.876216 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 131930us
I20260709 13:17:52.877614 14474 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:52.878135 14474 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:52.851080 14503 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:52.862617 10185 rpcz_store.cc:276] 0709 13:17:51.423043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.424051 (+  1008us) service_pool.cc:224] Handling call
0709 13:17:51.506448 (+ 82397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:51.947641 (+441193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.852307 (+904666us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002da0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:52.852676 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013091200}
I20260709 13:17:52.889420 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.892942 14490 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.893989 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:52.894657 14399 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:52.862689 10181 rpcz_store.cc:276] 0709 13:17:51.425751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.426426 (+   675us) service_pool.cc:224] Handling call
0709 13:17:52.853703 (+1427277us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54002d82d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.853941 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053853056}
I20260709 13:17:52.897300 10181 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:52.902709 10039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2664) took 1770 ms (client timeout 2241 ms). Trace:
W20260709 13:17:52.903178 10039 rpcz_store.cc:269] 0709 13:17:51.132133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.132258 (+   125us) service_pool.cc:224] Handling call
0709 13:17:52.902292 (+1770034us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54001572d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:52.902501 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872250112}
I20260709 13:17:52.906961 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 696) took 1057 ms. Trace:
I20260709 13:17:52.907521 10709 rpcz_store.cc:276] 0709 13:17:51.849216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.849504 (+   288us) service_pool.cc:224] Handling call
0709 13:17:51.849820 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.958834 (+109014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.885670 (+926836us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b54005ce9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:52.906775 (+ 21105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195485568}
W20260709 13:17:52.909768 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89515.7us
I20260709 13:17:52.914762 14550 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:52.915452 14550 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:52.879431 14474 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:52.908856 14360 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:52.927699 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:52.919974 14528 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:52.950603 10189 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:52.950939 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 325857us
W20260709 13:17:52.956557 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44627.1us
I20260709 13:17:52.963243 14503 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:52.970276 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:52.974225 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:52.982584 10185 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:52.985872 10711 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.986734 10713 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:52.988797 10714 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:52.991852 14528 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:52.992630 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.994503 14528 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:52.994679 14550 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.996820 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:52.997740 10181 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:52.998651 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.003129 14492 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:52.976733 14503 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:53.004070 14575 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.004675 14575 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:53.005316 14575 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.006204 14501 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:52.979800 14474 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.012933 10186 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:53.014763 10186 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:53.004798 10183 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.016327 14538 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.003903 14503 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:53.022570 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 84732.4us
I20260709 13:17:52.985875 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.014981 10110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:17:53.026592 14436 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:53.027134 14436 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:53.027530 14436 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.030004 10114 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:17:53.032121 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.034430 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.034736 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.035231 10713 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:53.046041 14545 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:53.046370 14446 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:53.046697 13922 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:53.048266 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.048425 14446 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:53.048868 14545 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:53.050371 14652 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:53.050843 14652 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:53.051569 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2916) took 1086 ms. Trace:
I20260709 13:17:53.052615 13922 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:53.052012 14652 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.052615 14615 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:53.053881 14652 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.056274 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.051999 10106 rpcz_store.cc:276] 0709 13:17:51.965511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.293763 (+328252us) service_pool.cc:224] Handling call
0709 13:17:52.294091 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.294330 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.294357 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.294832 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.922892 (+628060us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:53.051011 (+128119us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54000f5b20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f463733 00007f3c6f4e8dbf 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c
0709 13:17:53.051074 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.051187 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.051229 (+    42us) raft_consensus.cc:1685] finished
0709 13:17:53.051242 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.051510 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94244608,"thread_start_us":553345,"threads_started":1,"wal-append.queue_time_us":550475}
I20260709 13:17:53.061106 14446 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.061494 14446 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.062477 14446 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.035398 10110 raft_consensus.cc:606] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.064106 10110 raft_consensus.cc:614] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:53.066766 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 188535us
I20260709 13:17:53.069837 10186 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:53.053017 13922 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.099260 13922 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.025736 14575 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.100153 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.049381 14424 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:53.101377 14424 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:53.101742 14424 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.102702 14424 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.080695 14164 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:53.083448 14675 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.656s	user 0.001s	sys 0.003s
I20260709 13:17:53.084802 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.108320 10187 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:53.088521  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 8 to 13, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 13 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.052066 14498 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:53.109493 14498 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.110499 13922 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.092339 14534 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:53.111840 14534 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.112201 14534 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.113107 14534 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.114372 14534 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.114225 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:53.093004 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45336.9us
I20260709 13:17:53.110617 14498 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.118220 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.118916 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.119128 14498 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.119781 14528 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:53.120394 14528 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.122517 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:53.125732 14341 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:53.127013 14341 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:53.127434 14341 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.127863 14446 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.128794 14567 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:53.130378 14453 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:53.130821 14453 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.131510 10185 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:53.131975 14453 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.128809 14341 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.134629 14341 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.140270 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.141088 10114 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:53.144196 14411 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:53.144820 14411 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.144922 14617 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:53.145891 14411 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.146482 14552 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.146934 14552 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.147135  9935 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:17:53.148106 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.148095 14552 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.150450 14552 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.109611 14424 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:53.157125 14617 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:53.157812 14617 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.158541 14662 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.159399 14662 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.161545 14662 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.161831 14640 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:53.162485 14640 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.164693 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.166486 14640 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.166888 10714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:53.161451 14617 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.150569 14453 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.167732  9935 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.170795 10714 raft_consensus.cc:606] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.171164 10714 raft_consensus.cc:614] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:53.172317  9935 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.173950 10714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:17:53.174847  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.175464 14610 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:53.177591 14528 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.035001 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.182327 10183 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
W20260709 13:17:53.182621 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 147917us
I20260709 13:17:53.174775 14640 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:17:53.190091 14610 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:53.191545 14567 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.192040 14567 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.192580 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:53.193164 14567 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.194351 14538 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:53.194768 14640 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.195255 14640 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.196327 14640 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.195178 14538 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:53.198081 14640 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.197252 14501 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.198387 14538 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.217729 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.210613 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.231122 14399 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:53.232622 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.233208 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.234411 10114 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:53.181528 14503 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.176847  9935 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.236857 10714 raft_consensus.cc:606] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:17:53.240491 10714 raft_consensus.cc:614] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:53.205729 14528 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.234795 10114 pending_rounds.cc:85] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 6
I20260709 13:17:53.254068 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.254525 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.241880 10114 pending_rounds.cc:107] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:53.255441 10114 raft_consensus.cc:2889] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:53.256861 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.236033 14662 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.264417 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.267648 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:53.208841 14396 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:53.268603 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.307587 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:53.322919 10111 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:53.323988 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.324430 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.317765 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 153185us
W20260709 13:17:53.330931 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.256664 14360 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:17:53.345432 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.348435 10713 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.267397 14615 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:17:53.354146 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 97865.2us
I20260709 13:17:53.358654 10108 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:53.271792 14482 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:17:53.337091 14567 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.351107  9935 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 10, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:53.362339 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.343959 14501 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:53.380249 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:53.380664 14671 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.381287 14671 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.387816 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:53.392038 10707 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:53.393850 14664 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:53.394810  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:53.397239 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.398175 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.398361 14424 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.399116 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.398975 14424 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.400334  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:53.400846 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.401940 14669 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:53.327883 14662 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.406924 14662 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.409090 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.410142 10183 raft_consensus.cc:2410] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:53.350710 14470 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.414924 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:53.412425 10714 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:53.400185 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:53.372345 14598 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.382782  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 12 to 14, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 14 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.387542 14671 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.435513 14662 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.436022 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.409174 14492 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.399504 14552 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:53.439087 14424 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.440801 10035 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:53.451187 10039 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:53.381520 14631 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:53.454903 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 86729.3us
W20260709 13:17:53.435287 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 392292us
I20260709 13:17:53.469347 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.461979 14575 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:53.472344 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.476444 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 275741us
I20260709 13:17:53.478650 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:53.452082 14492 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:53.373497 14436 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.499977 10109 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.456671 14662 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.492178 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:53.485520 14652 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:53.516718 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.502205  9935 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 9, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.491199 14503 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:53.556500 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.528731 14474 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:53.479813 14671 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:53.472021 14552 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.565436 10111 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:53.484762 14490 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:53.536032 14631 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.500923 14411 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:17:53.573089 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.549822 14436 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:53.558363 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.525985 14652 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:53.502487 14418 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:53.578390 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.572835 14498 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.589154 14552 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.591115 10040 pending_rounds.cc:85] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 10
I20260709 13:17:53.591483 10040 pending_rounds.cc:107] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:53.585479 14490 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.591720 10040 raft_consensus.cc:2889] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:53.593067 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:53.593689  9934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 286) took 26445 ms (client timeout 15000 ms). Trace:
I20260709 13:17:53.594940  9935 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.596764 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:53.597014 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 92788.9us
I20260709 13:17:53.597661 10032 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 8: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:53.598605 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.599273 10032 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:53.600829 10036 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:53.603000 14548 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:53.603611 14548 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.605786 14548 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.561084 10037 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:17:53.592209 10715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 905) took 1039 ms. Trace:
I20260709 13:17:53.607867 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.608942 14498 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.609983 14498 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.594326 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:53.612890 14631 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.491693 14501 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:53.613691 14501 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.614120 14501 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.571939 10038 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:53.614537 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:53.603977 10181 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:53.596679  9935 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 3 to 7, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.625463 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:53.607201 10715 rpcz_store.cc:276] 0709 13:17:52.552295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.552439 (+   144us) service_pool.cc:224] Handling call
0709 13:17:52.552804 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.553227 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:52.885415 (+332188us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.334918 (+449503us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.389584 (+ 54666us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.389735 (+   151us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:53.389794 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.389877 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.591889 (+202012us) raft_consensus.cc:1685] finished
0709 13:17:53.591906 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.592031 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9700,"prepare.queue_time_us":327052,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":28139,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":24516,"thread_start_us":651841,"threads_started":2,"wal-append.queue_time_us":659880}
I20260709 13:17:53.592402 14411 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:53.627051 14411 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.627785 14436 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.628100 14411 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.628373 14436 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.629554 14411 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.630030 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:53.630774 10189 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:53.624327 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:53.633769 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.624449 10713 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:17:53.634519 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.625133 10109 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:53.583379 14652 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:53.644053 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 274423us
I20260709 13:17:53.570214 14671 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.594328 14490 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:53.647850 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 165687us
I20260709 13:17:53.627087 10032 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:53.646606 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:53.645363 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2923) took 1094 ms. Trace:
I20260709 13:17:53.582762 14418 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:53.662689 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:53.664453 10032 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:53.594074  9934 rpcz_store.cc:269] 0709 13:17:27.162370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.218983 (+ 56613us) service_pool.cc:224] Handling call
0709 13:17:53.593470 (+26374487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:47.696845 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:47.697281 (+   436us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:47.697318 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:17:47.697331 (+    13us) tablet.cc:662] Decoding operations
0709 13:17:47.704800 (+  7469us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:47.704919 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:47.704946 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:17:47.706273 (+  1327us) tablet.cc:701] Row locks acquired
0709 13:17:47.706321 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:17:47.706493 (+   172us) write_op.cc:270] Start()
0709 13:17:47.706849 (+   356us) write_op.cc:276] Timestamp: P: 1783603067706430 usec, L: 0
0709 13:17:47.706891 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:17:47.707679 (+   788us) log.cc:844] Serialized 7151 byte log entry
0709 13:17:48.563166 (+855487us) op_driver.cc:464] REPLICATION: finished
0709 13:17:48.970510 (+407344us) write_op.cc:301] APPLY: starting
0709 13:17:48.970631 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:50.011710 (+1041079us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:50.028336 (+ 16626us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:50.681829 (+653493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:50.682226 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 13:17:50.682274 (+    48us) write_op.cc:312] APPLY: finished
0709 13:17:50.684065 (+  1791us) log.cc:844] Serialized 164 byte log entry
0709 13:17:51.117231 (+433166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:51.124688 (+  7457us) write_op.cc:454] Released schema lock
0709 13:17:51.148038 (+ 23350us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:51.190991 (+ 42953us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:51.197251 (+  6260us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":872571,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":376023,"apply.run_cpu_time_us":59457,"apply.run_wall_time_us":2201931,"cfile_cache_hit":70,"cfile_cache_hit_bytes":73045,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":1,"lbm_read_time_us":154865,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":5,"lbm_reads_lt_1ms":2,"num_ops":18,"prepare.queue_time_us":177362,"prepare.run_cpu_time_us":21188,"prepare.run_wall_time_us":44184,"raft.queue_time_us":527247,"raft.run_cpu_time_us":9565,"raft.run_wall_time_us":112671,"replication_time_us":856106,"spinlock_wait_cycles":2304,"thread_start_us":1102371,"threads_started":5,"wal-append.queue_time_us":728468,"wal-append.run_cpu_time_us":21898,"wal-append.run_wall_time_us":2620913}]]}
I20260709 13:17:53.666602 10714 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:53.670287 10035 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:53.630939 14436 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.660156 10108 rpcz_store.cc:276] 0709 13:17:52.550858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.551099 (+   241us) service_pool.cc:224] Handling call
0709 13:17:52.551424 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.367345 (+815921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.616299 (+248954us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000b5254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:53.645288 (+ 28989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1760729984}
W20260709 13:17:53.672981 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 300685us
I20260709 13:17:53.627908 14552 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:53.654624 14685 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.678509 10111 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:53.679181 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.555760 14492 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.679430 14418 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.679956  9935 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.681149 14482 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.660768 14446 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.658510 14407 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.687517 14694 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:17:53.690100 14552 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.697161 14662 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.635927 14474 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.704722 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:53.709703  9935 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.699934 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:53.721225 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.706272 14446 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.722092 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:53.726763  9935 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 11, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 11 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.709420 14407 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.749203 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:53.750365 14695 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:53.751849 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.753681 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.755609 14453 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:53.761519 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.762526 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.731660 14360 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:53.764163 14360 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:53.765154 14360 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.767210  9935 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.769034  9935 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 9, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.741658 14424 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:53.773587 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.773869 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.774395 14492 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.774945 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.775065 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:53.776006 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.776292 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.776574 10032 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:53.776888 10035 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:53.784250 14418 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.788417 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.789072 14671 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.791163 14341 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.723552 14598 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:53.802090 10111 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:53.803805 10031 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:53.807327  9935 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.713306 14534 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:17:53.811180 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:53.792924 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:53.838002 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:53.798873 14598 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.799077 14685 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:53.841275 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.843649  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.860435 14598 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.812686 14503 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.865134 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:17:53.873411 14701 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:53.877030 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.878015 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.804440 14482 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:17:53.885288 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:53.859805 14399 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:53.839267 14470 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:53.868451 14543 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:53.859726 14685 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:53.888963 10033 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:53.871793 14669 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:53.881242 14615 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:53.892606 14662 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.898015 14490 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.896605 14685 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.887025 14548 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:17:53.898351 14399 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:53.913414 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 75491.9us
I20260709 13:17:53.900485 14543 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:53.923853 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.918927 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 272419us
I20260709 13:17:53.927691 10034 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:53.930330 14424 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:53.930804 14424 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:53.936224 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:53.900136 14470 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.936559 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:53.938215 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49304.5us
I20260709 13:17:53.918373 14669 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.948835 14669 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:53.936355 14424 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.950965 14424 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:53.948411 14470 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:53.919277 14490 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:53.968389 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.971997 14490 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.975901 14711 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:53.978180 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:53.978886 14418 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.979585 14543 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.989638 14399 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.990849 14501 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:53.975062 14598 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:53.965704 14474 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:53.935470 14662 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:53.998243 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62082.2us
I20260709 13:17:54.003623 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:17:54.018201 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.020145 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.010635 14501 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:54.011101 14534 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:54.011842 14640 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.000s
I20260709 13:17:54.016199 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.023097 10714 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:54.029449 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.030853 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.026993 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.040827 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.001354 14470 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.044591 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.045688 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.046690 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.050114 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.050354 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:54.050982 10711 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.051560 10185 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:54.053133 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:54.054921 14710 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.067s	user 0.000s	sys 0.002s
I20260709 13:17:54.060190 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.061075 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.062384 10180 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:54.056210 10106 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:17:54.064615 10709 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.064827 14482 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.065270 14482 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:54.065671 14482 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.067891 14669 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.069039 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.071606 10033 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.073117 14703 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.077109 14685 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.079310 14685 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:54.077558 14662 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.087723 10711 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:54.098364 14598 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.099413 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.100170 10115 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:54.101481 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:54.044421 14664 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:54.106428 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 90307.1us
I20260709 13:17:54.108047 10182 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:54.047793 14470 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:54.110319 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:54.116271 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:54.116616 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.117293 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:54.120687 10181 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.121982 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:54.107491 14164 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:17:54.125388 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.125701 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:54.126386 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 95636.4us
I20260709 13:17:54.132092 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:54.132925 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.055794 14418 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:17:54.141335 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:54.138067 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.143450 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.114732 14664 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:54.144094 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.142482 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.146947 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:54.127225 14470 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.127302 14490 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.146925 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.129032 14474 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:54.148649 10035 raft_consensus.cc:2376] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11. Re-sending same reply.
I20260709 13:17:54.155601 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.156152 10711 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:54.142669 14640 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.128302 14671 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:54.184027 14474 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:54.185267 14474 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:54.171187 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.115227 14652 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.183851 14671 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.194365 14700 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.194909 14700 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:54.195288 14700 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.196856 14552 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.141553 14682 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.173863 10107 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:54.174532 14716 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:54.170591 14490 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.177467 14615 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:54.179823 14640 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:54.216326  9925 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9a67604b91f54791b1316fd327793337 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:17:54.153890 14492 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.144309 14715 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:17:54.231765 10713 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:54.183847 14706 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:17:54.146194 14550 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:17:54.172503 14567 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.263546 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:54.264268 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 128977us
I20260709 13:17:54.265172 10109 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:54.256649 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.236883 10036 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:54.238245 10039 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:54.151922 14664 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:54.242654 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 117362us
W20260709 13:17:54.249374 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 61133.3us
I20260709 13:17:54.251853 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.267419 14407 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.268365 14640 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.270059 14490 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:54.272145 14446 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.272801 14728 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.236055 10181 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:17:54.282683 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.257797 14453 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:54.288625 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.289812 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.323184 10031 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:54.322293 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:54.252784 14501 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:17:54.266494  9925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48238.1us
I20260709 13:17:54.291944 14615 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:54.329483 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.329713 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:54.317938 14701 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:17:54.332314 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 49733.8us
I20260709 13:17:54.337989 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:54.338035 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48331.3us
I20260709 13:17:54.339403 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.336547 10184 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:17:54.293838 14567 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.348349 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.330421 14721 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
I20260709 13:17:54.353339 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.296674 14492 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.361143 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.345206 14534 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:54.344636 14407 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:54.352892 14341 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.372100 14341 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.375458 14733 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.345583 14436 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:17:54.379396 14492 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:54.385461 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.375157 14482 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.353128 14728 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.395598 10111 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:54.358278 14550 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:54.355335 14652 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:54.393834 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 105308us
I20260709 13:17:54.361740 14490 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.393184 14411 consensus_meta.cc:287] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.763s	user 0.014s	sys 0.000s
I20260709 13:17:54.391065 14732 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.348704 14615 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.410924 14615 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:54.415212 14550 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:54.406769 14407 raft_consensus.cc:2764] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:54.363130 14164 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:17:54.426563 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.423600 14734 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:54.438051 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.438804 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:54.439987 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 102093us
I20260709 13:17:54.444710 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:17:54.445556 14503 consensus_meta.cc:287] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.002s
I20260709 13:17:54.421595 14490 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.447882 14490 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:54.431998 14407 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.448426 14341 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.448671 14407 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.451754 14407 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:54.453163 14722 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:17:54.423702 14550 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.453604 14482 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:54.456487 14724 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:17:54.446013 14503 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.407028 14700 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:54.451576 14726 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:17:54.484375 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.485314 10188 raft_consensus.cc:2410] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:54.435786 14734 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:54.492551 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 107153us
I20260709 13:17:54.502980 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.494160 14407 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.490236 14734 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.505373 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.512920 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.515076 14662 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:54.516229 10032 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.516484 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.517228  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:54.520126 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55910.6us
I20260709 13:17:54.517184 10712 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:54.505086 14721 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.515571 14662 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:54.535545 14662 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.537140 14662 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.540688 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.510579 14407 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.549010 14407 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:17:54.561201 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.561721 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:54.564073 14610 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.564531 14610 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:54.564898 14610 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.525956 14164 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.568110 14164 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.570284 14164 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.570689 14341 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.571211 14341 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.571797 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.572403 10114 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:54.574257 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.575489 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:54.579145 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:54.579730 14729 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.406s	user 0.003s	sys 0.000s
I20260709 13:17:54.580103 14552 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.528110 14548 raft_consensus.cc:2764] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:54.579886 10181 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:54.543144 14470 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.584903 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.526273 14652 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:54.602252 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 59447.5us
I20260709 13:17:54.602123 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.604039 10184 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:54.606673 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:54.604986 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54988.6us
I20260709 13:17:54.607355 10109 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:54.604451 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.608310 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.610879 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:54.612510 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71908.3us
I20260709 13:17:54.616197 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.616556 10711 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:54.617596 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:54.617820 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:54.616591 10713 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.620548 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.621206 10115 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:54.624442 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.624442 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:54.626071 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.626734 10035 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:17:54.628041 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.628633 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:54.632036 10106 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:54.632128 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.625118 10715 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:54.632762 10111 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:54.633478 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:54.634161 10109 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:54.621903 14610 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.636034 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.640554 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:54.641479 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.662987 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:54.663890 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.607151 14407 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.668427 10040 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:54.669036 10711 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:54.672715 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:54.670367 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 66010.1us
I20260709 13:17:54.671054 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:54.671192 10181 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:54.677147 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.640436 14548 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.673465 10034 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:54.665704 14631 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.642012 14732 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:54.631697 14652 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:17:54.674490 14700 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.698948 10715 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:54.679183 14615 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:17:54.705088 14615 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:54.705508 14615 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:54.706481 14615 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:54.709159 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 124474us
I20260709 13:17:54.742929 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.690016 14682 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:54.743536 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.695840 14732 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:54.705417 14744 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:54.754503 10036 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:17:54.762312 14740 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:54.764546 14751 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:54.765944 14470 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.767199 14720 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:54.767850 14720 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:54.768888 14720 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.765869 14610 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.772604 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.773667 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.775154 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.775887 14474 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.778188 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.784401 14548 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.785239 14548 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.794062 14548 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.747530 14700 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.689395 14664 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.805649 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.795248 14733 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:54.756034 14682 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.756729 14631 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.758443 14732 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.759039 14615 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.813304 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.761865 14744 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.824811 10033 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:54.812062 14474 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:54.827138 14744 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.835423 14548 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:54.837040 14548 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.817828 14740 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.830363 14474 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:54.812340 14733 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:54.840967 14474 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.841511 14733 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.843115 14733 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:54.831424 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.813037 14700 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.835600 10110 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:54.844800 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.845706 14700 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.839473 14548 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:54.846558 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.847407 14501 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.848117 14501 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:54.848598 14501 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:54.849514 14501 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.851962 14360 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.831880 14503 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:54.853382 14503 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:54.854282 14503 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.856769 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.808787 14470 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:54.875147 14470 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:54.875828 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 251471us
I20260709 13:17:54.814949 14682 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.876928 10708 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:54.877743 14470 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:54.887486 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:54.868748 14411 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:54.888028 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.898382 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:54.900593 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:54.886991 14543 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.900450 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:54.898553 14615 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:54.900110 14740 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:54.950979 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.952220 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:54.902907 14733 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.951659 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49658.8us
I20260709 13:17:54.904098 14711 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:54.957258 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:54.957443 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:54.926160 14652 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:54.967976 14652 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.926513 14407 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:54.959338 14436 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.962122 14671 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:54.966671 14740 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.966691 14711 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:54.895315 14734 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:54.971947 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:55.021152 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49266.3us
I20260709 13:17:54.951596 14615 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:54.972410 14762 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.968667 14470 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:55.009488 14760 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:17:54.980722 14752 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:17:55.036047 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 78343us
I20260709 13:17:55.036285 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.000792 14744 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:54.970930 14436 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:55.013756 14700 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:55.014359 14662 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:54.980602 14754 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:54.970786 14407 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.045567 10180 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:54.968482 14652 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.039283 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:54.967483 14733 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.031729 14615 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:54.972868 14761 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:17:55.041477 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.044061 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.059087 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.047444 10182 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:55.060078 10036 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:55.062093 10714 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.973148 14732 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.035133 14610 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.983942 14664 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:55.047448 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.048010 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.048583 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.059005 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.066901 10035 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:55.033423 14418 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:55.035351 14446 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:17:55.069509 14446 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:55.069885 14446 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:55.070538 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:55.070948 10032 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:17:55.071329 10032 pending_rounds.cc:85] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 5
I20260709 13:17:55.071517 10032 pending_rounds.cc:107] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:17:55.045364 14436 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.049343 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.066593 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.054541 14407 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.066610 10037 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:55.067986 14418 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:55.077119 14418 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.078368 14418 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.078894 14734 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.079137 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:55.077804 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.063380 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.071727 10032 raft_consensus.cc:2889] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.075565 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:55.075376 14446 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.080327 10182 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:55.077023 10111 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:55.059062 14470 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.083532 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:55.039518 14762 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.093498 14543 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.094005 14543 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.094353 14543 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.100337 10112 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:55.102025 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.103370 14543 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.104728 14360 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:55.105571 14543 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:55.106405 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 175212us
I20260709 13:17:55.107152 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:55.108393 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.109105 10037 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:55.112641 14762 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:55.113754 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:55.114068 14733 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:55.115067 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.114804 14615 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.115571 10112 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:55.116819 14744 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.120558 10039 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:55.123435 10035 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.121294 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:55.124810 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.125571 10188 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:55.126025 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.126919 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.127321 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.127662 10180 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:55.126344 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.130501 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.133849 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.131099 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.137317 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:55.138809 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:55.139983 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:17:55.140547 10155 leader_election.cc:336] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.736s (SENT)
I20260709 13:17:55.140904 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:55.134475 10188 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:55.121856 14664 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:55.144255 14664 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.144748 14548 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:55.148185 10107 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:55.123149 14733 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.201422 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:55.200732 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48357.3us
I20260709 13:17:55.138543 14446 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.123551 14543 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:55.141538 14762 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:55.202257 10112 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:55.214982 10189 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:55.217375 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.135898 14474 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:55.204645 14738 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.221446 14762 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.225899 14474 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.148749 14748 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.227492 14748 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.227882 14748 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.228322 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:55.228899 14615 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:55.226615 14762 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.230274 14474 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:55.233521 14407 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.234912 10709 raft_consensus.cc:2368] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:17:55.204404 14501 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.087538 14711 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.258090 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.200281 14341 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.262866 14748 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.157178 14732 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.223671 14543 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.270351 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.200685 14652 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.272377 14748 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:55.273733 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.274397 10185 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.274840 14652 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.276964 14341 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.277542 14341 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.278043 10181 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:55.270638 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.277055 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.280493 10180 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.273975 14543 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:55.292227 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.293174 10181 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:55.293556 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65330.4us
W20260709 13:17:55.292330 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 159091us
I20260709 13:17:55.293015 14768 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:55.302520 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:55.303171 10110 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.306392 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:55.307132 10107 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.293686 14721 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:55.309665 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 169150us
I20260709 13:17:55.310192 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.312304 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.312954 10039 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.318630 10185 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
W20260709 13:17:55.311940 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.119s (SENT) [suppressed 11 similar messages]
W20260709 13:17:55.327036 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 168441us
I20260709 13:17:55.329384 10181 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:55.335366 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.336407 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.335566 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.337966 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:55.340325 10079 leader_election.cc:400] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:17:55.340662 10079 leader_election.cc:403] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.341667 10180 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
W20260709 13:17:55.351791 10155 leader_election.cc:336] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 2.241s (SENT)
I20260709 13:17:55.352394 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:55.360589 10039 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:55.366649 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:55.313524 14721 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.308867 14664 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.367475 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:55.375715 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.377348 14567 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.377157 14498 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:55.381853 14762 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.370067 14721 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.325136 14768 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:55.385752 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.386368 14768 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.387116 14762 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.382027 14682 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.388326 10711 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:55.314606 14748 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:17:55.390254 14682 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:55.392777 14407 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.393436 14411 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.393962 14411 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.388850 14341 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.416595 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.417341 10180 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.402262 10107 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:55.421880 10110 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
W20260709 13:17:55.425948 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 88079.8us
I20260709 13:17:55.368145 14490 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.362217 14396 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.427452 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:55.431010 10109 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:55.430555 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 330144us
I20260709 13:17:55.427672 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:55.435978 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.448539 10180 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:17:55.434490 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 229066us
I20260709 13:17:55.427265 14528 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.478392 10112 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.456286 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:55.403820 14436 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.477277 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:55.477615 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:55.484028 10111 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
W20260709 13:17:55.476728 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 125019us
I20260709 13:17:55.481371 10709 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:55.481794 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.486312 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:55.494728 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 117803us
I20260709 13:17:55.507979 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.509724 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:55.510385 10713 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.516621 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.517328 10039 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.522378 10109 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:17:55.575618 10707 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:55.578114 10040 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.443077 14543 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:17:55.485899 14664 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:55.449891 14671 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:17:55.603924 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:55.604820 10710 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:55.610855 10037 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:17:55.611343 10037 pending_rounds.cc:85] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
I20260709 13:17:55.611567 10037 pending_rounds.cc:107] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:17:55.611809 10037 raft_consensus.cc:2889] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.612089 14341 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:55.612675 14341 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.613246 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.614051 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.614622 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.613619 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.615971 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.616653 10031 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:55.618064 10713 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:55.619067 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.622080 14721 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.622530 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:55.623358 10185 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:55.624404 14671 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:55.624821 14671 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:55.625684 14671 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.626928 14671 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.636621 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:55.614787 10036 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:55.637997 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:55.497591 14732 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
W20260709 13:17:55.646166 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 170765us
W20260709 13:17:55.647902 10035 consensus_meta.cc:287] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.003s
I20260709 13:17:55.648368 10035 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 8.
I20260709 13:17:55.675937 10031 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:55.703797 10039 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:55.709326 10034 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:55.614738 14341 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.615994 14664 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:55.703054 14552 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:55.640714 14744 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:55.769045 10153 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:55.774621 10153 leader_election.cc:403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.780206 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.786010 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:17:55.740183 14724 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:17:55.764880 14774 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:17:55.762722 14775 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.796833 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:55.703051 14474 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:17:55.714497 14490 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:17:55.781762 14552 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:55.764729 14498 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.805219 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:55.787474 14744 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:55.833952 14744 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.809732 14721 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.806478 10113 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:55.803663 10109 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:17:55.795428 14754 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:55.764472 14720 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.811535 14787 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:55.812120 14785 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.812582 14743 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.844671 14743 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.844965 14552 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.846324 14490 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:55.846726 14490 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:55.846920 14743 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.813319 14598 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:55.847251 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 825) took 1232 ms. Trace:
I20260709 13:17:55.821069 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:55.824018 14396 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:17:55.847646 10716 rpcz_store.cc:276] 0709 13:17:54.615224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.619996 (+  4772us) service_pool.cc:224] Handling call
0709 13:17:55.118918 (+498922us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:17:55.119097 (+   179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.119437 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.119463 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.120007 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.319714 (+199707us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:55.319778 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.319850 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.837811 (+517961us) raft_consensus.cc:1685] finished
0709 13:17:55.837839 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.847085 (+  9246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2638,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8463,"spinlock_wait_cycles":12691840,"thread_start_us":171390,"threads_started":1,"wal-append.queue_time_us":292813}
W20260709 13:17:55.825109 14446 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 13:17:55.836647 14498 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.777556 14772 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:55.823487 14418 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.000s
W20260709 13:17:55.839700 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 511802us
I20260709 13:17:55.854696 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:55.855024 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:55.855729 10185 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.842123 10040 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:17:55.848733 10114 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:55.858402 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.861377 10115 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:17:55.861821 10115 pending_rounds.cc:85] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 8
I20260709 13:17:55.862040 10115 pending_rounds.cc:107] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:17:55.862257 10115 raft_consensus.cc:2889] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.864449 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.863626 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:55.849963 14720 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:55.874264 14631 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:55.875281 10153 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:55.878906 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.880678 10185 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:55.809162 14775 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.890681 14795 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:55.891486 14795 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.873008 14787 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.875056 14685 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.874938 14615 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.915371 10038 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:17:55.915576 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 102898us
I20260709 13:17:55.874307 14793 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.877249 14436 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:55.859552 14772 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.928586 10039 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:55.881475 14474 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:17:55.914578 14411 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.002s
I20260709 13:17:55.935833 10037 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:55.936134 10036 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:55.943885 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:55.926431 14498 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:55.924906 14490 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:55.949672 10709 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:55.919819 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46968.2us
I20260709 13:17:55.931073 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:55.929705 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:55.865923 14664 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:55.922539 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48449.3us
I20260709 13:17:55.927106 14787 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.958422 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:55.960386 10710 raft_consensus.cc:2368] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:17:55.982394 10112 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:55.989605 10108 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:55.991348 10004 leader_election.cc:400] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:17:55.992576 10004 leader_election.cc:403] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:17:56.027539 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69291.2us
I20260709 13:17:56.028458 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.035605 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:55.990965 14498 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.959928 14411 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.042640 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2707) took 1008 ms. Trace:
I20260709 13:17:56.045614 10032 rpcz_store.cc:276] 0709 13:17:55.034227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.034375 (+   148us) service_pool.cc:224] Handling call
0709 13:17:55.034753 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.103252 (+ 68499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.042362 (+939110us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b540039c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:56.042568 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82363776}
I20260709 13:17:56.027642 14743 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:17:55.968756 14548 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:56.050796 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.034175 14723 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.035257 14474 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.107918 14720 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:56.108209 14799 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:56.109813 14772 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.116571 14775 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.043790 14800 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.036742 14360 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.034425 14787 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:17:56.123868 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 73161.7us
I20260709 13:17:55.992422 14797 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:56.130177 10035 raft_consensus.cc:2368] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:56.132946 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.129562 14800 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.126192 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:56.142093 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 712) took 1477 ms. Trace:
I20260709 13:17:56.128510 14723 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.145538 10707 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:56.148635 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:56.136893 14775 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.150107 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:56.129345 14774 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:56.037676 14631 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:17:56.145977 10711 rpcz_store.cc:276] 0709 13:17:54.664864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.685364 (+ 20500us) service_pool.cc:224] Handling call
0709 13:17:54.692647 (+  7283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.388696 (+696049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.141807 (+753111us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54005195d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:56.142020 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599446912}
I20260709 13:17:56.048467 14498 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.145931 14785 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.143345 14567 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.162447 14796 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.164808 14787 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.146742 10155 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:56.173600 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.175170 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.154997 14360 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:56.178066 14671 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.003s
I20260709 13:17:56.156694 14775 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.180366 14631 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.179481 14360 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:56.184775 14800 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.179255 14598 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:17:56.177659 14567 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.201581 14360 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.206091 14810 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.228542 14810 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.230526 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:56.230875 14810 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.231717 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2115) took 1112 ms. Trace:
I20260709 13:17:56.232132 10038 rpcz_store.cc:276] 0709 13:17:55.118962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.123024 (+  4062us) service_pool.cc:224] Handling call
0709 13:17:56.231553 (+1108529us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400275bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:56.231659 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654349696}
I20260709 13:17:56.236177 14498 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.179623 14796 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.218631 14732 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.191533 14785 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:17:56.237864 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54137.5us
W20260709 13:17:56.217415 14794 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.407s	user 0.000s	sys 0.003s
I20260709 13:17:56.240440 10679 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:56.246222 14407 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:56.247123 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:56.246470 14796 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.237576 14598 consensus_queue.cc:1243] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:56.242929 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:56.269470 10710 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 8.
I20260709 13:17:56.270159 14744 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:56.270583 14744 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:56.270696 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:56.271556 14453 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:56.271953 14453 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.272291 14453 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:56.190932 14772 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:17:56.207613 14411 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.222868 14775 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.241940 14732 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:56.249157 14723 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:56.254513 14814 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:56.248873 14809 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.255550 14407 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:56.255918 14728 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:56.257293 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.258776 14682 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:56.260205 14740 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:56.262575 14490 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.263072 14528 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.263379 14501 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.264494 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:56.268553 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.282117 14804 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.248520 14762 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:56.290158 14732 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.293138 14567 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.288586 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:56.296178 10114 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.303088 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:56.313555 10111 raft_consensus.cc:2368] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:17:56.312462 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:56.304206 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:56.305855 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.314864 10107 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:56.306191 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.271409 14744 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.293183 14411 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.349483 14411 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.350522 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:56.307358 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.352854 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.353209 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:56.315505 10110 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:17:56.317785 14640 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.354035 14640 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.354410 14640 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.297387 14501 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:56.356181 14501 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.357460 14501 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.358942 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.294674 14740 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:56.354413 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.297711 14728 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:56.318568 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:56.319007 14723 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:56.324306 14652 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:56.324736 10109 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.363327 14728 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.364506 10109 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.294106 14809 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.329136 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.316419 14503 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:17:56.353591 10112 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:56.309418 14804 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.331579 10710 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:17:56.299399 14528 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.332746 14407 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.309446 14814 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.335983 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:56.336588 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.294103 14682 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:56.391135 14682 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.340657 14800 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:56.341648 14772 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:56.339177 14664 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.412249 14664 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.414281 10111 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:56.414696 14664 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.346387 14787 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:56.415508 14787 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.418515 14787 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.348681 10188 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:56.344732 10114 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
W20260709 13:17:56.367898 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49428.3us
I20260709 13:17:56.373818 10110 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:56.376076 10185 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.423732 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.424530 10038 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:56.379266 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.425390 10181 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:17:56.379618 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.379848 14762 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:56.380283 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56522.3us
I20260709 13:17:56.380359 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.429144 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.429807 10033 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:17:56.315824 14785 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:17:56.386317 14341 consensus_queue.cc:1175] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 16 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: [15.11-15.11]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:56.403501 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.341100 14360 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.410794 10109 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:56.315500 14768 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.426473 10113 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:17:56.363334 14723 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:56.371623 14796 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.406885 14567 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:56.446626 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:56.384783 14652 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:56.411381 14744 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.455993 14682 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.456492 14567 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.442978 14797 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:17:56.410600 14814 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:17:56.470821 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:56.372030 14453 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.474314 10180 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:56.464304 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.465983 14360 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.446803 14796 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.451020 14528 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.498462 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:17:56.499572 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.501912 14796 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:56.517709 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 80634.6us
I20260709 13:17:56.447862 14640 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.517143 14652 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.475798 14801 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:56.583058 14801 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:56.583470 14801 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:56.522483 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:56.584649 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 66311.6us
I20260709 13:17:56.584367 14801 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.451659 14768 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.585928 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:56.588346 10183 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:56.631954 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:56.639356 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 205438us
I20260709 13:17:56.642258 10040 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:56.587885 14810 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:56.634179 14453 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:56.639460 14812 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:17:56.634966 14360 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.637253 14548 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.634868 14407 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:56.644289 14806 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:17:56.667151 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.643884 14797 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:56.643428 14598 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.645478 14664 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:56.649116 14810 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.664702 14610 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.641611 14723 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.665162 14548 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.669484 14453 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.690477 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.644951 14762 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.704339 14640 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.707971 14804 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.669519 14407 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:56.713855 14821 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:56.714432 14407 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.698110 14453 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.718482 14453 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.688246 14810 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:56.724206 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.726229 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:56.729521 14814 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:56.731947 14503 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.692605 14548 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.688987 14664 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.666958 14360 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.681164 14598 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.692687 14610 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.765506 14793 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:56.765990 14793 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:56.766815 14793 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:56.768644 14826 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:17:56.727600 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:56.774658 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 48531.2us
W20260709 13:17:56.775921 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.779373 10716 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:17:56.781347 14795 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.781579 14793 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.783931 14809 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:56.785213 14834 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:56.787489 14470 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:56.787950 14470 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:56.788861 14470 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.789428 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.790797 14664 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.793045 14800 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.794391 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.822794 14795 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.823627 14795 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.824951 14744 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.825804 14795 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.825542 14744 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.825941 14498 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.826627 14498 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.827296 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:56.827797 14744 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.829399 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.830998 10039 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:56.831657 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.832302 10033 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:56.833065 10039 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.833374 14809 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.832111 14470 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.833864 14809 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.834231 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.791499 14610 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.834810 10036 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
W20260709 13:17:56.805837 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 134901us
I20260709 13:17:56.843250 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:56.846639 14797 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:56.848933 10153 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:56.828860 14498 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.862283 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.840023 14762 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.825798 14453 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:56.851191 14772 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.793640 14800 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.897701 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.861371 14567 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.903790 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.906448 10036 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:56.866199 14671 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:56.906749 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.907724 14598 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:56.908346 10034 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:56.914547 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1902) took 1130 ms. Trace:
W20260709 13:17:56.927838 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.927619 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:56.928475 10707 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 8.
I20260709 13:17:56.929266 14567 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:56.929630 14840 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.925223 10115 rpcz_store.cc:276] 0709 13:17:55.784647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.784788 (+   141us) service_pool.cc:224] Handling call
0709 13:17:55.785879 (+  1091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.862698 (+ 76819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.914239 (+1051541us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54000b5254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:56.914469 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172802432}
I20260709 13:17:56.932961 10110 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:56.864751 14631 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:56.935987 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 715) took 1010 ms. Trace:
I20260709 13:17:56.944516 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:56.939726 10713 rpcz_store.cc:276] 0709 13:17:55.925107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.925268 (+   161us) service_pool.cc:224] Handling call
0709 13:17:55.932473 (+  7205us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:55.934126 (+  1653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.934156 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:55.940813 (+  6657us) log.cc:844] Serialized 52 byte log entry
0709 13:17:56.144586 (+203773us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:56.409601 (+265015us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.437883 (+ 28282us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.935568 (+497685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.935644 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.935690 (+    46us) raft_consensus.cc:1685] finished
0709 13:17:56.935701 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.935922 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27781,"prepare.queue_time_us":65432,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":89085,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":32175,"thread_start_us":934072,"threads_started":3,"wal-append.queue_time_us":219592}
W20260709 13:17:56.946851 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 96576.9us
I20260709 13:17:56.948344 10034 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:56.942664 14787 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.955286 14787 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.925892 14453 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.953902 14803 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:56.962144 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:56.962818 10708 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:56.940052 14567 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.962064 14803 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.900966 14762 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:56.905845 14772 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:56.972541 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:56.973098 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:56.975980 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:56.962042 14453 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:56.972030 14610 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.930292 14840 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.008735 10106 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:57.010360 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.013266 10034 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:57.016582 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:57.018986 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.982692 14804 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:57.026487 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54975.5us
I20260709 13:17:57.034735 14854 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:57.035125 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.035961 10040 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:57.034823 10037 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:17:57.027590 14501 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.005s
I20260709 13:17:57.011428 14548 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.043943 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:57.026014 14671 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:57.035807 14567 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.045948 14750 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.046521 14750 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.049477 14750 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.040792 14787 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.052325 14840 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.054503 14548 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.057097 14810 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.057426 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.058171 10181 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:57.060676 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:57.021976 14610 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.062121 14733 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.062528 14733 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.062853 14733 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:57.063434 14796 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.002s
I20260709 13:17:57.029309 14804 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.076656 14831 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:57.058118 14803 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.035482 14854 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:57.038379 14809 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.079084 14804 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:56.953284 14797 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.086094 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.086023 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:57.069036 14610 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.096309 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.098853 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:57.100072 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:57.101131 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:57.095288 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.103631 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.104763 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.105103 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.105374 10031 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.106029 10032 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:57.106472 10036 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.107834 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:57.109671 14810 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.110091 14762 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.110426 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.111447 14411 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.111629 14800 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.096975 10037 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:57.117332 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.085592 14854 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.117892 10181 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
W20260709 13:17:57.119724 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.078989 14796 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.124854 14796 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.122339 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:57.128835 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:57.110450 14772 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.129423 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.137125 10184 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:17:57.118161 14407 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.127727 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.131992 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.141348 10185 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:17:57.135115 10031 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:57.135973 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:57.134318 10036 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:17:57.141882 10186 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.126479 14810 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:57.206091 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.204475 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.130229 14850 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.134677 14793 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.219254 14793 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.221385 10185 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:57.222183 14824 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:17:57.223027 14824 consensus_queue.cc:1243] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:57.224308 14841 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.219146 14850 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.265398 10031 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:17:57.265872 10031 pending_rounds.cc:85] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 10
I20260709 13:17:57.266094 10031 pending_rounds.cc:107] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:17:57.266314 10031 raft_consensus.cc:2889] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.266665 14850 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.203115 14728 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.138770 14762 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.125918 14750 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:17:57.211314 14819 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:57.205621 14810 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.294796 10155 leader_election.cc:400] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:57.221668 14793 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.308579 10155 leader_election.cc:403] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:17:57.312575 14779 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.540s	user 0.004s	sys 0.010s
I20260709 13:17:57.315922 14832 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:57.332100 14740 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.333338 14740 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.336959 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 819) took 2723 ms. Trace:
I20260709 13:17:57.337489 10712 rpcz_store.cc:276] 0709 13:17:54.613618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.616711 (+  3093us) service_pool.cc:224] Handling call
0709 13:17:54.617160 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.294082 (+676922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.294116 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.294682 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.456959 (+162277us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:55.457003 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.954918 (+497915us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54004d0154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:55.954970 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.294067 (+1339097us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:57.336680 (+ 42613us) raft_consensus.cc:1685] finished
0709 13:17:57.336704 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.336862 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74306,"raft.queue_time_us":65867,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":10975,"spinlock_wait_cycles":1433769984,"thread_start_us":161889,"threads_started":1,"wal-append.queue_time_us":303239}
I20260709 13:17:57.341804 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.342309 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:57.342597 10708 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:57.343411 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.344681 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.345916 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.347911 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.342976 10710 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:57.350704 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:57.351775 14837 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:17:57.296729 14548 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:57.353104 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.226934 14671 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.355625 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:17:57.356590 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 61945us
I20260709 13:17:57.298671 14762 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.371930 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.317966 14810 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:57.364387 14858 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:17:57.387545 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 191953us
I20260709 13:17:57.303946 14662 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:17:57.369863 14762 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.367005 14772 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:57.390578 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 158416us
I20260709 13:17:57.377054 14453 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.375898 10186 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:57.375347 10004 leader_election.cc:400] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:17:57.378866 14796 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:57.396643 10037 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:57.393527 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.398892 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:57.404120 14797 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.404624 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:57.405489 14797 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:57.407088 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.408697 10031 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:57.386535 14803 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:57.386775 14503 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:57.457882 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48059.2us
I20260709 13:17:57.472939 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:57.458577 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55164.6us
I20260709 13:17:57.384208 14501 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.407874 14861 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:57.487571 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.397215 14793 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:17:57.388695 14850 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 13:17:57.472828 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71344.5us
W20260709 13:17:57.503371 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.504042 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.396808 14772 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.489565 14407 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:17:57.399286 14453 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.467949 14797 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:57.466002 14796 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.479579 14750 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.478582 14598 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:57.573009 10710 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 9.
I20260709 13:17:57.488404 14503 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.563041 14822 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:17:57.505017 14803 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.576097 14750 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.490751 14861 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:57.601786 14768 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:57.602380 14833 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.882s	user 0.000s	sys 0.004s
I20260709 13:17:57.605093 14869 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:57.606735 14854 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.607106 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:57.514370 14862 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:57.631709 10186 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
W20260709 13:17:57.630309 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70176us
I20260709 13:17:57.514767 14498 raft_consensus.cc:2764] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:57.608474 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1917) took 1272 ms. Trace:
I20260709 13:17:57.608656 14772 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.632638 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.609514 14841 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:57.495922 14501 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.503944 14855 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:57.614771 14796 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.638469 14768 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.640444 14768 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.641430 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.642172 10031 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:17:57.642872 10113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 857) took 1376 ms (client timeout 1616 ms). Trace:
W20260709 13:17:57.643266 10113 rpcz_store.cc:269] 0709 13:17:56.266680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.268296 (+  1616us) service_pool.cc:224] Handling call
0709 13:17:57.642700 (+1374404us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540017d754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:57.642815 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299927424}
I20260709 13:17:57.644150 14501 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.615206 14453 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.644372 14855 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:17:57.618673 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 160156us
I20260709 13:17:57.645316 14855 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.574282 14598 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:57.629539 14861 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:57.633647 10111 rpcz_store.cc:276] 0709 13:17:56.336173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.336355 (+   182us) service_pool.cc:224] Handling call
0709 13:17:57.608252 (+1271897us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b540002c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:57.608380 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54573312}
I20260709 13:17:57.622682 14407 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.608492 14733 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.008s
I20260709 13:17:57.636221 14498 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.628824 14503 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.632655 14869 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:57.657646 14498 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:57.657974 14869 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:57.658229 14498 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.659065 14869 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.659267 14810 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.660401 14869 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.649304 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:57.662654 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.664000 14810 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.669812 14498 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.638926 14862 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:57.676256 14862 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.676715 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:57.640985 14854 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.655177 14664 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.677989 14664 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.678351 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:57.679359 14872 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.679693 14360 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:57.681990 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:57.682785 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.683439 10031 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:57.677278 10108 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:17:57.635910 14841 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:57.686636 14664 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.676914 14407 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.692233 14803 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:57.692803 14860 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.149s	user 0.000s	sys 0.003s
I20260709 13:17:57.693499 14407 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.695467 14750 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.650859 14840 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:17:57.690079 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.699299 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.704375 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.705945 10040 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:57.648617 14598 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.711725 10113 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:17:57.713420 14818 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 1.014s	user 0.000s	sys 0.010s
I20260709 13:17:57.717759 14841 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.718914 14841 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.720475 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 955) took 1365 ms. Trace:
I20260709 13:17:57.720898 10182 rpcz_store.cc:276] 0709 13:17:56.355422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.355598 (+   176us) service_pool.cc:224] Handling call
0709 13:17:56.355909 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.416753 (+ 60844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.416787 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.416828 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:56.416860 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.720125 (+1303265us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b54002acbd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:57.720180 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.720410 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139444096}
I20260709 13:17:57.722515 10115 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:57.676837 14453 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:57.722994 14453 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.723348 14453 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.724334 10115 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:57.725704 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:57.722558 14872 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:57.725828 14804 consensus_meta.cc:287] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:17:57.728434 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:57.730437 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:57.733711 10707 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.739171 10031 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:57.740682 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:57.706133 14830 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.993s	user 0.003s	sys 0.007s
I20260709 13:17:57.741902 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.743733 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.746186 10031 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:57.742651 10107 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:17:57.752427 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.753849 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.757295 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:57.734419 14869 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:57.727980 14872 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:57.760231 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:57.761360 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.760290 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.734586 14498 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.765269 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.741695 14822 raft_consensus.cc:2764] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:17:57.744066 14490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.020s	sys 0.048s
I20260709 13:17:57.741457 14840 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:57.657655 14733 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.736706 14804 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.777218 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:17:57.771782 14490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.020s	sys 0.049s
I20260709 13:17:57.781798 14873 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.782600 14804 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.782370 14873 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.779814 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.785040 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.785851 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.788023 10707 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:57.789094 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.784552 14873 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.760684 14790 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:17:57.782545 14490 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:57.795132 14490 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:57.796042 14490 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.796972 14490 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.760358 14864 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:17:57.798147 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:57.798398 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.793864 14804 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:57.881639 10710 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 9: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:57.887632 10039 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:57.776466 14840 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.792505 14750 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:17:57.797596 14822 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:17:57.890053 14804 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:57.891178 14809 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.903239 14869 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.918915 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 143373us
I20260709 13:17:57.920208 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:57.921643 14864 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:57.922075 14864 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.922432 14864 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.930727 14864 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.905105 14814 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:57.950659 14855 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.953092 14848 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:57.953549 14848 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:57.954445 14848 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.956153 14733 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:17:57.956491 14875 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:57.957115 14732 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.958935 14453 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.933032 14869 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.961745 14869 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.934485 14809 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:57.961483 14861 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:57.963598 10180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1735) took 1611 ms (client timeout 1544 ms). Trace:
I20260709 13:17:57.963806 14790 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.964345 14790 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.965026 14861 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.892313 14872 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.964737 14809 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:57.969300 14790 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:57.953109 14855 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:57.971939 14855 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:57.972321 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.973555 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.974108 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.974563 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:57.975111 10037 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.947160 14879 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:57.934046 14804 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:57.976527 14879 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:57.977540 14835 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.233s	user 0.005s	sys 0.000s
W20260709 13:17:57.979822 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.968114 10180 rpcz_store.cc:269] 0709 13:17:56.352456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.352964 (+   508us) service_pool.cc:224] Handling call
0709 13:17:57.963417 (+1610453us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002d9bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:57.963524 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240917248}
W20260709 13:17:57.956224 14762 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 13:17:57.986335 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:57.994804 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:57.995105 10111 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:57.979621 14848 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.997702 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2746) took 1561 ms. Trace:
I20260709 13:17:57.957254 14598 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.005297 14768 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.005126 10038 rpcz_store.cc:276] 0709 13:17:56.428419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.430825 (+  2406us) service_pool.cc:224] Handling call
0709 13:17:56.448114 (+ 17289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.448454 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.448483 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.466482 (+ 17999us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.663245 (+196763us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:56.663304 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.663374 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.976806 (+1313432us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:57.978998 (+  2192us) raft_consensus.cc:1685] finished
0709 13:17:57.979019 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.989884 (+ 10865us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1405,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":24140,"spinlock_wait_cycles":65596800,"thread_start_us":166191,"threads_started":1,"wal-append.queue_time_us":219851}
I20260709 13:17:58.010157 10115 raft_consensus.cc:2410] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:17:58.014707 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.978897 14879 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.051551 14768 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:58.111675 10034 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:58.113091 10712 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.058905 10037 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:58.117661 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:58.120795 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.121497 10707 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:17:58.122599 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.123365 10716 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:17:57.987582 14855 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:17:58.127750 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.146205 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.147181 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.142529 10711 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:58.104815 14809 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:58.076776 14776 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:57.992842 14762 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.089901 14854 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.110759 14768 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:58.160735 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.124946 14840 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.145522 14841 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:58.090111 14740 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.175359 14762 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.151603 14855 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.181586 10040 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:58.182008 10106 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:58.182794 10034 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:58.183529 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.184173 10109 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.189563 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.172119 14841 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:58.159359 14809 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.161135 14776 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.173399 14785 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:58.195304 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:58.201231 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.168208 14854 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.172294 14740 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.200266 14610 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:58.216500 10113 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.203567 14864 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.193994 14733 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:58.201171 14785 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.219911 14720 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:58.250440 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 80958.8us
I20260709 13:17:58.251402 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.252915 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.254343 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:17:58.254659 10153 leader_election.cc:403] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.237478 10109 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:17:58.256577 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:58.260998 10037 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:58.239395 14720 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:58.252154 14490 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.270377 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.227501 14610 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.273682 14490 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.278748 14610 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.271238 14897 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:58.275496 14720 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.268857 14768 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:58.269022 14896 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.287611 14896 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:58.288930 14896 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.290777 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.265115 14864 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:58.295238 14854 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.295611 14490 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.298453 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.296183 14857 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.306666 14776 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.300256 10113 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:58.307814 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.308701 10710 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:17:58.314500 14740 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.316524 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.308871 14864 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:58.317255 10710 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:58.317761 14864 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.318665 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:58.319638 14740 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.320084 14740 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.320437 14740 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.263355 14841 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.312973 14490 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 13:17:58.326362 14825 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.611s	user 0.004s	sys 0.011s
I20260709 13:17:58.307942 14720 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.327803 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 2962) took 1990 ms. Trace:
I20260709 13:17:58.328501 14785 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:58.322197 14809 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.336704 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.337508 10710 raft_consensus.cc:2368] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:17:58.338956 10079 leader_election.cc:400] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:17:58.339272 10079 leader_election.cc:403] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.339990 14732 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:17:58.340379 14855 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.345501 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.346881 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.349574 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.328207 10112 rpcz_store.cc:276] 0709 13:17:56.337575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.372670 (+ 35095us) service_pool.cc:224] Handling call
0709 13:17:56.373042 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.430102 (+ 57060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.430133 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.430584 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.643903 (+213319us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:56.643943 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.799716 (+1155773us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b5400189554. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:57.799803 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.325782 (+525979us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:58.327533 (+  1751us) raft_consensus.cc:1685] finished
0709 13:17:58.327556 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.327708 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1841,"raft.queue_time_us":2553,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7502,"spinlock_wait_cycles":272465024,"thread_start_us":159613,"threads_started":1,"wal-append.queue_time_us":219620}
I20260709 13:17:58.354048 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.354967 10182 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:58.355434 14801 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.356065 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.363480 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:58.377033 10710 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.322829 14857 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
W20260709 13:17:58.378432 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 121907us
W20260709 13:17:58.381561 14877 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.481s	user 0.000s	sys 0.002s
W20260709 13:17:58.381075 14876 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.488s	user 0.003s	sys 0.000s
I20260709 13:17:58.375610 14453 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.422144 10710 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:17:58.481371 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 170816us
I20260709 13:17:58.433183 14822 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:58.540419 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:58.541203 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 159964us
I20260709 13:17:58.540484 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.541990 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.542536 10183 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:17:58.541229 10189 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:58.544826 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2204) took 1317 ms. Trace:
I20260709 13:17:58.527884 14822 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.566745 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.567207 10185 rpcz_store.cc:276] 0709 13:17:57.227673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.353210 (+1125537us) service_pool.cc:224] Handling call
0709 13:17:58.360009 (+  6799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.543363 (+183354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.543404 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.543461 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:58.543503 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.543581 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.543728 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23688,"raft.queue_time_us":183671,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":17549}
I20260709 13:17:58.572737 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.573422 10189 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:58.576643 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.568560 14720 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:58.578013 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.578176 14720 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.581080 14720 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.582226 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.567997 14474 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.584232 10036 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:58.571372 14839 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.564013 14848 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:17:58.575114 14897 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:17:58.588604 14822 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:58.576666 14490 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:58.598241 10189 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:17:58.598323 14839 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:58.601989 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.594350 14890 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:17:58.582409 14740 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.596496 14848 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.615947 14848 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:58.616878 14848 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.618161 14848 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.620978 14839 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.615272 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.624996 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.625859 14418 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.627487 14418 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:58.592602 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.630533 10036 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:17:58.630609 14711 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.631110 14711 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.601598 14896 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.636312 14740 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.622237 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:58.638100 10710 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.612646 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:58.638322 10183 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:58.639286 14879 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:58.639846 14879 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:58.640673 14879 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.641319 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.641924 10183 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:58.643162 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.648263 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:58.651867 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:17:58.652541 10713 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.655907 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.657229 10185 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:58.660523 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:17:58.710035 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.710243 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:58.635535 14896 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:17:58.721674 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 61240.6us
I20260709 13:17:58.726265 10710 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:17:58.727090 10708 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:58.655690 14864 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.750200 10713 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:17:58.725334 14801 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:58.760032 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.722843 14740 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:58.755833 14864 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.784102 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.784825 10185 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:17:58.788285 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.792188 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.792815 10185 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:58.780019 14864 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:58.795603 14864 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.795818 14896 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:17:58.806794 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 73663.7us
I20260709 13:17:58.796440 14901 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:58.811877 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:58.819473 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2202) took 1624 ms. Trace:
I20260709 13:17:58.819996 10188 rpcz_store.cc:276] 0709 13:17:57.195032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.195397 (+   365us) service_pool.cc:224] Handling call
0709 13:17:57.195735 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.267874 (+ 72139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.267908 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.267947 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:57.267976 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.819184 (+1551208us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b5400100254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:58.819248 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.819401 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165358848}
I20260709 13:17:58.834751 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.836088 14855 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:58.821888 14900 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:58.839526 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.839665 14900 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:58.840883 14900 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.833271 14396 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:58.842082 14396 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.844291 14396 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.833339 14809 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:58.845028 14809 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.847398 14809 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.848102 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.838025 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.839139 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.851635 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.853282 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.855463 10112 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:58.855674 10115 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.855717 10181 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.856559 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.857128 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.857745 10187 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:58.858542 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.861101 10035 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:17:58.861471 10188 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:58.861404 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.862601 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.864272 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.864912 10183 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.868420 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.869171 10187 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:58.870010 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.869119 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.871640 10185 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:17:58.875358 10112 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:58.876716 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.877604 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.883353 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.885288 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.887988 10114 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:17:58.889104 10114 pending_rounds.cc:85] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 8
I20260709 13:17:58.889328 10114 pending_rounds.cc:107] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:17:58.889541 10114 raft_consensus.cc:2889] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.891844 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:58.893005 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.853929 14789 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.896343 14453 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:58.896696 14789 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.897164 14453 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.898983 14789 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.899307 14453 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.866225 14814 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:58.900205 14814 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.900630 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.901496 10109 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:58.902925 14814 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:58.904101 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.904726 10109 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:17:58.906221 10181 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:17:58.906764 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.907238 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.864195 14733 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:58.908107 14733 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.910218 14733 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:58.812563 14896 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.934398 14896 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:58.937352 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.909869 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.940063 10109 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.910866 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.912451 10115 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:58.912971 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.944496 10110 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.946316 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.948932 10708 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:58.949379 14893 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.683s	user 0.001s	sys 0.000s
W20260709 13:17:58.951053 14883 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.730s	user 0.001s	sys 0.000s
I20260709 13:17:58.910457 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.916266 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.952302 10035 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:58.953687 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:58.916847 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:17:58.904362 10713 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:58.954068 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.954617 10115 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:58.956148 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:58.956177 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 60502.8us
I20260709 13:17:58.956624 14744 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:58.957151 14744 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:58.957350 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.954742 10106 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:17:58.958400 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:58.958961 10113 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
W20260709 13:17:58.960923 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.962169 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:58.964337 14776 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:58.964740 14776 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.965154 14857 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.964757 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:58.965636 14857 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.966300 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:58.966483 14814 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.967017 14814 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:58.965304 10033 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:58.969036 14814 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:58.965090 14776 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.968087 10035 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:58.973080 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:58.963457 10110 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:17:58.976047 10115 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:17:58.976495 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.977159 10181 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:17:58.977890 14453 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:58.970155 14744 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:58.979997 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.980844 10187 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:17:58.954310 10108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1906) took 2652 ms (client timeout 1777 ms). Trace:
I20260709 13:17:58.922431 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
W20260709 13:17:58.925216 14908 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:17:58.925949 14906 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:17:58.866637 14855 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.001379 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.002288 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.003060 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:58.967885 14474 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:59.004081 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:58.817335 14901 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:17:58.981755 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.005087 10185 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:59.006392 14901 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:17:59.007025 10188 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:59.004266 10114 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:17:59.008213 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.008714 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.009975 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.010592 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:59.011109 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 95227.6us
I20260709 13:17:59.001231 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.002110 14785 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:59.012166 14785 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:58.988781 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.013727 10186 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:17:59.014125 10708 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:59.018261 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:59.021531 14723 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:59.021974 14723 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:59.022401 14723 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:59.023844 10183 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:59.027473 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.028422 10185 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:17:59.004223 14474 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.029162 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:59.023720 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.004890 10108 rpcz_store.cc:269] 0709 13:17:56.302358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.302539 (+   181us) service_pool.cc:224] Handling call
0709 13:17:58.954109 (+2651570us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002b8c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:58.954213 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004050176}
I20260709 13:17:59.029502 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.032438 10109 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:59.032281 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.029910 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.033386 10185 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:17:59.036233 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.033089 10110 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:17:59.035475 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.035545 10114 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:59.043525 10110 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:59.035983 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.047627 10187 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:17:59.013062 14785 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.048646 14785 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.048902 10186 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:59.048869 14790 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:17:59.052049 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.052696 14790 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:59.053052 14790 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:59.053293 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.054589 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.055224 10187 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:17:59.056217 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.065601 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:59.057916 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.070827 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.080797 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.205482 10184 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:17:59.206272 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 125553us
I20260709 13:17:59.205279 10187 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:59.208340 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.209470 10113 raft_consensus.cc:2410] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:17:59.210500 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.212900 10182 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:59.217378 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:58.967729 14857 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:59.221158 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.230978 10189 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.220737 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.220986 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.232576 10185 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:17:59.232986 10111 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.984692 14341 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.221s
I20260709 13:17:59.041167 14598 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.053557 14567 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:59.206498 14820 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.261257 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:17:59.220865 14885 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.280310 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.234535 14685 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.284960 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.205710 14762 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.220986 14768 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.288215 14498 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:59.289669 10182 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:59.310365 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.311097 10113 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:59.288120 14733 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.315339 14723 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.295303 14598 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.314138 10115 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:59.290578 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.320749 10113 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:59.314236 14474 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:59.330711 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:59.333850 14804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.015s	sys 0.009s
I20260709 13:17:59.303546 14685 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.303103 14567 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:17:59.355978 10113 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:17:59.357128 14804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.015s	sys 0.010s
I20260709 13:17:59.321559 14879 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:59.369284 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.371357 10182 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:59.374073 10113 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:59.375428 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.353245 14733 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:17:59.378461 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.348908 14598 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:59.376919 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:59.393998 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:59.347235 14776 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.294196 14790 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:17:59.382881 14864 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.000s
I20260709 13:17:59.398303 10113 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:59.400640 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:17:59.408106 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 176414us
I20260709 13:17:59.393211 14598 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.412413 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.421838 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:59.403657 14894 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.128s	user 0.013s	sys 0.000s
I20260709 13:17:59.427228 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.369256 14721 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:59.377949 14879 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.427382 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.398900 14804 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.403805 14789 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:59.418628 14862 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:59.432206 14800 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:59.425590 14396 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:59.453083 14776 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.428576 14790 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.431105 14809 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:59.458309 14809 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:59.458792 14809 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:59.453104 14685 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.452301 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.451550 14800 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:59.462229 14800 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.463311 14800 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.425894 14453 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.426451 14918 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:17:59.055122  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:59.414081 14864 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.493549 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:59.478751 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 413899us
I20260709 13:17:59.432426 14721 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:17:59.479283 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.481699 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.426074 14567 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.484364 14879 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:59.484838 14917 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:17:59.485392 14762 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:59.450479 14801 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:59.487800 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.488077 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:17:59.517690 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99336.6us
I20260709 13:17:59.488535 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.517791 10106 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:17:59.444053 14789 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:17:59.506994 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.508702 10189 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:17:59.511518 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 102515us
I20260709 13:17:59.515588 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.512576 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 872) took 1530 ms. Trace:
I20260709 13:17:59.522867 10108 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:59.518682 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.504206 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:59.522575 10107 rpcz_store.cc:276] 0709 13:17:57.982443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.982579 (+   136us) service_pool.cc:224] Handling call
0709 13:17:57.982923 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.987999 (+  5076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.988033 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.110631 (+122598us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.238079 (+127448us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:58.238115 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.238186 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.238525 (+1000339us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:17:59.507692 (+269167us) raft_consensus.cc:1685] finished
0709 13:17:59.507716 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.512502 (+  4786us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4614,"raft.queue_time_us":5084,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7310,"spinlock_wait_cycles":39554304,"thread_start_us":127065,"threads_started":1,"wal-append.queue_time_us":161755}
I20260709 13:17:59.507917 14453 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:59.528510 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 101360us
I20260709 13:17:59.530256 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.511970 14804 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:17:59.521004 14789 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:59.538810 10107 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:59.536350 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:17:59.521922 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 474915us
I20260709 13:17:59.468520 14733 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.562956 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.517843 14768 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:17:59.523533 14879 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:59.580534 14910 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:59.667666 10115 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:59.581147 14341 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:59.581743 14804 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.668922 14341 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.670068 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.585850 14711 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.559998 14703 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:59.671384 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 126254us
I20260709 13:17:59.671804 14711 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:59.672186 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:59.672951 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:17:59.546737 14916 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.673820 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:59.674139 14916 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:59.544623 14723 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.674528 14685 raft_consensus.cc:2764] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:59.531415 14814 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:59.675652 14814 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:59.676152 14814 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:17:59.677129 14820 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:59.677572 14740 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:59.678251 10711 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:17:59.678584 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:17:59.595041 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
W20260709 13:17:59.683332 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 89474.5us
I20260709 13:17:59.686915 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.564172 14927 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.560055 14411 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:17:59.757793 14411 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:59.757515 14927 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.758373 14411 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.760600 14411 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:59.645123 14453 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.586413 14864 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:17:59.661167 14598 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.763988 14598 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.688582 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:17:59.765209 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 76715.3us
I20260709 13:17:59.766021 14615 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:59.766487 14615 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:59.766834 14615 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.771246 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.771945 10186 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.763906 14927 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.779838 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.781613 10182 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:59.779899 10184 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:59.784066 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:17:59.781915 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 95089us
I20260709 13:17:59.785351 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.784698 10185 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:17:59.788424 14720 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:59.671190 14341 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:59.695364 14930 raft_consensus.cc:2764] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:59.701756 14871 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:59.695144 14711 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:17:59.678013 14740 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.792289 14740 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.790753 14720 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:17:59.695555 14809 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.797093 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:17:59.797430 14809 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.677424 14703 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.710917 14928 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.798128 14703 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.674583 14916 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.802528 10183 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:59.803551 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:17:59.804345 10183 raft_consensus.cc:2410] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:17:59.541716 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:59.726773 10112 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:59.727439 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:17:59.805339 10180 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:59.791996 14871 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:17:59.806208 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 264567us
I20260709 13:17:59.721735 14721 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.807125 14721 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.806923 14871 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.735442 14567 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:17:59.813406 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:17:59.823925 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.737347 10113 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:59.723356 14789 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.788610 14785 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:59.789727 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.807583 14453 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.808452 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.809522 14885 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:59.810177 14864 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:17:59.811110 14763 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.677023 14814 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:17:59.727762 10682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.057s	sys 0.056s
W20260709 13:17:59.787952 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 207769us
W20260709 13:17:59.872378 10682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.058s	sys 0.056s
I20260709 13:17:59.872730 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.814433 10186 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:17:59.825739 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 79857.7us
I20260709 13:17:59.827960 14809 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.824646 10187 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:59.828650 10189 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:59.836933 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47292.4us
I20260709 13:17:59.879292 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:17:59.872763 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 1.12084e+06us
W20260709 13:17:59.838411 14744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.026s	sys 0.053s
I20260709 13:17:59.859915 14848 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:17:59.783921 14800 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:59.783608 14598 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:17:59.824532 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:17:59.875815 10107 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:59.836072 14411 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.885700 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.886029 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.882673 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:17:59.892365 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 67900.4us
I20260709 13:17:59.839052 14490 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:59.838358 14453 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:17:59.883955 14744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.027s	sys 0.053s
I20260709 13:17:59.798352 14928 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.883993 14809 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.909099 10033 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:59.887666 14814 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:59.910684 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:59.951122 10038 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:59.952013 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1759) took 1094 ms. Trace:
I20260709 13:17:59.952404 10188 rpcz_store.cc:276] 0709 13:17:58.857426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.862381 (+  4955us) service_pool.cc:224] Handling call
0709 13:17:59.951854 (+1089473us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002ac6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:17:59.951953 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330653952}
I20260709 13:17:59.912797 10187 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:17:59.914819 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:59.902354 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:59.951143 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:17:59.955041 10035 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:17:59.906756 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:17:59.836447 14567 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:17:59.909874 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:59.921202 14809 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.871464 14909 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:59.891592 14598 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.919660 14800 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.887873 14411 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.896867 14861 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:59.877660 14762 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:17:59.933275 10710 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:59.968986 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:17:59.898958 14879 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:17:59.914191 14453 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.904184 14804 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:59.947669 14789 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:17:59.894534 14848 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.876170 14763 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.956871 10034 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:17:59.960605 10037 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:59.873845 14864 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:17:59.961758 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:17:59.898977 14933 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:59.950973 14341 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:59.919204 14900 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:59.934334 10716 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:59.973235 10033 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
W20260709 13:17:59.983471 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.961125 14744 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:17:59.996126 14910 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.022589 10707 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:59.956770 14418 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.971829 14411 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:00.008694 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47036.7us
I20260709 13:18:00.025928 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.027530 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.028525 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.028777 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:17:59.988071 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2773) took 1023 ms. Trace:
I20260709 13:18:00.029592 10038 rpcz_store.cc:276] 0709 13:17:58.964997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.965551 (+   554us) service_pool.cc:224] Handling call
0709 13:17:58.965888 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.951554 (+985666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.987753 (+ 36199us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54002765d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:17:59.987999 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265225984}
I20260709 13:18:00.012854 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:00.020346  9935 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 185) took 20468 ms (client timeout 15000 ms). Trace:
I20260709 13:18:00.022482 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:00.009732 14855 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:17:59.974908 14800 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.032513 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:00.034742 14832 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:00.034984 14934 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:00.011301 14341 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:00.041258 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:00.041257 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:00.035704 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 150076us
I20260709 13:18:00.033891 14662 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.004078 14820 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:17:59.997810 14703 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.013561 14822 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:00.045615 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 152012us
I20260709 13:18:00.053763 14822 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:00.054359 14822 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.044732 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.060246 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.042590 14341 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.071000 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:00.072783 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.038808 14832 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:00.030462 14418 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.078702 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.042467 14855 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:00.031443  9935 rpcz_store.cc:269] 0709 13:17:39.591477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.595531 (+  4054us) service_pool.cc:224] Handling call
0709 13:18:00.020239 (+20424708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:54.072792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:54.073453 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:54.073502 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:17:54.073519 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:54.075061 (+  1542us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:54.075155 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:54.075182 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:17:54.329079 (+253897us) tablet.cc:701] Row locks acquired
0709 13:17:54.329123 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:17:54.329338 (+   215us) write_op.cc:270] Start()
0709 13:17:54.329513 (+   175us) write_op.cc:276] Timestamp: P: 1783603074329267 usec, L: 0
0709 13:17:54.329551 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:17:54.330291 (+   740us) log.cc:844] Serialized 7174 byte log entry
0709 13:17:54.902014 (+571723us) op_driver.cc:464] REPLICATION: finished
0709 13:17:55.239143 (+337129us) write_op.cc:301] APPLY: starting
0709 13:17:55.239291 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:55.860989 (+621698us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:55.866446 (+  5457us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:55.954199 (+ 87753us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e532a 00007f3c6f46af14 00007f3c6f46aec3 00007f3c6f46ae38 00007f3c6f46adf3 00007f3c6f46a0dc 00007f3c6f493e16 00007f3c6f47bcbb 00007f3c6f46639d 00007f3c6f469d75
0709 13:17:56.114865 (+160666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:56.115250 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 13:17:56.115317 (+    67us) write_op.cc:312] APPLY: finished
0709 13:17:56.137322 (+ 22005us) log.cc:844] Serialized 164 byte log entry
0709 13:17:56.220800 (+ 83478us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6c3de0ac 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b
0709 13:17:56.412519 (+191719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.412725 (+   206us) write_op.cc:454] Released schema lock
0709 13:17:56.412808 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:56.413322 (+   514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.413351 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2566670,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":222224,"apply.run_cpu_time_us":46420,"apply.run_wall_time_us":1213368,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79259,"num_ops":18,"prepare.queue_time_us":91251,"prepare.run_cpu_time_us":19432,"prepare.run_wall_time_us":426270,"raft.queue_time_us":192220,"raft.run_cpu_time_us":55887,"raft.run_wall_time_us":1090439,"replication_time_us":556204,"spinlock_wait_cycles":14577920,"thread_start_us":673614,"threads_started":5,"wal-append.queue_time_us":516171,"wal-append.run_cpu_time_us":42434,"wal-append.run_wall_time_us":2412651}]]}
I20260709 13:18:00.085836 10033 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:00.031014 14723 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.087829 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.089241 10183 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:00.091914 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.096758 10182 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:00.097777 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.081826 14916 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.099766 10039 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:00.100970 14916 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:00.101722 14936 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:18:00.080446 14832 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.074242 14785 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.092063 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.103084 14703 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.105548 14785 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:00.111089 14935 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:18:00.079720 14503 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:00.111898 14943 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.119562 14947 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.120151 14947 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.121021 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.121672 10031 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:00.122393 14947 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.124558 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:00.094317 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 208375us
I20260709 13:18:00.061674 14900 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.129477 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:00.131852 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.133278 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.083729 14855 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:00.135092 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.119234 14740 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.136914 10186 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:00.128563 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:00.131843 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 174397us
I20260709 13:18:00.074345 14862 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:00.139729 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:00.160557 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:00.164106 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.172746 10106 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:00.112614 14896 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:00.173301 10707 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:00.132718 14763 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.136960 14855 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:00.140079 14924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.010s
I20260709 13:18:00.181558 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.183097 10186 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:18:00.172827 14946 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:00.185133 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.165184 14947 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:00.192623 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:00.173010 14900 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:00.173566 14933 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.176913 14928 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.183876 14848 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.179019 14567 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.187885 14943 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.180794 14804 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.194692 14785 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:00.203452 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 243502us
W20260709 13:18:00.186172 14924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.014s	sys 0.010s
I20260709 13:18:00.186005 14946 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.173420 14861 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:00.193665 14896 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:00.192241 14703 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.179260 14615 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.223305 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:00.198876 14598 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:00.227074 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87461.8us
I20260709 13:18:00.227895 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.206779 14931 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.207643 14864 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:00.234277 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49217.6us
I20260709 13:18:00.234633 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.266265 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.265020 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.264184 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.224403 14948 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:00.227761 14920 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:18:00.278226 10031 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:00.228480 14946 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.278924 14418 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.281669 14944 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:00.283488 14822 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.231099 14790 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:00.231102 14800 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:00.301293 14958 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.301990 14958 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.309845 14615 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.310913 14615 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:00.312465 14615 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:00.317914 14958 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.318822 14958 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:00.320785 14861 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.322566 14832 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.299005 14411 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.326009 14411 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.327991 14615 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:00.270486 14938 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
I20260709 13:18:00.263288 14804 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.359982 14804 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.360546 14804 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.361066 14800 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:00.361364 14809 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.365502 10708 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:00.263681 14931 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.226287 14933 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:18:00.228263 14768 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:18:00.338207 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52438.1us
I20260709 13:18:00.285022 14785 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.290311 14948 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:00.342988 10184 pending_rounds.cc:85] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 10
I20260709 13:18:00.290799 14944 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:00.231630 14896 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:00.329197 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.361603 14800 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.375730 14453 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.360635 14740 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.369115 14822 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.368046 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.388397 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:00.397037 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.400158 10184 pending_rounds.cc:107] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:18:00.403928 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.387428 14931 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.410633 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:00.217088 14943 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.410279 10184 raft_consensus.cc:2889] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:00.412565 10034 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.416553 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.417799 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.418306 14933 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:00.418952 14598 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:00.419384 14933 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:00.419560 14567 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:00.420331 14933 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.401820 14944 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.428879 14800 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:00.429476 14943 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:00.430449 14809 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.402194 14948 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.434959 10035 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:00.408733 14953 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:00.451083 10183 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:00.403051 14785 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.403033 14341 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.447248 14953 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:00.495391 10040 raft_consensus.cc:2410] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:00.517757 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.488518 14842 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.521502 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:00.521165 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81039.1us
I20260709 13:18:00.524180 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:00.526777 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.448889 14896 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.529421 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.530480 14703 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.530800 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:00.520896 14598 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:00.528463 14832 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:00.529175 14498 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:18:00.539960 14896 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:00.544322 14453 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.544404 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.525950 14946 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.552513 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.553769 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.554198 14946 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.563617 10032 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:00.541446 14953 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.576275 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.577673 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.578814 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.580840 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.593047 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.594388 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.528055 14842 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.596174 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.596413 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.600828 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.602321 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.599890 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.604061 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.604568 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.605302 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.606004 10107 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:00.607174 10114 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:00.606766 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 347741us
I20260709 13:18:00.608090 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.608971 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.609503 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.610284 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.611016 10113 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:00.608942 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.614046 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.615728 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.617414 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.618263 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:00.620362 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.621840 10707 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:00.596127 14953 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.624532 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.633397 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:00.630389 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.642752 10113 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:00.634334 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.633972 10109 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:00.635059 10114 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 9: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:00.647523 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.609553 14341 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.609298 14490 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.609088 14814 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.612892 14498 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.603194 14967 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:18:00.623979 14943 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:00.660117 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 396018us
I20260709 13:18:00.662252 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.624459 14832 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:00.666399 14948 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.609349 14615 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:18:00.693825 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:00.634953 14910 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.618793 14855 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.644981 14800 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.708437 14975 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:18:00.650743 14703 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.737140 14721 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:00.731861 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.743525 14721 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:00.744688 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:00.631953 14598 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.735155 14615 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:00.735915 14800 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.731914 14871 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.724071 14785 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.708916 14498 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:00.729880 14503 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.600s	user 0.017s	sys 0.003s
I20260709 13:18:00.661506 14933 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:00.772398 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78703.9us
I20260709 13:18:00.774434 10034 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:00.776753 10034 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:00.727016 14931 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.787834 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.784936 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:18:00.798576 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 173358us
I20260709 13:18:00.763188 14615 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:00.800141 10716 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:00.771783 14958 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.783179 14503 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.789220 14824 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:00.810267 10707 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:00.810024 10034 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:00.811997 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.810712 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:00.812649 10181 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:00.739691 14804 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:00.814965 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.820830 14909 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:00.821441 14909 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:00.822324 14909 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.825366 14498 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.836220 10185 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.836905 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:00.837193 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:00.837767 10710 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:00.837781 10108 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:00.840682 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.843015 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.843735 10186 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:00.846063 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:00.851080 10187 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:18:00.856328 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 208858us
I20260709 13:18:00.872865 10710 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:00.857564 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.801771 14789 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:00.821326 14800 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:00.921445 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:00.742262 14944 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:00.919797 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:00.951514 10189 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
W20260709 13:18:00.952581 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 167724us
W20260709 13:18:00.970718 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 113224us
I20260709 13:18:00.971632 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.836293 14820 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.835855 14824 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:00.790555 14721 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.973980 10188 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:00.981848 10185 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:00.813406 14958 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:00.857299 14809 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.972911 10004 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.978905 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:00.986805 10186 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:00.989636 10716 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:00.989997 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:00.994081 10033 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:00.939991 14972 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.975596 14933 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.976346 14720 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:00.984237 14948 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.987329 14615 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.004994 14983 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:00.996620 14973 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:01.051973 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 129548us
W20260709 13:18:01.051945 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 75962.2us
I20260709 13:18:01.000679 14842 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:00.993654 14809 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:01.061162 14979 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:18:01.053442 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:18:01.112679 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59311.7us
I20260709 13:18:01.113729 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:01.040120 14720 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.074153 14855 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.122448 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:00.986088 14820 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.041265 14800 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.088909 14944 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.091442 14809 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.093946 14931 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.095079 14804 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:01.130329 14994 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:01.151719 14994 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.152159 14994 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.153077 14820 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.120440 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.133944 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.137075 10115 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:01.077811 14824 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.121910 14997 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:01.146957 14800 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.142740 14953 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.130918 14503 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.184912 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:01.183092 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.184399 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.130558 14685 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:01.188129 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.188865 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:01.191351 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58982.4us
I20260709 13:18:01.192005 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.192320 10180 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:01.194767 10187 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:01.198045 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.194231 14744 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.190922 14685 consensus_queue.cc:1243] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:01.198808 14453 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.229118 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2176) took 1276 ms. Trace:
I20260709 13:18:01.229681 10035 rpcz_store.cc:276] 0709 13:17:59.953011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.957146 (+  4135us) service_pool.cc:224] Handling call
0709 13:17:59.957451 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.437223 (+479772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.228804 (+791581us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400412154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:01.229044 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097745792}
I20260709 13:18:01.205483 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:01.205595 10184 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:01.188282 14503 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.233618 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:01.237010 14411 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:01.237011 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.238446 14997 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.238982 14997 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.233479 14804 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.242112 10184 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:01.242262 14804 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:01.234133 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.244356 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:01.245680 15000 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:01.247010 14896 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:01.247480 14896 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:01.247898 14896 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.250545 14785 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:01.204304 14958 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.252640 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:01.253434 10711 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:01.256086 14924 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:01.256564 14924 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:01.212565 14720 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.213759 14789 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.250957 15001 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:18:01.237568 14411 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:01.208029 14998 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:01.269618 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.284847 10106 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:01.272596 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:01.291550 10106 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:01.234328 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:01.280058 10709 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:01.268622 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:01.280655 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:01.294265 10180 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:18:01.261405 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:01.270680 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:01.268280 15002 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.309314 14973 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:01.310366 14973 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:01.320369 14453 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:01.320828 14453 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:01.321681 14453 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.323123 14453 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.299597 14910 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:18:01.280107 14855 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:01.271457 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:01.271575 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.272236 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.281925 10184 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:01.270908 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.270253 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.281306 14785 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.296877 14814 consensus_meta.cc:287] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.013s
I20260709 13:18:01.334846 10184 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:01.339735 14855 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:01.341707 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 556566us
I20260709 13:18:01.342801 14855 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.343220 14931 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:01.328909 15002 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.344280 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 760) took 1444 ms. Trace:
I20260709 13:18:01.257402 14924 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.345928 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:01.283897 14789 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.354923 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:01.355276 15009 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.356135 15009 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.356307 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:01.356629 15009 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.357685 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:01.358824 15009 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:01.359203 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 97156.2us
W20260709 13:18:01.360169 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.361022 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.298059 15003 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:01.344679 10036 rpcz_store.cc:276] 0709 13:17:59.900397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.901943 (+  1546us) service_pool.cc:224] Handling call
0709 13:17:59.949244 (+ 47301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.001795 (+ 52551us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:00.199815 (+198020us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.442136 (+242321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.442196 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:00.442244 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.344044 (+901800us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54000654d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:01.344095 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.344218 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28898,"prepare.queue_time_us":277592,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":34846,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5250,"spinlock_wait_cycles":120274688,"thread_start_us":388058,"threads_started":2,"wal-append.queue_time_us":264018}
I20260709 13:18:01.367573 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:01.373728 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83294.1us
I20260709 13:18:01.374325 10110 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:01.375097 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.390653 14800 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.287060 14998 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.344758 14814 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.363252 14685 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.372318 15003 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.402526 14855 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:01.408694 14855 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.409054 14789 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.409919 15003 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.372855 14910 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:01.410821 14855 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.411700 14910 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:01.412767 10113 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:01.346450 14785 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.405375 14744 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.401136 14871 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:01.378394 15009 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.440366 10180 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:01.443002 10183 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.437966 14871 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:01.448642 14871 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.452632 15002 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.453976 14998 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.458237 15009 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.458817 15009 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.365388 14411 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.476719 14744 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:01.468879 14975 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.001s	sys 0.004s
I20260709 13:18:01.442992 14740 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:01.430153 14685 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.492205 14685 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.495121 14453 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:01.496966 15009 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:01.486742 14975 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.001s	sys 0.004s
I20260709 13:18:01.506335 10183 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:01.480015 14503 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:01.471338 14814 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 13:18:01.508479 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 102655us
I20260709 13:18:01.500411 14740 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.521313 14785 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:01.530962 14814 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:01.531450 14814 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:01.503854 14800 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.532069 14800 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.532408 14814 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.533697 14814 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.534399 14800 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:01.499446 14994 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.536533 10111 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:01.537467 14994 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:01.573494 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.614506 14685 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:01.615180 14685 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.624987 14740 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.627296 14685 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.630686 14896 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.636899 10182 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:01.637946 14896 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:01.649147 14685 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:01.676414 14685 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:01.690702 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 163497us
I20260709 13:18:01.692022 14952 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:01.692489 14952 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:01.685084 15012 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:18:01.693697 14685 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.693393 14952 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.639339 14598 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:01.699735 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:01.700701 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1968) took 1099 ms. Trace:
I20260709 13:18:01.701043 10112 rpcz_store.cc:276] 0709 13:18:00.601386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.611485 (+ 10099us) service_pool.cc:224] Handling call
0709 13:18:01.699601 (+1088116us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:18:01.700627 (+  1026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306496}
I20260709 13:18:01.703703 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:01.704531 10187 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
W20260709 13:18:01.704169 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 302732us
I20260709 13:18:01.715325 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:01.718859 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.720467 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.730036 10153 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:01.734437 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.735100 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.735294 10106 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:01.735875 10114 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:01.736865 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.736729 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:01.738039 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.738677 10114 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:01.739655 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.740370 10108 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:18:01.741791 10112 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:01.743079 15020 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.744120 15020 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.755402 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:01.756639 15007 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:01.757138 15007 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.757489 15007 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.768218 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:01.769345 15010 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:01.769806 15010 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:01.809085 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:01.810578 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:01.817713 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:01.701237 14723 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.707540 14744 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:01.822815 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:01.714118 14896 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:01.776556 14503 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:01.817077 14662 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.822506 15009 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:01.838042 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 60964.7us
I20260709 13:18:01.840265 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:01.836975 14503 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:01.832234 15027 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.833961 14785 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:18:01.832700 14744 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.770663 15010 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.839620 15009 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.848369 10708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 946) took 1707 ms. Trace:
I20260709 13:18:01.777024 14933 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:18:01.836197 15016 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:01.860877 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.826107 14960 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:01.850883 14503 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.824954 14723 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.863025 10708 rpcz_store.cc:276] 0709 13:18:00.140852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.141021 (+   169us) service_pool.cc:224] Handling call
0709 13:18:00.141357 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.385795 (+244438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.848092 (+1462297us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400484754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:01.848302 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515036416}
I20260709 13:18:01.833796 14896 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.907709 14896 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:01.848994 14662 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:01.908975 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.909742 10112 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:01.910292 14662 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.911432 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:01.911470 14960 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:01.912712 14960 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:01.913571 14960 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.914824 14960 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.917215 14933 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:01.917654 14933 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:01.918567 14933 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:01.921325 14744 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.865561 15009 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.865298 15023 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.869652 15016 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.915587 15020 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.986632 14723 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:01.929415 14896 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:01.989367 14896 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:01.992807 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:01.965384 14785 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:01.998180 14785 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:01.998637 14785 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.971642 15020 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:02.003119 15016 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:01.969627 15031 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:18:01.969712 15028 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:18:02.183197 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.137578 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.197976 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:02.200692 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:02.200045 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.204916 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:02.019438 14871 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.006s
I20260709 13:18:01.991665 14896 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.284938 14723 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.274360 14567 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:02.285861 14948 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:02.274149 14744 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:02.177393 14418 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.372638 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.003s
W20260709 13:18:02.373029 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.011s	sys 0.003s
I20260709 13:18:02.355099 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.325187 10036 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:18:02.373651 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 533493us
I20260709 13:18:02.380162 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.395579 10114 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:02.395633 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:02.003131 15020 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.402662 10034 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:18:02.405079 10114 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:02.124298 14503 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:02.417205 10186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.044s	sys 0.086s
I20260709 13:18:02.425455 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 767) took 2519 ms. Trace:
W20260709 13:18:02.425384 10186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.045s	sys 0.087s
I20260709 13:18:02.373629 14930 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:02.429301 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1015) took 1075 ms. Trace:
I20260709 13:18:02.426936 10040 rpcz_store.cc:276] 0709 13:17:59.906284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.907318 (+  1034us) service_pool.cc:224] Handling call
0709 13:18:02.420940 (+2513622us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540031ddd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.425363 (+  4423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220309376}
I20260709 13:18:02.331151 14948 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:01.992880 15007 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.442006 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:02.442186 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2194) took 1987 ms (client timeout 2590 ms). Trace:
W20260709 13:18:02.443005 10187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.048s	sys 0.119s
W20260709 13:18:02.442644 10032 rpcz_store.cc:269] 0709 13:18:00.454963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.530565 (+ 75602us) service_pool.cc:224] Handling call
0709 13:18:02.441968 (+1911403us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b54002779d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.442125 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71297280}
W20260709 13:18:02.443459 10187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.048s	sys 0.119s
W20260709 13:18:02.446059 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.432014 10186 rpcz_store.cc:276] 0709 13:18:01.353693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.717887 (+364194us) service_pool.cc:224] Handling call
0709 13:18:01.718221 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.718436 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:01.718674 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.428922 (+710248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.428984 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:02.429034 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.429104 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.429238 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7724,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":11487,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9301,"thread_start_us":709728,"threads_started":2,"wal-append.queue_time_us":184572}
I20260709 13:18:02.447376 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.322995 14871 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.324039 14723 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.450498 10032 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
I20260709 13:18:02.435834 14948 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.452996 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.330248 14567 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.331884 14744 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.460974 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.405844 14418 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.476356 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.450940 14800 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:02.472992 10037 raft_consensus.cc:2410] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:02.477880 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:02.481720 10034 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:18:02.452639 15024 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.020s
I20260709 13:18:02.490253 15016 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.491285 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:02.497138 14503 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.499200 14723 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.502195 14418 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:02.504988 14871 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:02.437636 14930 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.510130 14916 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:02.513151 14960 consensus_meta.cc:287] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.004s
I20260709 13:18:02.514264 15041 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.519073 14567 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:02.534735 15033 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 13:18:02.473906 14896 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:02.556223 10003 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.879s (SENT) [suppressed 16 similar messages]
I20260709 13:18:02.519065 14453 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:02.566380 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.567049 10031 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
W20260709 13:18:02.546051 15024 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.003s	sys 0.020s
W20260709 13:18:02.576092 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.574661 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.553960 14916 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.561446 14567 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.613564 15016 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.614274 14916 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:02.559757 15041 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.646378 15020 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:02.648712 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:02.649051 10109 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:02.649951 15037 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:18:02.653548 14981 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:02.572574 14453 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.648747 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3010) took 1378 ms. Trace:
I20260709 13:18:02.669607 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2787) took 2135 ms. Trace:
I20260709 13:18:02.653434 14662 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:02.675242 10111 rpcz_store.cc:276] 0709 13:18:01.269905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.270025 (+   120us) service_pool.cc:224] Handling call
0709 13:18:02.648476 (+1378451us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540004a6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.648657 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466330368}
I20260709 13:18:02.675346 10033 rpcz_store.cc:276] 0709 13:18:00.534483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.805669 (+271186us) service_pool.cc:224] Handling call
0709 13:18:00.812115 (+  6446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.994609 (+182494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.669302 (+1674693us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540031e2d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:02.669532 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417969536}
I20260709 13:18:02.632332 15036 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:02.640199 15045 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:02.670115 14931 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:18:02.670907 14763 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.637094 14567 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.567968 14896 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:02.688480 15035 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:18:02.695667 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:02.697275 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.699723 10032 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:18:02.702853 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 871) took 1935 ms. Trace:
I20260709 13:18:02.703995 10031 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:02.703261 10707 rpcz_store.cc:276] 0709 13:18:00.767333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.767572 (+   239us) service_pool.cc:224] Handling call
0709 13:18:00.767962 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.810699 (+ 42737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.702558 (+1891859us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b54006be254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:02.702776 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96726912}
I20260709 13:18:02.682493 14662 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.679193 14981 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.693169 15007 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.730672 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:02.732990 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:02.684913 15036 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:02.738350 10004 leader_election.cc:336] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.537s (SENT)
I20260709 13:18:02.744055 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:02.744707 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:02.706103 15046 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:02.734481 10114 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:02.735863 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.733850 10106 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:18:02.750972 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:02.760973 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.709897 15042 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:02.764647 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:02.750771 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:02.768493 10114 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:02.773084 14997 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:02.774187 15049 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:02.747252 15007 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:18:02.778394 15007 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:02.778939 15007 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:02.729795 14744 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:02.694533 15045 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.803552 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:02.782055 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1957) took 2187 ms (client timeout 1537 ms). Trace:
I20260709 13:18:02.781920 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1795) took 1936 ms. Trace:
I20260709 13:18:02.784353 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 771) took 2425 ms. Trace:
W20260709 13:18:02.804679 10115 rpcz_store.cc:269] 0709 13:18:00.594477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.595612 (+  1135us) service_pool.cc:224] Handling call
0709 13:18:02.781876 (+2186264us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400362754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.781981 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193448832}
I20260709 13:18:02.805174 10039 rpcz_store.cc:276] 0709 13:18:00.358783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.745636 (+386853us) service_pool.cc:224] Handling call
0709 13:18:00.745983 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.796251 (+ 50268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.796280 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.800693 (+  4413us) log.cc:844] Serialized 26 byte log entry
0709 13:18:00.991362 (+190669us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:00.991404 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.783948 (+1792544us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b5400411c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:02.784000 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.784064 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:02.784075 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.784293 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1154,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10039,"spinlock_wait_cycles":93080448,"thread_start_us":172861,"threads_started":1,"wal-append.queue_time_us":254710,"wal-append.run_cpu_time_us":11766,"wal-append.run_wall_time_us":1026744}
I20260709 13:18:02.799702 10707 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:02.780946 15016 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:02.804819 10183 rpcz_store.cc:276] 0709 13:18:00.845631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.845763 (+   132us) service_pool.cc:224] Handling call
0709 13:18:02.781731 (+1935968us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54003f11d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.781855 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371234688}
I20260709 13:18:02.781584 14801 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:02.812937 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.813024 14801 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:02.813594 10039 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:02.765965 14930 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:02.834134 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 277978us
I20260709 13:18:02.781062 15007 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:02.877993 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.767256 15046 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:02.887928 15039 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:18:02.890057 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2269) took 1514 ms. Trace:
I20260709 13:18:02.890470 10187 rpcz_store.cc:276] 0709 13:18:01.375670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.724690 (+349020us) service_pool.cc:224] Handling call
0709 13:18:01.725007 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.770193 (+ 45186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.770225 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.770722 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.443962 (+673240us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.444003 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.444083 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.889852 (+445769us) raft_consensus.cc:1685] finished
0709 13:18:02.889872 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.889999 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44008,"raft.queue_time_us":44555,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":630999,"threads_started":1,"wal-append.queue_time_us":796345}
I20260709 13:18:02.814055 14801 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.896548 14801 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.816095 15016 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:02.898924 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.899605 10035 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:02.900537 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:02.904387 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 246569us
I20260709 13:18:02.927383 15050 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.928161 15050 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.819837 15048 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:02.958413 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.817853 14916 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:18:02.964675 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.796396 15042 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:02.889988 15046 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.968111 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:02.972594 10036 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:02.819411 15040 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:18:02.887988 15007 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:02.973982 15007 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:02.975694 10185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 2247) took 2648 ms (client timeout 1879 ms). Trace:
I20260709 13:18:02.976146 15007 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:02.977267 10186 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:02.904301 15047 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.976161 10185 rpcz_store.cc:269] 0709 13:18:00.327121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.328926 (+  1805us) service_pool.cc:224] Handling call
0709 13:18:02.975491 (+2646565us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54002d32d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.975596 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997977344}
W20260709 13:18:02.990530 10110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 1975) took 1730 ms (client timeout 1779 ms). Trace:
W20260709 13:18:02.996327 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.999826 10110 rpcz_store.cc:269] 0709 13:18:01.259826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.261165 (+  1339us) service_pool.cc:224] Handling call
0709 13:18:02.990316 (+1729151us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b54002b8c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:02.990457 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111234304}
I20260709 13:18:02.959534 14453 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:02.991235 10035 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
W20260709 13:18:03.005688 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 345431us
W20260709 13:18:02.971894 15049 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:18:02.980135 15009 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.049s	user 0.006s	sys 0.007s
I20260709 13:18:02.971069 15038 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.010609 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.002s	sys 0.019s
W20260709 13:18:03.019815 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.002s	sys 0.019s
W20260709 13:18:03.019368 10154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.014s
I20260709 13:18:03.020586 15051 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:03.020938 10154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.014s
I20260709 13:18:03.021347 15051 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.021284 15046 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:03.024338 15046 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.026541 15046 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.027168 15046 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:03.028208 15051 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.028905 15051 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.029445 15051 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.031765 15051 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.033139 15051 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.027678 15046 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:02.979267 15041 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:03.044683 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.100051 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.252960 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.114924 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 369116us
I20260709 13:18:03.014256 14567 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:03.188807 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 265513us
I20260709 13:18:03.054013 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:03.237123 14931 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:03.237505 14981 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.238103 15045 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.036873 14682 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.223s
I20260709 13:18:03.057479 14832 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:03.037477 14896 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.003213 15047 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.236851 14768 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:03.240051 14948 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.002s
I20260709 13:18:03.040732 15038 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.014937 15009 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.049758 15041 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:03.008936 15048 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:03.242215 15058 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.243534 10189 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:03.042188 15051 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.238566 14453 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.283970 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:03.298293 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:03.041831 15016 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.303022 14768 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.292457 14682 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:03.336642 14682 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.337239 15075 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:03.338445 15009 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.339102 14682 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.290581 14832 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.273020 14931 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:03.331156 15052 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:03.318631 15036 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.334532 15047 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.301229 15046 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.333060 15038 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.304384 14948 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.331036 15076 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:03.312467 15041 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.333086 14768 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.345295 14879 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.361461 14931 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.313145 15048 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.362984 14948 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.363152 14832 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.363827 15048 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.364169 15042 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.364980 15076 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.365691 15041 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.318533 15058 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.366518 15051 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.348354 14981 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:03.369412 14981 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:03.370327 14981 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.371886 14981 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.266233 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:03.246948 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.269840 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:03.254437 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.408663 10187 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:18:03.409641 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 139790us
I20260709 13:18:03.408882 10184 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:03.411834 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2270) took 1892 ms. Trace:
I20260709 13:18:03.412995 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.414230 10114 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:18:03.422591 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 368508us
I20260709 13:18:03.412345 10181 rpcz_store.cc:276] 0709 13:18:01.518866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.782388 (+1263522us) service_pool.cc:224] Handling call
0709 13:18:02.782757 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.783102 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.783132 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.783607 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.042495 (+258888us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:03.042541 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.235936 (+193395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.411263 (+175327us) raft_consensus.cc:1685] finished
0709 13:18:03.411305 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.411628 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99681,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":70365,"thread_start_us":258424,"threads_started":1,"wal-append.queue_time_us":565732}
I20260709 13:18:03.424855 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.425868 10189 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:18:03.405124 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 150535us
I20260709 13:18:03.426838 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:03.324119 14453 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.430594 14453 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.431308 14453 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:03.432049 10107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.009s
I20260709 13:18:03.438030 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:03.439347 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1808) took 1948 ms. Trace:
I20260709 13:18:03.440999 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:03.441687 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 952) took 1665 ms. Trace:
I20260709 13:18:03.446321 14930 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:03.448606 10184 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:03.449230 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:03.449537 10040 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:03.451519 14974 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:03.450167 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.460649 10186 rpcz_store.cc:276] 0709 13:18:01.490667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.544012 (+1053345us) service_pool.cc:224] Handling call
0709 13:18:02.977059 (+433047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.977662 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.438839 (+461177us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54002d32d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.439116 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995178240}
I20260709 13:18:03.479588 10081 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:03.481525 15041 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.461179 10711 rpcz_store.cc:276] 0709 13:18:01.776297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.776573 (+   276us) service_pool.cc:224] Handling call
0709 13:18:01.827329 (+ 50756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.985567 (+158238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.985602 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.986131 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.397442 (+411311us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:02.397483 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.440862 (+1043379us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003ce1d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:03.440938 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.441025 (+    87us) raft_consensus.cc:1685] finished
0709 13:18:03.441043 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.441451 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1177,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":362801920,"thread_start_us":410962,"threads_started":1,"wal-append.queue_time_us":528952}
I20260709 13:18:03.482542 15041 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.484467 15057 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:03.485100 15057 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:03.485561 15057 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:03.464447 14930 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.484350 14801 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:03.488447 14801 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.488953 14801 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:03.492331 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.488260 14930 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:03.479686 15079 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:03.496830 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1979) took 1973 ms. Trace:
I20260709 13:18:03.496520 15079 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.497280 10109 rpcz_store.cc:276] 0709 13:18:01.523581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.524771 (+  1190us) service_pool.cc:224] Handling call
0709 13:18:02.648828 (+1124057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.660945 (+ 12117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.496341 (+835396us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540004a6d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.496612 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584530176}
W20260709 13:18:03.498148 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.476487 10107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.005s	sys 0.009s
I20260709 13:18:03.499317 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.497752 15041 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.488232 14974 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.515205 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.504244 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.505164 10184 pending_rounds.cc:85] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 10
I20260709 13:18:03.505187 14917 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.505828 14924 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:03.506350 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.506870 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 66166.8us
I20260709 13:18:03.510625 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1012) took 2158 ms. Trace:
I20260709 13:18:03.512367 14685 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:03.512550 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1972) took 2906 ms. Trace:
I20260709 13:18:03.517030 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:03.677495 10180 rpcz_store.cc:276] 0709 13:18:01.352370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.444912 (+ 92542us) service_pool.cc:224] Handling call
0709 13:18:01.705479 (+260567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.714464 (+  8985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.714497 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.714998 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.931997 (+216999us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:01.932049 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.932128 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.748844 (+816716us) raft_consensus.cc:1685] finished
0709 13:18:02.748868 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.510055 (+761187us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400053a50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.510418 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12477,"raft.queue_time_us":9277,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9427,"spinlock_wait_cycles":598479232,"thread_start_us":99195,"threads_started":1,"wal-append.queue_time_us":464417}
I20260709 13:18:03.679987 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.680413 10186 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:03.531139 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.587699 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 89407.9us
I20260709 13:18:03.642768 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2271) took 2123 ms. Trace:
W20260709 13:18:03.606494 14785 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 1.437s	user 0.016s	sys 0.010s
I20260709 13:18:03.689222 14814 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:03.689059 14685 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.689657 14814 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:03.691072 14814 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.687556 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.693459 10186 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:03.675477 10184 pending_rounds.cc:107] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 13.11
W20260709 13:18:03.615615 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 166650us
I20260709 13:18:03.687346 14916 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:03.687068 14785 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.697921 15079 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.694371 10184 raft_consensus.cc:2889] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.699385 14916 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:03.703615 14916 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:03.705387 14785 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.705649 10187 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:03.683537 14974 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.682183 14453 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.709141 14453 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.717036 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.720391 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.725507 15034 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.304s	user 0.009s	sys 0.005s
I20260709 13:18:03.729091 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.729444 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.675863 10107 rpcz_store.cc:276] 0709 13:18:00.606372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.612151 (+  5779us) service_pool.cc:224] Handling call
0709 13:18:01.010583 (+398432us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:01.010794 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.012602 (+  1808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.012635 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.785253 (+1772618us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b2c000bbbd8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:18:02.806748 (+ 21495us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.511964 (+705216us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:03.512066 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.512200 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.512247 (+    47us) raft_consensus.cc:1685] finished
0709 13:18:03.512257 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.512453 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1427,"raft.queue_time_us":72684,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":73978112,"thread_start_us":628788,"threads_started":1,"wal-append.queue_time_us":546329}
I20260709 13:18:03.684082 10183 rpcz_store.cc:276] 0709 13:18:01.519570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.811484 (+1291914us) service_pool.cc:224] Handling call
0709 13:18:02.811837 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.812081 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:03.253620 (+441539us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.640435 (+386815us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.642041 (+  1606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.642115 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:03.642257 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.642351 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.642542 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":476263,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":150,"raft.queue_time_us":1623,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":344,"thread_start_us":813888,"threads_started":2}
I20260709 13:18:03.732843 10181 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 9.
W20260709 13:18:03.738898 10037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2204) took 1384 ms (client timeout 1833 ms). Trace:
W20260709 13:18:03.739494 10037 rpcz_store.cc:269] 0709 13:18:02.354689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.354833 (+   144us) service_pool.cc:224] Handling call
0709 13:18:03.738333 (+1383500us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b5400277ed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.738641 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208334208}
I20260709 13:18:03.746084 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1981) took 1358 ms. Trace:
I20260709 13:18:03.752226 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 753) took 1276 ms. Trace:
I20260709 13:18:03.752718 10713 rpcz_store.cc:276] 0709 13:18:02.406286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.406564 (+   278us) service_pool.cc:224] Handling call
0709 13:18:02.406888 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.407257 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.407287 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.407786 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.836935 (+429149us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:03.260245 (+423310us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.308692 (+ 48447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.308770 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.596374 (+287604us) raft_consensus.cc:1685] finished
0709 13:18:03.604465 (+  8091us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.682760 (+ 78295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":502605,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":74647,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":5429,"thread_start_us":810727,"threads_started":3,"wal-append.queue_time_us":590197}
I20260709 13:18:03.762269 10189 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:03.746583 10112 rpcz_store.cc:276] 0709 13:18:02.387543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.388240 (+   697us) service_pool.cc:224] Handling call
0709 13:18:02.388540 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.388907 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.388935 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.389406 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.554043 (+164637us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:02.809248 (+255205us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.745304 (+936056us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b54000f2e20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f463733 00007f3c6f4e8dbf 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c
0709 13:18:03.745401 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.745550 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.745627 (+    77us) raft_consensus.cc:1685] finished
0709 13:18:03.745722 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.745909 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133886,"prepare.queue_time_us":776530,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":239657,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":9255,"spinlock_wait_cycles":13897984,"thread_start_us":405092,"threads_started":2,"wal-append.queue_time_us":304843}
I20260709 13:18:03.765520 14685 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.779940 14933 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:03.767688 10034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2210) took 1315 ms (client timeout 1624 ms). Trace:
I20260709 13:18:03.771821 14998 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:03.773031 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:03.773591 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:03.776549 14930 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.776993 14993 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.777601 14928 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:03.782845 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.786283 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:03.786955 14998 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:03.781457 10034 rpcz_store.cc:269] 0709 13:18:02.452519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.452736 (+   217us) service_pool.cc:224] Handling call
0709 13:18:03.767224 (+1314488us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5400042254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.767444 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48890624}
I20260709 13:18:03.791208 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:03.792069 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:03.790012 14928 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:03.800040 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.802103 14928 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.789829 14993 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.810040 14997 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.810564 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.810416 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:03.816028 15079 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.817589 15079 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.818595 14993 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.819111 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1017) took 2405 ms. Trace:
I20260709 13:18:03.819845 15079 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.820713 14952 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.821918 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 1982) took 1433 ms. Trace:
I20260709 13:18:03.822336 10108 rpcz_store.cc:276] 0709 13:18:02.387890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.387999 (+   109us) service_pool.cc:224] Handling call
0709 13:18:03.820200 (+1432201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.820526 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.820557 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.820619 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:03.820649 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.820728 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.821611 (+   883us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540038f4d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.821742 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292920064}
I20260709 13:18:03.829819 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:03.830138 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:03.830693 10037 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.831344 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:03.828883 14998 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.832230 10040 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:03.834036 10032 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:03.835485 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.819921 10113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3012) took 2548 ms (client timeout 1811 ms). Trace:
I20260709 13:18:03.839949 15075 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.840268 15040 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.841396 15040 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.844344 15050 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.840646 15075 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.845616 15040 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:03.840276 10113 rpcz_store.cc:269] 0709 13:18:01.271228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.271350 (+   122us) service_pool.cc:224] Handling call
0709 13:18:03.819468 (+2548118us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b540038f4d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.819680 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184277248}
I20260709 13:18:03.848579 10187 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:03.811550 14997 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:03.850843 14997 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:03.844197 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70860.3us
I20260709 13:18:03.851974 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:03.819464 10188 rpcz_store.cc:276] 0709 13:18:01.413961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.536087 (+1122126us) service_pool.cc:224] Handling call
0709 13:18:02.536469 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.709645 (+173176us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:03.051563 (+341918us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.268203 (+216640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.268266 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:03.268317 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.818638 (+550321us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400052154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:03.818717 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.818935 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560783,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6037,"raft.queue_time_us":37998,"spinlock_wait_cycles":411816064,"thread_start_us":525128,"threads_started":2,"wal-append.queue_time_us":287639}
I20260709 13:18:03.854473 14975 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:03.854938 14998 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:03.860433 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1800) took 2667 ms. Trace:
I20260709 13:18:03.862571 14662 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:03.864853 14800 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:03.847470 15075 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.885609  9938 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.882045 14975 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:03.882453 15079 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.882720 15045 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:03.886024 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.887364 15041 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:03.939962 15045 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.940642 15041 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.942668 15045 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:03.892539 15042 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.944139 15042 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.944244 14975 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.946429 15042 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.892527 10189 raft_consensus.cc:2376] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12. Re-sending same reply.
I20260709 13:18:03.899048 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.899199 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2214) took 1325 ms. Trace:
I20260709 13:18:03.947929 10031 rpcz_store.cc:276] 0709 13:18:02.574132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.574334 (+   202us) service_pool.cc:224] Handling call
0709 13:18:03.898816 (+1324482us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540031bad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:03.899023 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291446016}
I20260709 13:18:03.949798 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.938071 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:03.951081 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.951851 10189 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:03.952751 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.953214 14920 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.953855 14920 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.955242 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.955389 15041 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:03.903796 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.891319 15094 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:03.905442 14721 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.968570 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:03.966269 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.971889 14804 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:03.906737 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.973990 15016 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.974716 14804 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.885739 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:03.909952 14948 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:03.849651 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.910540 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 190837us
I20260709 13:18:03.811055 15057 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.876909 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:03.923954 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46620.4us
I20260709 13:18:03.924744 10182 rpcz_store.cc:276] 0709 13:18:01.192710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.330892 (+138182us) service_pool.cc:224] Handling call
0709 13:18:01.364094 (+ 33202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.637319 (+273225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.859976 (+2222657us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002d9bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:03.860255 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626911488}
I20260709 13:18:03.981201 14948 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.006073 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.007002 10186 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:04.008189 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.008682 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.009205 10185 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:03.950111 14814 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.937918 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:03.938647 15079 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:03.955260 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.956029 10188 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:03.901014 15092 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:03.956326 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:03.957155 15058 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.959013 14800 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.975319 14804 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:03.980351 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.020848 10033 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
W20260709 13:18:03.981168 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.025936 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.981475 14762 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.027911 14762 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.981776 14920 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:03.917053 14930 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.009549 10181 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:04.000936 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:04.009043 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.934890 10037 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:04.006999 14948 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.012687 10110 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:18:04.003587 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.014820 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.021468 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.007105 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.010098 14944 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:04.012995 10180 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:04.004587 10716 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:04.036867 10112 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.014420 15092 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:04.035804 10186 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:04.035177 10185 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:04.029699 14762 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.979483 14998 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:04.047003 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.048760 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.048640 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:03.926914 14916 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:04.047716 14801 consensus_meta.cc:287] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.558s	user 0.001s	sys 0.016s
I20260709 13:18:04.064287 10106 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:04.064502 15058 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:04.064800 14804 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.065574 14973 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:18:04.066108 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.068130 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.068732 10114 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.069335 10180 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:04.072472  9938 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 4 to 7, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.045908 15092 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.061389 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:04.081329 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 101988us
I20260709 13:18:04.074728 10187 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:04.085534 10031 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:04.086603 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.088524 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.089208 10108 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:04.094434 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 91081.3us
I20260709 13:18:04.096685 10107 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:04.094882 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.074316 14948 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:04.093444  9938 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 6 to 10, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.075681 14801 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.098577 14993 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:04.147083 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 231309us
I20260709 13:18:04.097628 14933 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:04.115605 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:04.101727 14948 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.151525 10108 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
W20260709 13:18:04.143699 14981 consensus_meta.cc:287] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.011s
I20260709 13:18:04.143561 15015 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.158927 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.157686 10107 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:04.143433 14980 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:04.165269 10181 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:04.147583 10114 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:04.129201 14744 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.152550 14993 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.156877 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.171859 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.152496 14933 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:04.171891 10708 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:04.182705 10106 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:04.177189 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 146752us
I20260709 13:18:04.170068 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.185928 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:04.189265 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51822.4us
I20260709 13:18:04.190594 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.168455 15057 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.174816 14993 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.187594 15079 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.181958 14933 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.183651 14952 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:04.194275 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.197867 15060 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.195366 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:04.185896 15084 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:04.203081 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.203411 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.204232 10114 raft_consensus.cc:2393] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.206156 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.208515 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.202764 15060 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.204727 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.200742 14952 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:04.213806 10107 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.174449 14744 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:04.215145 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 63192.6us
I20260709 13:18:04.188244 14998 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.193778 14768 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 13:18:04.217680 14965 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:04.207613 15079 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.205714 15057 raft_consensus.cc:2764] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:04.212778 15060 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.222470 14965 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:04.224431 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 139168us
I20260709 13:18:04.225288 15023 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.230624 14944 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:04.241896 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.216361 14952 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.217762 14785 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.252148 14785 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:04.252638 14785 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.240247 14662 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.213806 15076 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.245435 14965 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.246157 14997 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.246064 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:04.249708 14998 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.250128 10109 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.255184 15092 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.257457 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:04.258646 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58272.4us
I20260709 13:18:04.241751 14924 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:04.280004 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.263381 10032 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:04.263933 10038 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:04.240299 15023 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:04.250959 15020 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.270751 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 100909us
I20260709 13:18:04.271347 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.270879 10189 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:04.273861  9938 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 7 to 10, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.284356 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.286583 14662 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.287099 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.280594 14998 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.287731 14998 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:04.288152 14998 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.246835 15079 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:04.288612 10038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2203) took 2089 ms (client timeout 2109 ms). Trace:
W20260709 13:18:04.289021 10038 rpcz_store.cc:269] 0709 13:18:02.199256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.199734 (+   478us) service_pool.cc:224] Handling call
0709 13:18:04.288392 (+2088658us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400398fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:04.288536 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4279110016}
I20260709 13:18:04.289832 15023 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.290441 14997 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.281003 14920 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.295879 15020 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.298255 14762 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.299045 14801 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.266893 14916 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:04.295334 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49416.5us
W20260709 13:18:04.309854 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 100774us
I20260709 13:18:04.310375 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:04.310581 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.269484 14917 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.295320 14920 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:04.298349 15100 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:04.314339 10109 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:04.292680 14944 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.328329 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:04.311802 14916 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:04.330740 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.314926  9938 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 4 to 7, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:04.330655 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 43797.6us
I20260709 13:18:04.328050 14997 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.330462 14944 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.359735 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 117168us
I20260709 13:18:04.356587 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.363471 10111 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:04.364403 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.350440 14916 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.366879 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.368283 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.293956 14948 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.353370 14721 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.356949 15050 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:04.372716 14662 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:18:04.379779 14762 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:04.363129 14944 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:04.381047 15096 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.375s	user 0.005s	sys 0.000s
W20260709 13:18:04.395767 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 115107us
I20260709 13:18:04.397632 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.398806 14567 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.399190 14567 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.399504 14567 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.403577 10114 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:04.407552 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.408335 14801 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:04.409037 14801 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.410240 14801 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.410755 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.411669 10708 raft_consensus.cc:2410] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:04.414906 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.416679 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.416896 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.418910 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.420327 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.394268 15092 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.415212 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.424633 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.426550 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.428786 10713 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.429225 15026 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.429656 15026 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.430027 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.431990 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.434448 15020 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:04.392743 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:04.440452 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.329411 14917 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.438210 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.370107 14981 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:04.376377 14721 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.449661 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 121421us
I20260709 13:18:04.363263 14997 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.429994 15026 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:04.456072 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.460994 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.460996 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:04.468751 15099 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 13:18:04.472348 15079 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:04.439137 15050 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.474884 15050 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.481272 14785 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.461987 14973 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:04.488318 14973 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.491055 14973 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.493009 14800 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.495115 10711 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:04.501225 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.501966 10114 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.503216 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.504539 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.505347 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.507930 14967 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:04.533846 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.534677 10710 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:04.449719 14981 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:04.512288 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.513375 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.514225 15015 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.514586 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:04.515458 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.516546 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.457597 14721 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.520061 14916 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.525460 15060 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.545018 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.545656 10112 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.547174 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.535320 14981 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.521977 10108 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:04.548413 14983 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.548803 14983 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.549152 14952 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.549669 14983 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.550699 14983 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.552414 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.553974 14744 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.555398 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.556188 10109 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.557945 14948 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.521925 14998 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.559921 10032 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:18:04.542661 14967 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:04.560946 14967 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:04.561317 14967 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.521484 14997 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.533634 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.564509 14997 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.471099 15023 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.564617 10038 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.570879 14952 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.572011 15060 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.573810 14920 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.575242 15010 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.581944 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.582578 10034 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:04.582978 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.581954 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.583648 10031 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.584842 14615 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:04.586654 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.587275 10033 raft_consensus.cc:2376] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12. Re-sending same reply.
I20260709 13:18:04.538741 14800 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:04.543431 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.582918 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.576802 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.578689 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.579017 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.555647 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.589493 10038 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:18:04.547979 10112 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:04.580392 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.535902 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.545584 10111 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.432590 14944 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.589601 10709 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:04.588872 10712 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:04.611927 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.615156 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.606359 14567 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.561307 14998 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.622704 10036 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:04.623898 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.608166 14916 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.543596 14933 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.628010 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:04.628736 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89202.9us
I20260709 13:18:04.633854 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.634565 10181 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:04.636984 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.602427 10713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:04.640697 10713 raft_consensus.cc:606] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.641177 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.641527 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.641875 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:04.645546 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89976.1us
I20260709 13:18:04.649852 10716 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:04.652537 10040 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.652468 10032 raft_consensus.cc:2410] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:04.653617 10188 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:04.654096 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.656687 10187 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.628450 15023 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.657047 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.657424 10180 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.662238 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.665779 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:04.666818 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 175436us
I20260709 13:18:04.666592 10714 raft_consensus.cc:2410] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:04.648239 14944 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.668560 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:04.629468  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:04.671151  9923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 43523.9us
W20260709 13:18:04.671963 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.673794 14567 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.676069 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.676702 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:04.680493 10031 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:04.669761 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.666724 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.679494  9938 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.670859 15017 raft_consensus.cc:2764] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:04.689110 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.691841 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.682854 14998 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:04.701901 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.699931 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.705704 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:04.714612 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.716892 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.716380 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.718986 15109 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.719775 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.720302 10039 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.720589 10712 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:04.724676 14785 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:04.731591 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.732050 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.719538 15109 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.734927 15109 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.732291 10189 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.740235 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.740605 14933 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.716334  9938 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 5 to 7, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 7 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:04.743613 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.745244 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.744832 10189 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:04.700088 14998 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:04.732941 10183 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:04.748232 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.710254 14824 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:04.760488 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:04.701004 14965 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:18:04.753629 14998 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:04.762795 10040 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 13. Ops: []
I20260709 13:18:04.764003 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:04.764612 10712 raft_consensus.cc:606] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:18:04.760380 14841 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.765156 14841 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.765532 14841 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.766544 15026 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.760507 14720 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.755311 14824 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:04.768563 14824 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:04.760658 15023 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:04.768195 14720 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:04.764463 14960 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.764968 10712 raft_consensus.cc:614] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.771194 14965 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.771829 14965 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.770701 15023 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.772895 14965 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.769690 14662 raft_consensus.cc:993] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:04.764458 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.774665 14662 raft_consensus.cc:1081] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:04.770713 14960 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.776656 10186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:04.777323 10186 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.777699 10186 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.779316 14960 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.779913 10113 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:18:04.769749 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 76196.3us
I20260709 13:18:04.716462 14418 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.787380 10038 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:04.781759 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.770027 15022 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:04.781960 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.781297 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.796494 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.797017 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.797372 10189 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.770324 14720 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.853893 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:04.857542 14801 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.858173 14801 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.774101 15023 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.799479 14721 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.862488 14721 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.800588 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.801229 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.801985 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.864018 10183 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.864405 10707 raft_consensus.cc:2393] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:04.802577 14967 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.803483 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.865671 10187 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:04.803851 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.768303 14785 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.805080 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.770628 15060 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.756857  9938 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.809139 14981 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.813968 14998 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.814734 15040 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.817373 14917 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.819121 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:04.820190 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62438.9us
I20260709 13:18:04.879406 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:04.879696 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.833209 10186 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.820837 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.821224 15109 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:04.823176 15022 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:04.824604 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:04.890177 10712 raft_consensus.cc:606] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.826054 14997 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:04.755617 14993 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.003s
I20260709 13:18:04.821015 15075 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:04.832526 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.834728 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.835626 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.838985 14841 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.841264 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.843372 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:04.834823 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.827440 15057 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:04.902729 14615 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.903105 14615 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.903023 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.774153 14965 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.904167 14615 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.906211 14615 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.848909 10111 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:04.852648 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.907675 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.828617 14800 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.860530 14801 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.910593 14916 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:04.899489 14993 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.916868 14967 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.916921 14916 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.920735 15075 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.917013 15010 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.921283 15010 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.921626 15010 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.915688 14841 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:04.917459 14920 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.916426 14720 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:04.890548 10712 raft_consensus.cc:614] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.925977 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.926621 14720 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.916525 10035 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.890595 10081 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:04.927810 14720 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:04.928435 14997 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:04.929610 14997 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.929946 14997 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.930764 14997 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.934906 15057 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:04.925091 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.935883 15057 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:04.936280 15057 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.926822 14916 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:04.937110 15119 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:04.927225 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.938112 10180 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:04.894663 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.938323 14720 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.938723 10187 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.939118 15058 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:04.939574 15058 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:04.937299 15057 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.940263 14916 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.940809 15057 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.940565 15058 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:04.895328 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 74566.7us
I20260709 13:18:04.941876 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:04.942216 14997 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.942943 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.943403 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.944175 15109 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:04.944434 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.944567 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.944684 15109 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.874806 14960 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:04.945729 15109 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.947137 14998 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.947501 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.948796 14998 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.888152 10036 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:04.897248 10039 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.952963 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:04.954356 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:04.874934 15060 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.907868 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.955053 15060 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.910876 10181 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:04.956190 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.956507 10188 raft_consensus.cc:2410] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:04.956889 10181 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:04.957428 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:04.912319 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 69034.5us
I20260709 13:18:04.913371 10034 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.958186 15079 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:04.958513 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:04.960048 15079 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:04.960551 15079 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.961869 15015 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:04.962342 15015 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:04.924741 14920 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:04.962719 15015 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.963048 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:04.963419 14920 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.964830 14920 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.919554 10115 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:04.960427 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.965555 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.965914 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.966563 10110 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:04.937687 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.853780 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:04.966048 10180 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.919121 10186 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.908141 15023 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:04.968529 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:04.969403 10038 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:04.965583 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:04.920348 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:04.896600 10710 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:04.957994 10188 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.875609 10031 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:04.979429 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.957733 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.001278 10181 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.919245 14993 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:04.939332 14720 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.962759 14800 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:05.011427 15075 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:05.012718 10716 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.013793 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:05.014374 10709 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:05.014664 10709 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.015458 10709 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.016099 15092 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:05.016841 10709 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:05.017536 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 212527us
I20260709 13:18:05.018610 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:05.019496 10113 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:05.011862 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:05.011719 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.008883 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:05.020480 10712 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
W20260709 13:18:05.021245 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53741.7us
I20260709 13:18:04.924005 14862 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:04.908500 14975 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.024715 10189 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
W20260709 13:18:05.025439 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122502us
I20260709 13:18:05.033696 10035 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:05.023496 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:05.027663 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:04.941840 15058 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.034457 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:05.037982 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.034621 10034 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:05.035147 10183 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:04.881675 15040 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:04.964223 14981 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:05.034861 10039 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:05.040333 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.038053 15026 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.078222 14662 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.899538 14785 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.073251 15092 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.081269 15092 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.082491 14785 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:05.083163 14785 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.034452 14993 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:05.083920 14948 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.007s
W20260709 13:18:05.066996 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 190727us
I20260709 13:18:05.076414 15023 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:05.084996 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.085554 15023 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.077237 14998 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.088587 10707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:05.089582 10707 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.089924 10707 raft_consensus.cc:614] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:05.093108 10709 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:05.094527 15010 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:05.095580 14983 consensus_meta.cc:287] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.544s	user 0.014s	sys 0.005s
I20260709 13:18:05.083600 15092 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:05.095067 10707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:05.096387 10037 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:05.096773 15010 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.097182 10707 raft_consensus.cc:606] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:05.097568 10707 raft_consensus.cc:614] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:05.044776 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.100208 10183 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.100052 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.101425 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.102166 10184 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:05.102411 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.102942 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.103086 10186 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:05.104121 10040 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:05.105899 15040 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.103709 10184 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:05.108981 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.110229 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.111613 10184 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:05.115006 15079 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.107951 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:05.077842 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43479.2us
I20260709 13:18:05.128037 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:05.125484 10031 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
W20260709 13:18:05.127810 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 56366.7us
I20260709 13:18:05.132400 10183 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:05.127087 10181 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
W20260709 13:18:05.128098 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54118.8us
I20260709 13:18:05.036377 14997 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.138639 10181 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:05.139698 10180 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:18:05.141937 10183 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.143003 10110 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:05.140388 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.144060 10189 raft_consensus.cc:2376] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13. Re-sending same reply.
W20260709 13:18:05.146081 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 61168.6us
I20260709 13:18:05.061657 10187 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:05.006042 15050 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:05.041764 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69669.5us
I20260709 13:18:05.039775 15110 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.148627 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.148975 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.155943 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.040174 14862 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:05.158036 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:05.160041 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 122146us
I20260709 13:18:05.159343 10180 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:05.161966 15110 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.166095 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.166901 15010 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.167668 14164 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.168267 14164 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.136904 14993 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:05.172533 14824 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.173354 14164 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:05.186264 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58318.5us
I20260709 13:18:05.191476 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.192703 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.149593 15050 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.044410 14800 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.150141 14841 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:05.151039 14980 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.188513 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.196870 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.204448 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:05.204792 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44619.6us
I20260709 13:18:05.200134 15050 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:05.206774 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 48840.8us
I20260709 13:18:05.168844 14975 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:05.169281 14983 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.209656 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:05.168573 15110 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:05.148737 15017 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:18:05.226171 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.225955 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.221872 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.197544 14920 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.227535 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:05.233733 10182 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:05.223106 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.238108 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.238816 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.242125 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.202227 15058 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.242856 10189 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
W20260709 13:18:05.247953 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.245460 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.224644 14615 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.252556 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.230417 14801 raft_consensus.cc:2764] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:05.229127 14917 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.256086 15111 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:05.220777 14975 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.229583 14983 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.256524  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:05.241016 14998 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:18:05.257305 14768 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.226729 15040 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.254590 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.245847 15058 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:05.259950 10187 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:05.245460 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.201520 15060 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.242224 14841 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:05.265869 10180 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:05.236344 14762 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:18:05.254029 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.289096 10183 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
W20260709 13:18:05.292217 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 70421.4us
I20260709 13:18:05.294739 10040 raft_consensus.cc:2410] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:05.296408 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.297712 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.298941 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.262041 14920 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:05.275151 14917 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.281204 14975 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.303380 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.304770  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:05.255262 14952 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:05.310446 10037 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:05.281095 14983 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.303030 15111 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:05.286774 14997 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.291976 15058 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.325989 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.327291 10040 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:05.303262 14967 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.294682 14768 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.306668 14965 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:05.332571 10031 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:05.295297 15010 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:05.309610 14917 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.344832 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.346057 10182 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
W20260709 13:18:05.359568 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.326315 14841 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:05.381772 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 418807us
I20260709 13:18:05.289364 14993 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.343992 15010 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.388638 15060 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:05.391122 15123 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:18:05.397300 10189 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:05.286413 14862 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.337986 15079 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:05.411855 14980 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:05.417397 10037 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:18:05.417398 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.419981 15111 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.415575 10183 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:05.428857 10040 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:05.432384 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.341001 14720 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:05.445976 10184 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.341389 14801 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:05.437404 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.440235 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:05.434538 15121 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:18:05.446126 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.431401 15010 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:05.436642 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 209188us
I20260709 13:18:05.450405 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.458231 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.461658 10184 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:18:05.463827 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 164954us
I20260709 13:18:05.341413 15015 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.474953 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:05.476761 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 254136us
I20260709 13:18:05.477584 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.420504 14768 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.439464 14980 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.482903 10040 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:05.485190 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.455286 15109 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:05.485868 10035 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.434306 14948 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:05.491174 10188 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:18:05.493109 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.493877 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.495684 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:05.501291 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.515954 10037 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:05.516295 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.518608 10035 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:05.436853 14920 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.523061 10180 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:05.492298 14801 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.528223 14801 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:05.529433 14801 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.533970 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:05.535959 15131 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:05.536554 15131 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:05.537209 14824 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:05.484359 14785 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:05.537461 15131 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.486006 15092 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.495249 15109 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.541671 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 66747.5us
I20260709 13:18:05.521311 14800 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:05.479501 14720 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.529422 14762 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:05.590590 10031 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:05.592900 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:05.554447 15079 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.596800 10188 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:05.606406 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:05.568691 15109 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.569610 15092 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.614171 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:05.612646 10109 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.607661 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:05.613453 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:18:05.664494 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.646994 14615 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.648643 10112 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:05.653443 10113 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.654093 15027 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
W20260709 13:18:05.654742 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 53341.6us
W20260709 13:18:05.655634 15132 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:18:05.656448 15138 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:18:05.674328 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82686.2us
I20260709 13:18:05.678380 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:05.681355 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.705216 10111 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:05.702618 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.706997 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:05.710891 15027 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:05.711367 15027 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:05.712123 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.712289 15027 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.713068 10040 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:05.714239 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.714866 10037 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.702620 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:05.719401 10110 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:05.721367 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:05.722050 10113 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:18:05.613500 14762 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.635561 14983 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.499703 14841 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.734376 14983 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:05.735855 15136 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:18:05.736642 15130 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 13:18:05.739992 15124 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
W20260709 13:18:05.759848 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.742326 14975 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:05.736742 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.746258 10036 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:05.746833 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:05.751346 10037 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:05.757570 10111 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:18:05.768169 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:05.768898 10180 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.779193 10034 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:05.594967 14980 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.780894 14662 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.781471 14662 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.783391 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.784402 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.784590 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.787926 15092 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.792065 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.792848 10037 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:05.793180 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.793726 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:05.793955 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.794323 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.794802 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.795229 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.795393 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.795926 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.807446 10037 raft_consensus.cc:2368] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
W20260709 13:18:05.796693 15125 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.543s	user 0.004s	sys 0.000s
I20260709 13:18:05.787149 15058 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.816553 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.817451 10037 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:05.817729 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.817929 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.818312 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.799377 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2250) took 1130 ms. Trace:
I20260709 13:18:05.800865 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.801787 14762 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.804426 10036 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:05.805881 10180 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:05.818570 10034 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:05.834930 10032 rpcz_store.cc:276] 0709 13:18:04.669383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.669504 (+   121us) service_pool.cc:224] Handling call
0709 13:18:04.669810 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.690801 (+ 20991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.690834 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:04.696913 (+  6079us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.162628 (+465715us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:05.162676 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.162755 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.739404 (+576649us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:05.798991 (+ 59587us) raft_consensus.cc:1685] finished
0709 13:18:05.799015 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.799283 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6454,"raft.queue_time_us":12750,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4782,"spinlock_wait_cycles":15193984,"thread_start_us":430511,"threads_started":1,"wal-append.queue_time_us":542370}
I20260709 13:18:05.837236 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.834931 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.797493 14952 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:05.813699 10115 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:05.815301 10184 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:05.797804 14998 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:05.806391 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.840373 14998 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.841336 15057 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:05.842087 14952 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:05.842741 14998 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.842998 14952 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.838479 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:05.846506 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.847115 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 46345.2us
I20260709 13:18:05.818558 15140 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:05.848656 14998 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:05.849164 14998 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:05.840025 10036 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.819283 14930 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:05.849318 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:05.850167 14998 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.850914 14801 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.851244 14930 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:05.851928 14998 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:05.853861 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.853703 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:05.855227 14733 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:05.856106 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.857250 14768 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:05.857806 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:05.839816 10034 raft_consensus.cc:2393] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:05.858513 10115 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:05.860980 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:05.861177 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.862586 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.863473 10031 raft_consensus.cc:2368] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:05.852222 14930 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.870915 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.872501 10039 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:05.871229 10187 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.870390 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:05.760581 15027 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:05.792861 15050 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.001s
W20260709 13:18:05.875892 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 129167us
I20260709 13:18:05.880113 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:05.878886 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.811594 14662 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.861282 15079 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:05.860117 15026 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:18:05.881644 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.858271 14768 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:18:05.905467 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.874572 15143 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.874718 14762 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:05.913954 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:05.881963 14933 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:05.918370 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.919672 10036 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:05.887408 14800 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.869621 14983 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:05.921883 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.929122 10031 raft_consensus.cc:2376] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12. Re-sending same reply.
I20260709 13:18:05.875468 15022 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:05.891932 15144 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:05.924191 10187 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:05.941650 10039 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:05.911469 14762 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.883236 15050 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:05.927115 15092 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:05.958995 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98097.7us
W20260709 13:18:05.946609 14917 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 13:18:05.954217 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.928467 14933 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:05.931634 15079 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.963724 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.947100 15140 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.935606 15144 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.950093 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:05.945307 14768 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.944466 14785 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:05.964584 10031 raft_consensus.cc:2368] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:05.967971 10035 raft_consensus.cc:2368] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:18:05.966667 10033 raft_consensus.cc:2376] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15. Re-sending same reply.
W20260709 13:18:05.969465 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.944751 14967 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:18:05.924867 15143 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:05.972565 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:05.983347 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.967443 15092 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.983928 10033 raft_consensus.cc:2376] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13. Re-sending same reply.
W20260709 13:18:05.979897 15010 consensus_meta.cc:287] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.001s
I20260709 13:18:05.988437 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.991267 14662 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.991789 14662 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.992149 14662 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.003914 14733 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:06.005954 10033 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:06.022173 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.022718 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:05.975863 14768 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:05.976466 15144 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.008502 14785 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.024181 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:05.975963 15140 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:05.969563 14917 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.025151 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.025949 10716 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:06.026217 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.026508 15140 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.027354 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.027545 14917 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.011617 15050 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.013743 15092 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.029153 15143 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:05.982707 14762 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.030725 14762 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.014777 14933 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.015703 14975 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.019578 10034 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:18:06.021445 15141 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:18:06.024802 14768 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.012715 15058 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.043093 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.023939 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.035342 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.045403 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.045987 10036 raft_consensus.cc:2376] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12. Re-sending same reply.
I20260709 13:18:06.036732 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.047330 10115 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:06.037875 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.023535 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.024780 10031 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.039392 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.041323 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.041208 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.048482 10111 raft_consensus.cc:2410] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:18:06.050602 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.051487 10033 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:05.987939 15109 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.054106 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.055127 10037 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:05.987155 15131 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:06.055202 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46304.6us
I20260709 13:18:06.061790 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.062634 10038 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:06.057492 10040 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 10: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:06.040135 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.058260 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.064234 10187 raft_consensus.cc:2368] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:06.065501 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.066581 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.034636 15010 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.070510 10032 raft_consensus.cc:2368] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:06.054112 15109 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.067615 15020 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:18:06.081861 10031 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
W20260709 13:18:06.203802 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.206208 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.207260 10039 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:18:06.216102 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.219440 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.222154 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.225324 14418 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:06.084508 15131 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:06.228215 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.229506 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:06.253998 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.254282 10038 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:06.230904 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.231225 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.231702 15110 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:06.125463 15153 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.232030 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.225956 14418 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.146661 15159 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:06.237010 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.237584 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.238438 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:06.238905 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.239310 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.301935 10031 raft_consensus.cc:2376] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15. Re-sending same reply.
I20260709 13:18:06.239881 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.241309 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.302987 14615 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.244736 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.303527 14615 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.247341 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.248757 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.305775 14615 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.307201 14983 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.249260 10109 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:06.250114 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.307715 14983 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.252401 10115 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:06.248160 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:06.260563 10155 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.519s (SENT)
I20260709 13:18:06.233273 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.304006 10107 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14.
I20260709 13:18:06.238463 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.317391 10108 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:06.320050 10708 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14.
I20260709 13:18:06.328840 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.342830 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:06.346182 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 85681us
W20260709 13:18:06.347143 10155 leader_election.cc:336] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.524s (SENT)
I20260709 13:18:06.265856 15153 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:06.348624 10107 raft_consensus.cc:2410] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:06.325006 15140 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.352362 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.319996 14418 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:06.357971 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 292539us
I20260709 13:18:06.299584 15110 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.372372 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.373858 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.350423 15153 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.326870 14662 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.326033 15159 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.390717 10110 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:06.357234 15140 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.383780 15171 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:06.389729 15170 raft_consensus.cc:2764] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:06.392109 14983 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.381511 15131 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.375243 14800 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.380507 15020 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:06.408955 15020 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:06.410125 15020 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:06.412096 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.410355 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.430043 15164 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:18:06.435217 15159 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.392634 14948 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.435410 15170 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:06.438627 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64839.9us
I20260709 13:18:06.410329 14983 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.448921  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:06.456179 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:06.465050 10035 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:06.466675 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 73400.5us
I20260709 13:18:06.468111 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.446009 14800 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.477088 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.466208 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.480077 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.449656 15170 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:06.481462 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.483395 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.483840 10035 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:06.445240 14948 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.485297 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.487385 10035 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:06.448264 14983 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.478642 14841 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.497426 14841 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.498713 14983 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.486536 14967 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:06.499536 14841 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.496181 15075 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:06.485097 14785 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.501579 15140 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.502175 14975 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:06.482142 14800 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.504149 10039 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:06.506022 14800 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.499667 14967 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:06.507974 14948 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.490491 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.507424 15176 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:06.478886 14418 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.516551 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.517269 10035 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:06.518488 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.520699 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.508507 14967 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.517518 15176 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.526898 14720 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.528240 15176 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:06.530197 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.541150 15176 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.542356 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.542668 15176 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:06.543310 15176 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:06.543902 14998 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.532048 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.544577 10189 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:06.545375 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.530180 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.546382 10032 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:06.547894 10032 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:06.532215 14824 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:06.518512 14418 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.555356 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.491892 14662 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.533852 10182 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:06.534097 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.534767 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.535454 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.536284 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.536751 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.536952 15180 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.567930 14800 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:06.571159 14418 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.549836 15170 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.573626 15142 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:06.574321 15142 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.576690 15142 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:06.584808 15144 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
I20260709 13:18:06.584669 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.539937 15177 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.540367 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.539840 10033 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:06.550299 15160 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:06.560818 10038 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:06.544240 15176 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.565724 14824 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:06.587158 15160 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.538364 10031 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:06.567385 10183 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:06.501583 14785 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.588941 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.586643 15180 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:06.589874 10180 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.485827 15175 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:18:06.587633 14824 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:06.591872 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:06.585248 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64917.8us
I20260709 13:18:06.544277 15060 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.550840 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.549801 15140 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:06.586422 15177 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:06.604687 15177 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.586428 15110 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.594597 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:06.602385 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.585376 15144 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:06.607810 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57208.7us
I20260709 13:18:06.608902 10180 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:06.591605 15174 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.595198 15171 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.611191 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.613919 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.630441 14785 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.605651 15139 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.634956 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.603350 15140 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.631227 15175 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.637434 14720 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.648074 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.640615 15139 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.644299 15110 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:06.655265 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 199181us
I20260709 13:18:06.646600 15140 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:06.639324 15060 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:18:06.664939 15020 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.666278 14917 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:06.666719 14917 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:06.667196 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.668179 14721 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:06.668457 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.668659 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.669600 15183 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:06.672211 15160 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.647316 14418 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:06.675482 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.676364 10186 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:06.676383 14948 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.677664 14948 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.647049 15075 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:18:06.653236 14933 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:06.659433 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.651849 14720 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.653512 15171 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:06.658597 15181 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.655296 15139 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.662429 15144 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:06.679477 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.684953 14720 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:06.690428 15149 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.800s	user 0.012s	sys 0.005s
I20260709 13:18:06.678570 14721 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:06.691763 14721 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.693212 15111 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:06.693616 15111 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:06.694860 15075 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.694428 15111 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.699055 15111 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.667685 14917 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.687855 15079 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.700248 14917 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.694507 10040 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:06.704113 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44762.1us
I20260709 13:18:06.704948 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.705765 15079 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:06.706301 15079 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:06.706701 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:06.707535 10709 raft_consensus.cc:2368] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:06.709407 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:06.695411 15075 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.697849 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.698407 15181 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:06.713057 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.707325 15079 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.712322 14662 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.714386 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.712992 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.714123 14965 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.716069 15181 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.716205 14418 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.719833 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.724795 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.721570 15026 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:06.666644 15153 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.732292 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.728152 15026 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:06.725486 14662 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.734490 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.762697 15026 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.725739 15060 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.764911 15153 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:06.765908 14662 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:06.766444 14841 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.766191 10709 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:06.769948 15075 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.771085 10714 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:18:06.776255 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51529.8us
I20260709 13:18:06.777132 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.779001 15181 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:06.725637 14733 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.779430 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49523.5us
I20260709 13:18:06.780038 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.780861 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.811161 10113 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.781602 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.811968 10106 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.782327 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.783203 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.812723 10115 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:06.783443 10107 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:06.790364 15180 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.790665 15177 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.791150 14720 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:06.792138 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.796725 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.816695 10711 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:06.797438 10708 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:06.798537 10153 leader_election.cc:400] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:06.806432 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:06.818261 10153 leader_election.cc:403] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:06.818410 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.819250 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:06.824061 15171 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.824556 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.824550 15171 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.825548 15171 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.827025 14944 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:06.827461 14944 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:06.828311 15015 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.829077 15015 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:06.825580 15155 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.934s	user 0.003s	sys 0.011s
I20260709 13:18:06.828373 14944 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.830835 14720 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.832235 10112 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:06.824759 15180 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.827219 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.836763 14800 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.793560 15142 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:18:06.853461 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:06.854103 15180 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.856130 14944 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:06.856583 15180 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.857283 14721 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.857095 15180 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.853858 15171 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.846804 15181 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:06.855659 15139 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.819691 14733 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.865018 10713 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:06.865859 15010 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.866228 15139 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:06.863943 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 85137.4us
I20260709 13:18:06.853669 15026 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.868424 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:06.873379 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.873808 10106 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:06.873121 10113 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:06.884938 15092 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:06.886057 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.887033 14733 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:06.887902 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.888274 15189 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.888578 10182 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:06.889874 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.890537 10187 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:18:06.874747 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47587.4us
W20260709 13:18:06.893167 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.878499 10184 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:06.876788 10181 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:06.880532 10186 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:06.883029 10180 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:06.879231 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:06.895763 10183 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.892913 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.883158 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.904476 15139 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.905107 15139 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:06.899250 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:06.921555 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.922945 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:06.924481 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.925731 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.927352 10040 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:06.927354 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.925817 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:06.933439 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 122336us
I20260709 13:18:06.928807 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:06.941560 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.942466 10032 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:18:06.884608 15140 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:06.916126 15189 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.948179 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.949611 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.991053 10032 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.947821 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.988802 14824 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:06.992803 15015 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.951876 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.994130 10111 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:06.951666 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:06.953712 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:06.995184 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.952494 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.957082 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:06.996322 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:06.958158 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:06.958877 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.929006 14720 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:06.960084 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:06.998651 10031 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.961037 10110 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:06.996457 10038 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:06.962065 14841 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.964608 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.966274 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:06.966924 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:06.967514 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.967871 10183 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:07.004555 10113 raft_consensus.cc:2368] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:06.969950 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.971549 10033 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:06.972748 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:06.973937 15180 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:06.973522 15171 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.927698 15144 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:06.984856 15150 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 1.086s	user 0.000s	sys 0.006s
I20260709 13:18:06.990430 10112 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:06.959473 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:06.994089 14933 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.993381 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:07.017570 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47691.7us
I20260709 13:18:07.016737 10183 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:07.018106 10183 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:06.998245 14662 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.961903 10035 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:07.025801 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:07.026479 10110 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
W20260709 13:18:06.999621 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 106792us
I20260709 13:18:06.993212 14824 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:07.001155 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 186224us
I20260709 13:18:07.018627 10183 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.037776 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:06.997454 10114 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:07.003830 10107 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:06.997110 10715 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:07.005446 10713 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.005347 10109 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:07.005892 10189 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:07.006711 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:07.040478 10111 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
W20260709 13:18:07.007010 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55437.7us
I20260709 13:18:07.042358 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:07.043108 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.006284 10038 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:07.013792 10108 raft_consensus.cc:2368] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:06.996798 10716 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.950037 15139 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:06.993778 15057 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.049418 15057 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.050020 10033 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:07.051218 10033 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:07.021420 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.052163 10112 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.053936 14967 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:07.019081 10037 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:07.023981 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:07.056947 14980 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.057283 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:07.025396 15058 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.058156 15058 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.058645 10004 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14.
I20260709 13:18:07.016871 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.060091 10153 leader_election.cc:400] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:07.060925 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:06.997166 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:07.061980 15180 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.062798 15180 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:07.063169 15180 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:07.063514 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:07.064050 15110 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.064872 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.063548 15180 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.068427 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1856) took 1627 ms. Trace:
I20260709 13:18:07.068828 10185 rpcz_store.cc:276] 0709 13:18:05.441196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.441352 (+   156us) service_pool.cc:224] Handling call
0709 13:18:05.447196 (+  5844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.452173 (+  4977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.452208 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.499055 (+ 46847us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.864161 (+365106us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:05.864209 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.864288 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.984216 (+1119928us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:07.068120 (+ 83904us) raft_consensus.cc:1685] finished
0709 13:18:07.068144 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.068364 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2944,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14218,"spinlock_wait_cycles":59338112,"thread_start_us":299863,"threads_started":1,"wal-append.queue_time_us":375383}
I20260709 13:18:07.028751 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:07.072445 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43778.6us
I20260709 13:18:07.073417 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:07.073832 10155 leader_election.cc:400] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:07.074191 10155 leader_election.cc:403] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.059000 10004 leader_election.cc:403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.074682 15181 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.059028 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:07.079615 15017 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14.
I20260709 13:18:07.040925 14720 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:07.020195 15140 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:07.081595 15170 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:07.083199 10187 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:07.083624 15058 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:07.084045 15193 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.075286 15174 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:18:07.074261 14983 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:18:07.085655 15135 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:07.086566 10115 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
W20260709 13:18:07.087361 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 90270.3us
I20260709 13:18:07.088791 15189 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.089073 15174 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:07.089946 15174 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:07.090269 15174 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:07.090620 10715 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:07.075074 14920 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:18:07.092573 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.079831 10035 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:18:07.077572 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:07.095063 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.077267 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.097604 15057 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:07.097873 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.076694 15027 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:07.068832 14768 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.098934 15180 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.035180 10031 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:07.035826 15171 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:07.014938 14615 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:07.100188 14615 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:07.101047 14615 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.102240 14615 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.102702 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:07.044198 10183 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.104524 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.007310 14841 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.106719 15159 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:07.107117 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:07.107336 14841 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:07.046079 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:07.035876 15144 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:07.107677 15159 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:07.108709 10109 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:07.083149 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.091055 15174 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.110474 14983 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:07.112602 10187 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:07.098707 15027 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:07.118014 10114 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:18:07.167541 10114 pending_rounds.cc:85] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 7
I20260709 13:18:07.168874 10114 pending_rounds.cc:107] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:18:07.169157 10114 raft_consensus.cc:2889] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:07.016667 14933 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.120071 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.121230 10111 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:07.186290 10111 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:07.088967 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.124063 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:07.188452 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 99563.6us
I20260709 13:18:07.191618 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:07.130599 15140 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:07.192855 15140 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.193311 15140 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.193477 10712 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:07.132426 15180 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:07.085398 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:18:07.195329 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 109999us
I20260709 13:18:07.196064 15135 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:07.141719 10106 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.197016 15135 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:07.198022 15192 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:07.204550 15192 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:07.204977 15192 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:07.205948 15192 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.207353 15192 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.146024 10112 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:07.149426 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:07.149799 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.213253 10113 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:18:07.213203 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 63470us
I20260709 13:18:07.150759 10038 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.214181 10153 leader_election.cc:400] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:07.214471 10153 leader_election.cc:403] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.215096 15020 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.215185 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.154224 10716 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:07.218957 14800 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:07.219409 14800 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.219760 14800 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.219966 15181 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:07.221742 15181 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:07.222141 15181 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:07.157922 10032 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:07.158645 10713 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:07.163935 10108 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
W20260709 13:18:07.164553 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 81478.5us
I20260709 13:18:07.119654 10107 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:07.223040 15181 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.224738 15181 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.175951 10039 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:07.177378 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:07.225874 14164 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:07.177271 10183 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:07.166826 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:07.229009 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.229928 15153 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:07.230497 15153 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:07.230703 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.231490 10185 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:07.231958 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.232394 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.230401 10112 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:07.233526 10182 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:07.231513 15153 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.235810 15189 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:07.237273 10109 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:07.238974 10111 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:07.224922 10107 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:07.192378 10707 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:07.198596 15135 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:07.241887 15135 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:07.242838 15135 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.244114 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:07.245307 15190 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:07.247797 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.248765 10182 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:07.248945 15139 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:07.249676 15139 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:07.232470 10188 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:07.250566 15139 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.252089 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.248733 15075 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:07.253372 15170 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:07.254436 10186 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:07.254755 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.234683 10106 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:07.257476 10038 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:07.259495 10114 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:07.247077 15020 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
W20260709 13:18:07.261235 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 141240us
I20260709 13:18:07.295077 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.297366 10186 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:07.101269 15177 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:07.260497 14933 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.161665 15159 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:07.302196 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.305722 10182 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:07.298691 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.307840 10038 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:18:07.342739 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.166445 15026 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:07.165287 14983 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:07.185645 15015 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.326412 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:07.327265 10031 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:07.316934 15075 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.262099 15193 raft_consensus.cc:2764] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:07.366585 14983 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.367975 14983 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.370782 15171 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:07.358314 14965 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:07.373836 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:07.375465 10078 leader_election.cc:400] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:07.375830 10078 leader_election.cc:403] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.294652 14920 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.377210 14920 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.345924 10184 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:07.378482 15057 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:07.379326 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.380519 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.381145 10184 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:07.382053 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.315096 15174 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.383046 14720 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.384135 14720 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.339067 15109 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:18:07.356645 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54546.3us
I20260709 13:18:07.308545 14944 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:07.388826 14944 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.390987 14944 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:07.390687 15159 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.299794 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:07.361754 10187 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.342705 15111 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.301131 15058 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:18:07.393745 15058 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.355985 14801 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:07.394234 15058 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.361093 10031 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:07.395519 10031 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.396128 10115 raft_consensus.cc:2410] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:07.396538 10031 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:07.365610 15075 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.397301 10035 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:07.397413 15075 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.398803 15058 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:07.400287 15026 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:07.400756 15026 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:07.391047 15140 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.404407 10110 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:07.301312 14841 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:18:07.392283 10004 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14.
I20260709 13:18:07.406339 15027 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.407047 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:07.407894 14720 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.409250 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.416599 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:07.425266 15160 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.331925 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.392107 15159 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.436476 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:07.408370 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.437557 10181 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:07.425114 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:07.443246 10187 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:07.394793 14801 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:07.424042 10184 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:07.346139 15022 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:18:07.424753 14944 raft_consensus.cc:2764] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:18:07.425431 15140 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:07.447100 14615 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:07.447685 15010 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.456987 15015 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.490556 14801 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.406003 15144 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:07.481721 15131 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 13:18:07.471275 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 212882us
I20260709 13:18:07.456166 14967 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:07.476439 15190 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.504173  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.470232 14824 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:18:07.468806 15058 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:18:07.507560 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99277.8us
I20260709 13:18:07.515641 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.519016 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.483503 10031 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:07.506235  9935 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 8 to 12, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 12 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:07.525327 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.526750 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.535601 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:07.501722 15020 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:07.496964 14841 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:07.534929 15010 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:07.609478 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 267445us
I20260709 13:18:07.535846 14944 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.636463 14944 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:07.539016 15170 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:07.589255 15020 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:07.561466 14980 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:18:07.649197 15194 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:07.540377 14948 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.650840 14720 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:07.537400 15110 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:07.649041 15199 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:07.655575 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:07.697022 10716 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.573347 14920 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:18:07.659386 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 344506us
W20260709 13:18:07.703037 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.707475 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.660367 14762 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.659761 15160 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.522385 15190 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.562168 15177 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:18:07.695384 10710 raft_consensus.cc:2410] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:18:07.570753 15017 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:18:07.720312 10716 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:07.700019 15194 consensus_queue.cc:1243] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:07.753254 14944 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.753948 14944 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.717468 15026 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.760368 15026 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:07.690207 14800 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.760250 10110 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:07.765045 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.725759 15110 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.724787 14981 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.782974 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:07.781791 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58840us
I20260709 13:18:07.787056 10115 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:07.702281 15075 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.787968 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:07.790603 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:07.792037 10184 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:07.794559 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 329282us
I20260709 13:18:07.765967 15139 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.721019 14762 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.807462 10189 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:07.740852 14980 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:18:07.791603 15198 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
I20260709 13:18:07.727026 14933 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:07.812593 10034 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:07.810086 10713 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:07.840636 10184 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:07.842099 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.842442 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:07.842806 10184 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:07.799029 15057 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.848253 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:07.818511 15010 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.805840 15109 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.789444 15160 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:18:07.787642 15110 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:07.951423 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.026876 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 415531us
I20260709 13:18:07.792457 14981 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.793946 15170 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.026520 15027 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:07.824259 15139 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:07.854333 15217 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:07.850135 15181 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.211s
I20260709 13:18:08.030222 15010 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.059055 15212 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.055132 15192 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.058444 15144 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.134537 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 360185us
W20260709 13:18:08.113842 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.023s
W20260709 13:18:08.141456 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.002s	sys 0.023s
W20260709 13:18:08.142161 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 558964us
I20260709 13:18:08.143338 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:08.058764 14944 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.091523 15027 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.113068 15174 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.152616 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:08.134765 15217 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:08.125710 15020 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.131821 15206 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:08.137390 15205 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.189524 10035 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:18:08.190100 10035 pending_rounds.cc:85] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 10
I20260709 13:18:08.190497 10035 pending_rounds.cc:107] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:18:08.190806 10035 raft_consensus.cc:2889] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:08.187502 15202 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.439s	user 0.001s	sys 0.001s
I20260709 13:18:08.179858 15027 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:08.214795 10710 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 767) took 1963 ms (client timeout 1599 ms). Trace:
W20260709 13:18:08.217600 10710 rpcz_store.cc:269] 0709 13:18:06.239437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.239594 (+   157us) service_pool.cc:224] Handling call
0709 13:18:08.197622 (+1958028us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540049e154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:08.202886 (+  5264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3201868544}
I20260709 13:18:08.142258 15212 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.246438 15212 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.147962 15144 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.248123 10715 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
W20260709 13:18:08.248353 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 460475us
I20260709 13:18:08.249011 15144 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.184229 15174 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.251322 14967 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.251904 14967 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:08.252791 14967 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.255679 15232 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:08.256270 15232 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.258412 15232 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.258697 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.259305 10115 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:08.260766 10110 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:08.261263 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:08.261775 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 466474us
I20260709 13:18:08.262001 10715 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:08.265074 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.265889 10110 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:08.267529 15233 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:08.251374 15174 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.268160 15233 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.269304 14762 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.216149 14800 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:08.187724 15206 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.271859 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.282913 10039 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:08.190104 15205 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.274637 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:08.274763 10715 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:08.286063 15205 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:08.270612 15233 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.275199 15075 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.279626 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:08.288388 15233 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:08.288792 15233 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.289517 15233 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:08.292441 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.297379 14768 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:08.300101 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1077) took 1056 ms. Trace:
I20260709 13:18:08.300590 10183 rpcz_store.cc:276] 0709 13:18:07.244100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.244276 (+   176us) service_pool.cc:224] Handling call
0709 13:18:07.244625 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.244999 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.245029 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.245506 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.474250 (+228744us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:07.474299 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.474382 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.299838 (+825456us) raft_consensus.cc:1685] finished
0709 13:18:08.299865 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.300016 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":228345,"threads_started":1,"wal-append.queue_time_us":456191}
I20260709 13:18:08.303725 14768 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:08.304740 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3066) took 1143 ms. Trace:
I20260709 13:18:08.305166 10112 rpcz_store.cc:276] 0709 13:18:07.160937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.234227 (+ 73290us) service_pool.cc:224] Handling call
0709 13:18:07.234533 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.310042 (+ 75509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.310079 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.325477 (+ 15398us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.794289 (+468812us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:07.794331 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.794401 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.304526 (+510125us) raft_consensus.cc:1685] finished
0709 13:18:08.304549 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.304680 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44370,"raft.queue_time_us":50241,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12840,"thread_start_us":468371,"threads_started":1,"wal-append.queue_time_us":752074}
I20260709 13:18:08.305871 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:08.268874 15010 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.309624 14762 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.310086 14762 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:08.310454 14762 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:08.315124 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 257064us
I20260709 13:18:08.231843 14980 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:08.237748 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2301) took 1066 ms. Trace:
W20260709 13:18:08.240406 15220 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:18:08.318385 14933 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:08.243285 15222 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:08.318572 15140 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:08.176456 15177 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:08.316636 10033 rpcz_store.cc:276] 0709 13:18:07.171368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.173610 (+  2242us) service_pool.cc:224] Handling call
0709 13:18:07.173996 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.260179 (+ 86183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.260212 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.299415 (+ 39203us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.799322 (+499907us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:07.799374 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.799452 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.237504 (+438052us) raft_consensus.cc:1685] finished
0709 13:18:08.237527 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.237683 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13617,"raft.queue_time_us":2390,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14188,"thread_start_us":453271,"threads_started":1,"wal-append.queue_time_us":907458}
I20260709 13:18:08.244315 15139 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.320713 15140 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:08.185729 14944 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.289615 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:08.316231 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:08.187297 14920 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:08.318045 14824 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:08.242466 15228 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:08.320959 10716 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:08.321652 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 917) took 1027 ms. Trace:
I20260709 13:18:08.270141 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:08.150985 15192 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.321798 15057 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:08.325449 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:08.328423 10189 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:08.318568 14980 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:08.332952 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52628.7us
I20260709 13:18:08.338486 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:08.349277 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:08.336164 10707 rpcz_store.cc:276] 0709 13:18:07.294278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.295384 (+  1106us) service_pool.cc:224] Handling call
0709 13:18:07.295680 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.296064 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.296091 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.304873 (+  8782us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.822329 (+517456us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:07.822377 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.822457 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.321428 (+498971us) raft_consensus.cc:1685] finished
0709 13:18:08.321450 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.321596 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9037,"thread_start_us":476067,"threads_started":1,"wal-append.queue_time_us":725854}
I20260709 13:18:08.335570 15010 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.339535 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 69478.4us
I20260709 13:18:08.339769 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:08.352491 10180 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:08.339237 14801 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:08.343708 15190 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.344242 15110 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.344064 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 964) took 1049 ms. Trace:
I20260709 13:18:08.339617 14841 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:08.350695 10114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.001s	sys 0.008s
I20260709 13:18:08.353910 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:08.354197 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 207426us
I20260709 13:18:08.354620 10110 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:08.422412 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:08.395902 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46172us
I20260709 13:18:08.350373 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:08.338594 14944 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:08.459053 10112 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:08.480859 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:08.459350 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:08.482489 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:08.459141 10114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.001s	sys 0.008s
I20260709 13:18:08.482491 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:08.484556 10707 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:08.484983 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 134692us
I20260709 13:18:08.476205 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:08.476670 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54378.6us
I20260709 13:18:08.488292 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.438282 10106 rpcz_store.cc:276] 0709 13:18:07.294774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.294915 (+   141us) service_pool.cc:224] Handling call
0709 13:18:07.295253 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.295636 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:07.645744 (+350108us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.322013 (+676269us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.322469 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:18:08.322629 (+   160us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:08.322661 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.322725 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.343841 (+ 21116us) raft_consensus.cc:1685] finished
0709 13:18:08.343862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.344002 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208771,"prepare.queue_time_us":98540,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":221909,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":13734,"thread_start_us":762167,"threads_started":2,"wal-append.queue_time_us":559271}
I20260709 13:18:08.490269 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:08.490849 10106 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.492059 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:08.509486 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:08.519204 10183 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:08.520520 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:08.353086 15058 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:08.397764 14720 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.527822 10106 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:08.528767 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:08.336709 15233 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:08.492559 15159 consensus_meta.cc:287] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 1.049s	user 0.013s	sys 0.000s
I20260709 13:18:08.534582 10710 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:08.455073 14841 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.453188 15177 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:08.535574 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.485322 15209 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:08.542392 10715 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:18:08.546145 10715 pending_rounds.cc:85] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 11
I20260709 13:18:08.546403 10715 pending_rounds.cc:107] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:18:08.546638 10715 raft_consensus.cc:2889] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.507704 15206 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:08.508405 15110 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:08.521991 15111 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.511305 15139 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.539156 15234 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.396878 15010 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.438462 15060 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 13:18:08.511510 15212 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:08.507561 15215 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:08.548110 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.536978 14800 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.554951 15110 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.542934 14841 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.545833 15058 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:08.507792 14164 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:18:08.541627 14720 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.547636 15177 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.550609 15209 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.559175 15139 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.559455 15234 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.633818 15234 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.425091 15217 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.596342 15190 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:08.603838 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:08.697798 10183 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:08.576778 15110 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.618753 15058 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.606534 14933 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.623306 15209 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:08.704993 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 198653us
I20260709 13:18:08.624301 15192 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.625245 15214 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.580801 14944 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.633185 15010 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.567566 15111 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.713548 15111 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.623620 10707 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:08.578173 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.714746 10106 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:08.696842 10112 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:08.698201 10181 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:08.699936 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.611047 15208 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.382s	user 0.001s	sys 0.001s
I20260709 13:18:08.579872 14800 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.720571 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:08.637967 15139 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:08.707109 15216 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:18:08.576228 15215 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:08.736017 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 212869us
I20260709 13:18:08.706636 15190 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.717190 14933 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.764516 10181 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:08.773135 10189 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:08.774744 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:08.775045 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.775820 10035 raft_consensus.cc:2368] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:18:08.776902 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.777264 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.777555 10035 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:08.777824 10036 raft_consensus.cc:2376] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15. Re-sending same reply.
I20260709 13:18:08.780035 14933 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.780431 15177 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:08.780934 15241 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:18:08.781615 15250 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
W20260709 13:18:08.782090 15251 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:08.740214 15135 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:08.788107 15135 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.790875 15213 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:08.797572 15153 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:08.798061 15153 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:08.809281 15192 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:08.809901 15192 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.810552 15190 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.818084 14720 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.818570 15215 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:08.821017 15238 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:08.823084 15237 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:18:08.831368 14800 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:08.832780 14768 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.833338 14768 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.836331 14983 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:08.837802 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.838411 10031 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:08.836732 14983 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:08.841480 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.842797 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.843506 14983 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.811622 15233 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:08.844568 14983 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.791543 15213 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:08.843436 10039 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:08.851193 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:08.856135 10033 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:08.862450 15213 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:08.882534 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.890172 15140 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.890805 15140 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:08.892894 15140 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:08.893479 15140 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:08.894364 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 156759us
I20260709 13:18:08.798947 15153 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.895622 10189 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:08.896649 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.897310 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.905984 10035 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:08.898437 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:08.899528 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:08.900242 10032 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:08.901327 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:08.915519 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:08.916626 10032 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:18:08.917019 10032 pending_rounds.cc:85] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
I20260709 13:18:08.917701 10032 pending_rounds.cc:107] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:18:08.918579 10032 raft_consensus.cc:2889] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.926599 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:08.926939 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78782.2us
I20260709 13:18:08.927536 10035 raft_consensus.cc:2410] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:08.931108 10038 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:08.933411 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:08.931681 10031 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:18:08.951566 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.881235 15075 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.063254 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.893961 15140 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:08.894248 15015 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:08.903373 14800 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.927789 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:08.880882 15213 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:08.892314 15218 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.058049 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:09.009115 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.633s (SENT) [suppressed 42 similar messages]
W20260709 13:18:09.069271 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 174000us
W20260709 13:18:09.069782 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 139032us
W20260709 13:18:09.104321 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.110818 10037 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:09.056720 15131 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.088666 10035 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:08.920311 14824 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.196s
I20260709 13:18:09.066591 15215 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.113941 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 48099.6us
I20260709 13:18:09.111182 14965 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.149500 15218 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.063464 15153 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:09.083920 14720 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:09.208866 15234 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.003s
I20260709 13:18:09.154438 15256 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.191495 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.234882 10185 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:09.106770 15111 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.236068 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.157549 15135 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:09.215755 14841 consensus_meta.cc:287] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.609s	user 0.004s	sys 0.005s
I20260709 13:18:09.067655 15075 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.197350 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.194056 15177 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:09.212881 15180 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:09.179507 15194 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.108119 15213 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.179445 15022 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:09.113305 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 185631us
W20260709 13:18:09.187155 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 178024us
I20260709 13:18:09.217851 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.306217 10707 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:09.190163 15192 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:09.208848 14762 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.898s	user 0.009s	sys 0.004s
I20260709 13:18:09.178853 15131 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.308666 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:09.314157 10155 leader_election.cc:400] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:18:09.236819 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:09.315146 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78419.5us
I20260709 13:18:09.109234 15015 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.197799 15246 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:09.285322 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:09.321867 15264 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:18:09.322080 10107 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:18:09.286504 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.322165 15015 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.326784 15218 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.288159 15140 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:09.289700 15027 consensus_meta.cc:287] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.975s	user 0.007s	sys 0.003s
I20260709 13:18:09.216868 15257 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.234053 14720 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.293730 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.179414 14933 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.295964 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.339553 14933 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.342638 14933 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.343091 15027 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.345099 15246 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:09.345474 15027 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.183663 15215 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.346014 15257 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.346026 15246 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.348213 15257 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.349941 15215 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.312712 15022 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.350513 15215 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.070541 15255 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 13:18:09.316376 14762 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.317497 15224 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:09.317873 15110 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.005s
I20260709 13:18:09.303362 15177 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.325176 15111 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:09.307794 15249 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:18:09.233655 14965 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.352356 15022 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.311332 15194 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.308678 15180 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.236886 15234 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.354209 14980 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.354949 15181 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:09.356163 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.429833 10115 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:09.350307 14720 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.296550 14841 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:09.358718 15139 consensus_meta.cc:287] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.000s
I20260709 13:18:09.276131 15256 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.362768 14981 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.365207 15131 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.412050 15194 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.367228 15260 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.310393 15245 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:18:09.368251 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.368984 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:09.349876 15213 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.335911 15015 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.371522 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:09.495986 10112 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:09.496857 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.498100 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.498762 10112 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
W20260709 13:18:09.369010 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 53889.4us
I20260709 13:18:09.500329 10155 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:09.500634 10155 leader_election.cc:403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.367374 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.501387 10111 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:09.153465 14800 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.320133 15253 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:09.350214 15075 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.375375 15140 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.406014 14965 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:09.422591 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.507391 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.428488 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.508617 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.509617 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.510545 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:09.432156 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 335914us
I20260709 13:18:09.443243 10184 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:09.454648 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.472663 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.512373 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:09.513224 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.513769 10115 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:09.514448 10081 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:09.514868 10115 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:18:09.389221 15215 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.515931 14720 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:09.512328 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.414678 14768 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.330874 15079 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.517557 10113 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.518105 15057 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:09.517928 15079 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.394181 15110 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.521745 15110 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.522414 10034 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:18:09.522585 14762 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.394342 15224 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.502635 15253 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.523262 15253 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.524693 15224 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.473245 15139 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.525578 10113 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:09.506249 15140 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.516321 14720 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:09.527534 14720 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.528784 15140 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.529419 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1906) took 1011 ms. Trace:
I20260709 13:18:09.529788 10181 rpcz_store.cc:276] 0709 13:18:08.518051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.773854 (+255803us) service_pool.cc:224] Handling call
0709 13:18:08.774166 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.864373 (+ 90207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.864409 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.864450 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:08.864485 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.529195 (+664710us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54003f0054. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:09.529242 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.529356 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206967552}
I20260709 13:18:09.530718 15256 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.532436 15234 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.533221 15022 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.527091 15139 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.533767 15022 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:09.534837 15203 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.734s	user 0.007s	sys 0.014s
I20260709 13:18:09.536677 15177 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.537137 14720 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.538316 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 962) took 2301 ms. Trace:
I20260709 13:18:09.538479 14841 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:09.541568 15268 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:18:09.499500 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.548132 10112 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
W20260709 13:18:09.550786 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50608.8us
I20260709 13:18:09.552260 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:09.504390 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:09.538735 10109 rpcz_store.cc:276] 0709 13:18:07.237141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.238133 (+   992us) service_pool.cc:224] Handling call
0709 13:18:07.238462 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.238830 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.238859 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.239366 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.598305 (+358939us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:07.598359 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.598849 (+   490us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.534249 (+1935400us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:09.538022 (+  3773us) raft_consensus.cc:1685] finished
0709 13:18:09.538047 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.538245 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2996,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":25538304,"thread_start_us":344696,"threads_started":1,"wal-append.queue_time_us":485703}
W20260709 13:18:09.555979 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.555989 10115 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:09.440996 15255 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.567943 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:09.575713 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.576434 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.573015 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:09.577558 10108 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:09.571646 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.578747 10707 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:09.580971 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:09.582089 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.587000 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.588093 10707 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:09.582851 10112 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
W20260709 13:18:09.592653 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.502166 15260 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.517427 15215 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.597936 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.438654 15181 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.606001 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:09.607280 10112 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.564127 15213 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.494153 15131 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.613938 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:09.604264 10710 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:09.617285 10181 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:09.539410 14720 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.618393 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2045) took 1129 ms. Trace:
I20260709 13:18:09.545085 15180 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.624502 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.621660 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.575881 15079 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.621723 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:09.628911 10715 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:18:09.603567 15266 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:09.620296 15215 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:09.641737 14762 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:09.642297 14762 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.642699 14762 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.627502 15022 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:09.628589 15017 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:09.645370 15017 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:09.645797 15017 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:09.646391 15263 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:18:09.637660 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.648455 10710 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:09.642076 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:09.650178 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 976) took 1506 ms. Trace:
I20260709 13:18:09.650843 14980 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.651427 14980 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.651847 14980 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.646870 15017 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.627998 10106 rpcz_store.cc:276] 0709 13:18:08.489102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.728513 (+239411us) service_pool.cc:224] Handling call
0709 13:18:08.728824 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.845236 (+116412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.845268 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.845720 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:18:08.888503 (+ 42783us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:08.888550 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.888626 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.540986 (+652360us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:09.605458 (+ 64472us) raft_consensus.cc:1685] finished
0709 13:18:09.605481 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.618322 (+ 12841us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":299631,"raft.queue_time_us":117079,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9446,"spinlock_wait_cycles":6448512,"thread_start_us":42447,"threads_started":1,"wal-append.queue_time_us":361915}
I20260709 13:18:09.628189 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.633946 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.645726 10039 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:09.603346 15110 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.637802 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.639441 14800 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:09.605786 15177 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:09.631932 15026 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.668013 10181 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:09.668464 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:09.698887 10707 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.669649 10109 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:09.605973 15260 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.662539 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:09.700515 10037 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:09.628836 15213 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.650619 10716 rpcz_store.cc:276] 0709 13:18:08.144112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.144399 (+   287us) service_pool.cc:224] Handling call
0709 13:18:08.320761 (+176362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.335841 (+ 15080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.649944 (+1314103us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400686fd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:09.650104 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331963264}
I20260709 13:18:09.691891 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:09.564417 15015 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.695871 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:09.627516 15058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.020s	sys 0.029s
I20260709 13:18:09.570847 15254 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:18:09.737794 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:09.738548 10180 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.696810 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:09.727895 10707 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:09.640497 15111 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.637850 14662 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.690824 15212 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.769093 10184 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:09.697846 15180 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:09.732594 15058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.021s	sys 0.029s
I20260709 13:18:09.734490 10715 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
W20260709 13:18:09.740932 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44226.7us
I20260709 13:18:09.743357 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:09.584029 15255 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.729146 15215 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:18:09.734616 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.634187 15131 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.744900 15192 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.701758 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:09.692440 15110 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.746687 15017 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:09.750361 14768 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.750900 14662 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.743301 15204 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.751468 15027 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.729007 15079 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:18:09.743831 14981 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.729055 15026 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:09.739867 14800 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
W20260709 13:18:09.874902 10188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 1879) took 2580 ms (client timeout 2229 ms). Trace:
I20260709 13:18:09.795684 10112 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:09.825461 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:09.823419 10180 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:09.896027 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:09.890633 15277 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:18:09.832640 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:09.887305 15203 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:09.907380 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2310) took 1143 ms. Trace:
W20260709 13:18:09.881495 15266 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:09.781661 15212 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.878230 15194 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.801649 15233 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.891106 14662 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.906193 15027 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.924015 10034 rpcz_store.cc:276] 0709 13:18:08.764399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.764600 (+   201us) service_pool.cc:224] Handling call
0709 13:18:08.764982 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.522852 (+757870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.907078 (+384226us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b540031bfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:09.907311 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741456768}
W20260709 13:18:09.931723 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99217.1us
I20260709 13:18:09.802196 15111 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:09.920429 10188 rpcz_store.cc:269] 0709 13:18:07.251439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.251828 (+   389us) service_pool.cc:224] Handling call
0709 13:18:09.827018 (+2575190us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b54002d9bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:09.827185 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5746003840}
I20260709 13:18:09.936334 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:09.912509 15180 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.900087 15177 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:09.959574 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.960795 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:09.961201 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:09.943852 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.964401 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:09.962287 10180 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:09.965601 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:09.970372 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:09.972573 10039 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:18:09.934970 15153 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.002s
I20260709 13:18:09.882956 15192 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.934302 15109 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:09.927428 14720 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:09.975495 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:09.980058 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:09.942806 15246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.020s	sys 0.061s
I20260709 13:18:09.900219 14768 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:09.975858 10186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.004s	sys 0.017s
I20260709 13:18:09.932386 15170 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:09.914572 15204 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.943058 15027 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:09.969412 10078 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.011s
W20260709 13:18:10.003306 10038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.031s	sys 0.031s
W20260709 13:18:10.019337 10078 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.016s	sys 0.011s
W20260709 13:18:10.019443 10038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.032s	sys 0.031s
W20260709 13:18:10.004040 10182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.015s	sys 0.047s
W20260709 13:18:10.007025 10186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.005s	sys 0.018s
W20260709 13:18:10.012933 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 276798us
I20260709 13:18:09.949311 15287 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:10.020064 10182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.016s	sys 0.047s
I20260709 13:18:09.977542 15224 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:09.972107 15174 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:10.024561 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:10.020834 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 649590us
I20260709 13:18:09.972625 15022 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.019855 15079 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.978724 15189 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.926100 14981 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.958693 15274 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:18:09.960287 15233 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:10.046486 10113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.016s	sys 0.045s
I20260709 13:18:09.960515 15194 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.973042 15177 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:10.058894 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 455015us
I20260709 13:18:09.995960 14720 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.021181 15181 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:09.995301 15275 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.061498 10113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.017s	sys 0.046s
I20260709 13:18:09.968286 15111 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.974309 15253 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:09.968247 15180 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.021889 14933 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.036195 14164 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:09.972258 15215 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.057773 15079 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:10.020072 15246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.021s	sys 0.061s
I20260709 13:18:10.072242 14720 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.023052 15170 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:10.130020 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.217658 10185 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:10.218715 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:10.219341 10185 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.132045 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:10.220118 10184 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.137293 15144 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:10.140507 15160 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:10.158792 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2374) took 1052 ms. Trace:
I20260709 13:18:10.060355 15189 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.160353 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.238987 10181 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:10.239959 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:07.784019  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:10.165493  9935 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 13, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 13 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:10.240617 10181 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:10.161402 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:10.174584 15190 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:10.037299 15224 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:10.072288 15015 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.033581 15287 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.057478 15174 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:10.110508 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 293128us
I20260709 13:18:10.082710 15181 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.082152 15213 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:10.198734 10189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.011s
W20260709 13:18:10.303854 10189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.007s	sys 0.012s
W20260709 13:18:10.208640 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.212214 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:10.212850 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
W20260709 13:18:10.312626 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.313938 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:10.204955 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:10.146064 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:10.237311 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1908) took 1718 ms. Trace:
I20260709 13:18:10.225548 10187 rpcz_store.cc:276] 0709 13:18:09.106441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.356469 (+250028us) service_pool.cc:224] Handling call
0709 13:18:09.356742 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.664730 (+307988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.664766 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.664810 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:09.664846 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.158531 (+493685us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540019bed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:10.158586 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.158721 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707751808}
I20260709 13:18:10.241585 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:10.316661 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.317349 10187 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:18:10.168800 15111 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.256172 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.315100 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.329571 10181 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:10.178771 15131 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:10.274878 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 273356us
I20260709 13:18:10.337054 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:10.337380 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:10.283721 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 339682us
I20260709 13:18:10.291783 15224 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:10.225670 14933 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:10.249231 15255 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.310972 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:10.318382 10039 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:18:10.315661 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 169693us
I20260709 13:18:10.320093 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:10.408500 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:10.409039 10187 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:10.246583 15144 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.315564 10186 rpcz_store.cc:276] 0709 13:18:08.518507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.146949 (+628442us) service_pool.cc:224] Handling call
0709 13:18:09.174402 (+ 27453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:09.188067 (+ 13665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.188101 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:09.193948 (+  5847us) log.cc:844] Serialized 52 byte log entry
0709 13:18:09.377306 (+183358us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:09.396920 (+ 19614us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.020413 (+623493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.020495 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.237024 (+216529us) raft_consensus.cc:1685] finished
0709 13:18:10.237050 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.237232 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21495,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":173438,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":7849,"thread_start_us":802817,"threads_started":2,"wal-append.queue_time_us":423134}
W20260709 13:18:10.300804 15283 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.345s	user 0.001s	sys 0.001s
I20260709 13:18:10.324002 10031 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:10.324424 15217 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:10.325245 15295 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:10.390221 14980 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.004s
I20260709 13:18:10.264477 15110 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.181403 14164 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.328488 10180 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:18:10.337872 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.420450 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2313) took 1053 ms. Trace:
I20260709 13:18:10.424288 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.295940 10184 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
W20260709 13:18:10.352587 15298 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:18:10.353379 15284 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
I20260709 13:18:10.356765 15309 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:10.339082 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.358883 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:10.436636 10033 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.360373 15177 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.089694 15275 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.362399 14981 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.312729 15015 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:18:10.364915 15189 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.305644 15174 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.307091 15026 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.309113 15181 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.366000 15194 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.366986 15204 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.246290 15160 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:10.453552 14762 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 13:18:10.368038 15192 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.369928 15287 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.371415 15079 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.372185 14768 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.377295 15253 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:10.381114 15260 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.648s	user 0.004s	sys 0.007s
W20260709 13:18:10.382181 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44907.4us
W20260709 13:18:10.383869 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 179020us
I20260709 13:18:10.488139 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.326941 14917 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:10.387152 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:10.491886 10106 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:10.388706 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:10.389549 10185 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:10.493814 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.408548 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:10.412782 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.495841 10187 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:18:10.326568 15288 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:18:10.418411 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:10.497491 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 89001.8us
I20260709 13:18:10.498174 10031 raft_consensus.cc:2368] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17.
I20260709 13:18:10.420943 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.391482 15022 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.383697 15060 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:10.428236 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.505916 10181 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:10.426844 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.508013 10184 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:10.509284 10184 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:10.430011 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.435166 10036 raft_consensus.cc:1217] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 13.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 13:18:10.424129 10035 rpcz_store.cc:276] 0709 13:18:09.366783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.369448 (+  2665us) service_pool.cc:224] Handling call
0709 13:18:09.369776 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.370125 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.370152 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.370594 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.768724 (+398130us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:09.768767 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.768855 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.420239 (+651384us) raft_consensus.cc:1685] finished
0709 13:18:10.420262 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.420393 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5032,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7375,"thread_start_us":397715,"threads_started":1,"wal-append.queue_time_us":998077}
I20260709 13:18:10.512378 10036 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:10.438583 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 815) took 2333 ms. Trace:
I20260709 13:18:10.443759 15170 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:10.419832 15212 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.423522 15217 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:10.465378 10033 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:10.465590 10109 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:10.464485 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2318) took 1070 ms. Trace:
I20260709 13:18:10.435981 15309 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:10.327224 15213 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:10.439435 15302 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.419796 14933 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.422709 14980 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.649200 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:10.462900 15110 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:10.422451 15295 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.489600 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.499097 10186 raft_consensus.cc:2376] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19. Re-sending same reply.
I20260709 13:18:10.501238 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.655812 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2320) took 1252 ms. Trace:
I20260709 13:18:10.656167 10185 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:10.504894 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:10.506682 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:10.447945 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 108946us
I20260709 13:18:10.657218 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.658452 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:10.658746 10153 leader_election.cc:403] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:10.526503 15026 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:18:10.531138 15253 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:10.513083 10040 rpcz_store.cc:276] 0709 13:18:08.105390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.105559 (+   169us) service_pool.cc:224] Handling call
0709 13:18:08.125331 (+ 19772us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:08.129339 (+  4008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.129377 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:09.195550 (+1066173us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b2c00000658. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:18:09.221919 (+ 26369us) log.cc:844] Serialized 52 byte log entry
0709 13:18:09.718667 (+496748us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:09.718707 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.718784 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.433012 (+714228us) raft_consensus.cc:1685] finished
0709 13:18:10.433035 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.438483 (+  5448us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3375,"raft.queue_time_us":4009,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9417,"spinlock_wait_cycles":9544576,"thread_start_us":405287,"threads_started":1,"wal-append.queue_time_us":725633}
I20260709 13:18:10.517742 15060 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:10.697937 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 53168.9us
W20260709 13:18:10.621153 10155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.039s	sys 0.054s
I20260709 13:18:10.700368 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:10.497545 15260 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.643661 15109 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.510751 10184 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:10.636811 15022 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:10.505760 14917 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:10.720551 15217 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.697069 15170 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:10.722195 15318 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:10.722741 15318 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.723534 15180 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.724866 15318 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.726662 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:10.480675 14762 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.497491 15312 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:10.736008 10107 raft_consensus.cc:2368] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:10.639117 10038 rpcz_store.cc:276] 0709 13:18:09.394451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.394593 (+   142us) service_pool.cc:224] Handling call
0709 13:18:09.394921 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.395133 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:09.395363 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.462716 (+1067353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.462776 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:10.462821 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.464292 (+  1471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.464425 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3457,"prepare.queue_time_us":1281,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":44433,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":1938,"thread_start_us":1055077,"threads_started":2,"wal-append.queue_time_us":986592}
I20260709 13:18:10.646246 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:10.736004 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:10.737651 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2324) took 1137 ms. Trace:
W20260709 13:18:10.646366 10111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.018s
W20260709 13:18:10.640807 10114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.012s
I20260709 13:18:10.738049 10112 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:18:10.738498 10114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.004s	sys 0.012s
I20260709 13:18:10.660595 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:10.739787 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 79229.3us
I20260709 13:18:10.662002 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:10.656203 10035 rpcz_store.cc:276] 0709 13:18:09.403180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.530814 (+1127634us) service_pool.cc:224] Handling call
0709 13:18:10.655340 (+124526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.655504 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.655527 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.655563 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:10.655591 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.655640 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.655735 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.661818 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2864) took 1764 ms. Trace:
I20260709 13:18:10.663091 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:10.664378 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:18:10.640990 15234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.012s	sys 0.007s
I20260709 13:18:10.634038 15255 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:10.671226 10711 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:18:10.640096 15280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.014s	sys 0.004s
I20260709 13:18:10.521811 15314 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:10.701035 10155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.042s	sys 0.056s
I20260709 13:18:10.643069 15309 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:10.702575 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 195960us
W20260709 13:18:10.703083 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 213556us
I20260709 13:18:10.638315 15192 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:10.705579 10715 raft_consensus.cc:2368] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
W20260709 13:18:10.644922 15017 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.010s
I20260709 13:18:10.706694 10714 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:18:10.665858 15310 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.165s	user 0.003s	sys 0.002s
W20260709 13:18:10.630611 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 200684us
I20260709 13:18:10.815079 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:10.643731 15194 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:10.649349 15305 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.398s	user 0.007s	sys 0.000s
I20260709 13:18:10.664673 15075 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:18:10.784950 15234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.015s	sys 0.020s
I20260709 13:18:10.717185 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:10.670754 15110 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.718405 15324 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:10.719316 14164 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.671190 15302 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.719907 15295 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.843847 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.844511 10184 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:10.844841 10033 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:10.727632 15224 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.728505 15109 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:10.823053 15285 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.738s	user 0.004s	sys 0.009s
I20260709 13:18:10.720463 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2375) took 1573 ms. Trace:
I20260709 13:18:10.858948 10182 rpcz_store.cc:276] 0709 13:18:09.147368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.407381 (+260013us) service_pool.cc:224] Handling call
0709 13:18:09.407759 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.022583 (+614824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.022616 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.035431 (+ 12815us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.467530 (+432099us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.467564 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.467628 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.720251 (+252623us) raft_consensus.cc:1685] finished
0709 13:18:10.720271 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.720404 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9917,"raft.queue_time_us":164607,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":24678,"thread_start_us":1000578,"threads_started":2,"wal-append.queue_time_us":652312}
W20260709 13:18:10.665560 15308 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.199s	user 0.005s	sys 0.000s
I20260709 13:18:10.738046 10038 rpcz_store.cc:276] 0709 13:18:09.600514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.736839 (+1136325us) service_pool.cc:224] Handling call
0709 13:18:10.737144 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.737331 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.737355 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.737397 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.737433 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.737483 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.737592 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.861673 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:10.862332 10038 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:10.863319 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:10.723244 15300 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.402s	user 0.001s	sys 0.001s
I20260709 13:18:10.644426 15246 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:10.865103 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:10.741134 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:10.865608 15233 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.866595 14841 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:10.867064 14841 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:10.867419 14841 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.742228 10036 rpcz_store.cc:276] 0709 13:18:08.897228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.897340 (+   112us) service_pool.cc:224] Handling call
0709 13:18:10.435004 (+1537664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.512786 (+ 77782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.661592 (+148806us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001572d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:10.661757 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3535615872}
I20260709 13:18:10.778169 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 982) took 1192 ms. Trace:
I20260709 13:18:10.790336 10112 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:10.709797 14920 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:10.821069 15144 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.794178 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2325) took 1193 ms. Trace:
I20260709 13:18:10.888065 10035 rpcz_store.cc:276] 0709 13:18:09.600799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.742050 (+1141251us) service_pool.cc:224] Handling call
0709 13:18:10.793667 (+ 51617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.793839 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.793864 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.793904 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:10.793933 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.793983 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.794118 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.816344 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:10.721649 15260 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.720317 15181 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:10.824054 15192 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:10.717517 15275 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.813331 10708 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:10.818068 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:10.899323 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81317.5us
I20260709 13:18:10.819262 10034 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:10.774062 15212 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.826674 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.845212 15323 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:10.773697 15180 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:10.794010 14965 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:10.836277 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.838021 14762 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:10.813640 15314 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:10.821875 15075 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:10.785789 15255 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:10.838785 10031 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.840660 15110 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:10.824354 15324 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.845486 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2321) took 1434 ms. Trace:
I20260709 13:18:10.720312 15022 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.845232 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.718334 14980 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:10.821336 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 728629us
I20260709 13:18:10.846498 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.847117 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:10.943372 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1909) took 2096 ms. Trace:
I20260709 13:18:10.654992 14998 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:10.853762 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2065) took 1135 ms. Trace:
I20260709 13:18:10.947257 10109 rpcz_store.cc:276] 0709 13:18:09.718362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.731228 (+ 12866us) service_pool.cc:224] Handling call
0709 13:18:10.149898 (+418670us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:10.150154 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.639114 (+488960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.853495 (+214381us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540017e154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:10.853696 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784026368}
I20260709 13:18:10.855573 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.711234 15322 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.873596 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 132538us
I20260709 13:18:10.873968 10038 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:10.874788 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:10.865521 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2055) took 1578 ms. Trace:
W20260709 13:18:10.880581 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 153996us
I20260709 13:18:10.819754 15318 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:10.871328 10111 rpcz_store.cc:276] 0709 13:18:09.585950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.586214 (+   264us) service_pool.cc:224] Handling call
0709 13:18:09.617512 (+ 31298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.617722 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:09.617958 (+   236us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.445640 (+827682us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b18003d6300. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:10.580483 (+134843us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18003d6300. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:10.777698 (+197215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.777764 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:10.777812 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.777887 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.778002 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62283,"prepare.queue_time_us":2496,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":196004,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10764,"spinlock_wait_cycles":47842432,"thread_start_us":1057316,"threads_started":2,"wal-append.queue_time_us":633336}
I20260709 13:18:10.776392 14721 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.904049 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:10.905139 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1907) took 2386 ms. Trace:
I20260709 13:18:10.900648 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:10.721627 14917 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.824303 15194 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:10.910842 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 74635.7us
I20260709 13:18:10.974332 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.974530 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2332) took 1277 ms. Trace:
I20260709 13:18:10.896574 15302 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:10.912477 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2333) took 1175 ms. Trace:
I20260709 13:18:10.979072 10035 rpcz_store.cc:276] 0709 13:18:09.737213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.902982 (+1165769us) service_pool.cc:224] Handling call
0709 13:18:10.911936 (+  8954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.912135 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.912160 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.912201 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.912233 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.912290 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.912408 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.969301 10189 rpcz_store.cc:276] 0709 13:18:08.518277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.920027 (+401750us) service_pool.cc:224] Handling call
0709 13:18:08.937142 (+ 17115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.600455 (+663313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.600494 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.611879 (+ 11385us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.304311 (+692432us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.304357 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.589228 (+284871us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400100254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:10.629404 (+ 40176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.899808 (+270404us) raft_consensus.cc:1685] finished
0709 13:18:10.899836 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.905048 (+  5212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53371,"raft.queue_time_us":36662,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":34787,"spinlock_wait_cycles":1488452480,"thread_start_us":640811,"threads_started":1,"wal-append.queue_time_us":826013}
W20260709 13:18:10.973007 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98304.8us
I20260709 13:18:10.919925 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2322) took 1490 ms. Trace:
W20260709 13:18:10.925980 15297 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.720s	user 0.003s	sys 0.000s
I20260709 13:18:10.899220 15160 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:10.936717 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.943101 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97963us
I20260709 13:18:10.988703 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.943435 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:10.847718 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:10.989055 10031 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:10.943919 10183 rpcz_store.cc:276] 0709 13:18:08.846912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.290347 (+443435us) service_pool.cc:224] Handling call
0709 13:18:09.290778 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.291313 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.291357 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.294795 (+  3438us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.598217 (+303422us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:09.598258 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.598326 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.589552 (+991226us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:10.943060 (+353508us) raft_consensus.cc:1685] finished
0709 13:18:10.943083 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.943309 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1793,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"spinlock_wait_cycles":7783680,"thread_start_us":303023,"threads_started":1,"wal-append.queue_time_us":726859}
I20260709 13:18:10.943490 10188 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:10.908125 15189 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.895977 15246 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.927016 15324 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.969424 15318 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:10.970223 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3081) took 1584 ms. Trace:
I20260709 13:18:10.989948 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2335) took 1220 ms. Trace:
I20260709 13:18:10.990600 10107 rpcz_store.cc:276] 0709 13:18:09.366987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.510333 (+143346us) service_pool.cc:224] Handling call
0709 13:18:10.946971 (+1436638us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540024fed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:10.951837 (+  4866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2803538688}
I20260709 13:18:10.952147 10187 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:10.911497 15314 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.912086 15323 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:10.972487 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71926.7us
I20260709 13:18:10.974941 10038 rpcz_store.cc:276] 0709 13:18:09.697380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.871926 (+1174546us) service_pool.cc:224] Handling call
0709 13:18:10.873638 (+  1712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.974272 (+100634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.974471 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.909348 15212 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.917339 15017 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:10.918717 10033 rpcz_store.cc:276] 0709 13:18:09.411058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.651525 (+1240467us) service_pool.cc:224] Handling call
0709 13:18:10.651887 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.844693 (+192806us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b54000134a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45fdc0 00007f3c6f4ea1c0 00007f3c6f4eb231 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c
0709 13:18:10.845242 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.845432 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132437760}
I20260709 13:18:11.011245 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.012715 10033 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:10.981961 10040 rpcz_store.cc:276] 0709 13:18:09.429254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.702159 (+1272905us) service_pool.cc:224] Handling call
0709 13:18:10.715874 (+ 13715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.716087 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:10.776242 (+ 60155us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.919558 (+143316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.919616 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:10.919664 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.919730 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.919866 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":553,"prepare.queue_time_us":74814,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":40,"raft.queue_time_us":664,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":11940224,"thread_start_us":141345,"threads_started":1,"wal-append.queue_time_us":144889}
I20260709 13:18:10.990758 10031 rpcz_store.cc:276] 0709 13:18:09.769791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.504641 (+734850us) service_pool.cc:224] Handling call
0709 13:18:10.838603 (+333962us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54001654a8. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752c5924 00007f3c744ae227 00007f3c744adab8 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:10.989871 (+151268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34215808}
I20260709 13:18:11.013550 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:10.981071 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2334) took 1235 ms. Trace:
I20260709 13:18:11.014173 10711 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:10.989641 10113 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.976159 10114 rpcz_store.cc:276] 0709 13:18:09.287183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.287305 (+   122us) service_pool.cc:224] Handling call
0709 13:18:09.287658 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.297527 (+  9869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.297558 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.303505 (+  5947us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.564107 (+260602us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18002056c0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:18:09.982964 (+418857us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:10.040332 (+ 57368us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.637869 (+597537us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:10.738905 (+101036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.738997 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.865299 (+126302us) raft_consensus.cc:1685] finished
0709 13:18:10.865319 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.865452 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129314,"prepare.queue_time_us":57040,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":194780,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":30225,"spinlock_wait_cycles":71838720,"thread_start_us":1050869,"threads_started":2,"wal-append.queue_time_us":920718}
W20260709 13:18:10.998023 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54683.7us
I20260709 13:18:11.000536 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.017479 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.002085 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.018960 10153 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:10.977923 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:10.975301 14720 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.004s
W20260709 13:18:10.979856 14662 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 1.006s	user 0.014s	sys 0.007s
I20260709 13:18:11.007028 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2337) took 1081 ms. Trace:
I20260709 13:18:11.019164 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.014384 10035 rpcz_store.cc:276] 0709 13:18:09.745638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.980237 (+1234599us) service_pool.cc:224] Handling call
0709 13:18:10.980564 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.980765 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.980792 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.980837 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:10.980865 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.980920 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.981022 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.020591 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:10.976267 15027 consensus_meta.cc:287] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.945s	user 0.008s	sys 0.013s
I20260709 13:18:10.952608 15110 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:11.051007 10113 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:11.038162 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.108081 10038 rpcz_store.cc:276] 0709 13:18:09.926546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.006189 (+1079643us) service_pool.cc:224] Handling call
0709 13:18:11.006518 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.006685 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.006732 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.006773 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:11.006803 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.006855 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.006960 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.978922 15302 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.983310 14980 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:11.112291 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81576.2us
I20260709 13:18:11.111385 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:11.121341 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 102248us
W20260709 13:18:11.112640 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 134808us
I20260709 13:18:11.115010 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.125320 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:10.991878 14933 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:11.117329 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 96788.8us
I20260709 13:18:11.137357 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.138589 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:10.987389 15254 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:11.132958 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.140404 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.139353 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.004285 15317 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.141505 10188 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:10.996753 15306 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:11.204792 15313 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:11.205053 15109 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.205436 15306 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:11.206032 15323 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.206640 15306 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.207579 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2331) took 1515 ms. Trace:
I20260709 13:18:11.205446 15313 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.143525 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.144850 10714 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:11.209934 14800 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:11.210776 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:11.211596 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 68169.3us
I20260709 13:18:11.212478 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.213322 10180 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:11.213457 15212 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:11.214568 15332 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 13:18:11.214963 15194 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.215677 15224 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:11.216176 15330 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:18:11.200011 14933 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:11.216908 14933 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:11.217146 15327 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:18:11.217315 14933 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.217602 14965 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:11.218093 14965 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:11.218861 15340 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:18:11.220491 14800 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.221058 14800 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.143208 10682 leader_election.cc:400] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17.
I20260709 13:18:11.222720 10682 leader_election.cc:403] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:11.223459 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 80410.9us
I20260709 13:18:11.108253 15215 raft_consensus.cc:2764] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:11.229390 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.230815 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.232089 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.232277 14800 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.205631 15060 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.233214 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:11.235330 10034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2330) took 1599 ms (client timeout 1990 ms). Trace:
W20260709 13:18:11.235788 10034 rpcz_store.cc:269] 0709 13:18:09.635637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.161132 (+525495us) service_pool.cc:224] Handling call
0709 13:18:11.235171 (+1074039us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400043654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:11.235271 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328285440}
I20260709 13:18:11.236341 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.236958 10709 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:11.237157 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.010044 15292 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:18:11.241206 15022 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.242753 14965 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.009377 15015 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:11.208654 15335 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:10.969424 15322 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.244980 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.244108 15324 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.245730 15317 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.250542 14933 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.008785 15058 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:11.031451 15256 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:11.302151 15317 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:11.294474 15015 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:18:11.211990 15345 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:11.207990 10036 rpcz_store.cc:276] 0709 13:18:09.691716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.869720 (+1178004us) service_pool.cc:224] Handling call
0709 13:18:10.870065 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.870282 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.870306 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.870757 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.928092 (+ 57335us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:10.928154 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.928267 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.207299 (+279032us) raft_consensus.cc:1685] finished
0709 13:18:11.207322 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.207489 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":56894,"threads_started":1,"wal-append.queue_time_us":262697}
I20260709 13:18:11.145633 15017 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.150s
I20260709 13:18:11.029664 15174 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.267187 15318 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.104823 15075 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.309640 15015 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.333925 15313 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.313606 15322 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.315634 15324 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.268410 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.009720 15192 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.269063 15246 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.269505 15309 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.010345 15217 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:11.109675 15110 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.117044 15160 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.134473 15302 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.139964 15181 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:11.286656 10709 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:11.141964 15295 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:11.286674 10711 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:11.009941 15180 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.244s
I20260709 13:18:11.369326 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.370179 10185 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:11.373473 10189 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:11.373929 10189 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:11.375792 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.262545 14981 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:11.262321 15079 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:11.298923 14933 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.299435 15058 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.314203 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2317) took 1928 ms. Trace:
I20260709 13:18:11.345108 15174 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.405838 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:11.276870 15131 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:11.123910 14662 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.132359 14720 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:11.120571 15027 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:10.962582 14998 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:11.203284 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63865.2us
W20260709 13:18:11.421175 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 461799us
I20260709 13:18:11.304797 14965 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:11.347734 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 328862us
I20260709 13:18:11.362958 10707 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:11.396566 15253 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.432657 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:11.382941 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.434118 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.389986 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.392014 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.397039 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.357120 15110 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:11.374727 10189 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.439217 10189 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.400252 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.407287 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.356676 15217 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.367556 14762 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17.
W20260709 13:18:11.338056 15321 consensus_queue.cc:1175] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 16 status { last_received { term: 16 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 16 index: 12 } }
I20260709 13:18:11.365653 15181 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.365136 15295 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:11.405532 10032 rpcz_store.cc:276] 0709 13:18:09.385863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.386011 (+   148us) service_pool.cc:224] Handling call
0709 13:18:09.386369 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.395371 (+  9002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.395405 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.395931 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.544006 (+148075us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4800080358. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:18:09.802706 (+258700us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:09.802756 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.802830 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.872555 (+1069725us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:11.313918 (+441363us) raft_consensus.cc:1685] finished
0709 13:18:11.313944 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.314112 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8563,"raft.queue_time_us":8681,"raft.run_cpu_time_us":834,"raft.run_wall_time_us":147626,"spinlock_wait_cycles":20379136,"thread_start_us":338835,"threads_started":1,"wal-append.queue_time_us":651999}
I20260709 13:18:11.435204 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:11.436478 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.435915 10038 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
W20260709 13:18:11.406131 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 271572us
I20260709 13:18:11.440542 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.494365 10031 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:11.402851 15079 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.405653 15170 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:11.443197 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.499264 15079 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:11.462206 14841 consensus_meta.cc:287] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.001s
I20260709 13:18:11.500221 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.500833 10035 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:11.500669 14841 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.447464 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.502948 14841 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.503347 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.411367 15131 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:11.499293 15170 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:11.504097 15131 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.504943 14721 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:11.504621 15170 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.505491 14721 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:11.505874 15170 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.506397 14721 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.424378 15060 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:11.458237 10037 raft_consensus.cc:2368] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:11.459012 10710 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:11.462598 15181 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:11.509922 15350 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:11.448693 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:11.425988 15318 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:18:11.510703 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62093.6us
I20260709 13:18:11.479382 15295 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.512336 15309 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.514567 15254 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:11.514993 15254 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.515354 15254 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.518607 15027 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.443008 14980 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:11.520529 14980 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.521292 14720 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:11.522969 14662 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:11.524143 15344 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:11.525983 10034 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.529405 15174 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:11.530486 15314 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 13:18:11.530938 15314 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.532014 10036 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:11.444324 15317 consensus_queue.cc:1175] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f672b54d4754c5aa62b5b919597a14e" responder_term: 15 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:11.533231 15314 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.447245 15217 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.452312 15253 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.540988 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.462132 15026 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:11.541676 10184 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:11.541796 15026 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.542203 15026 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.542753 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:11.543287 15346 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:18:11.544468 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.545581 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.463349 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.412405 15322 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:18:11.546590 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.402681 15274 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:18:11.548697 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.559078 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.559404 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.560912 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.561281 10035 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:11.562222 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.563014 10184 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:11.564180 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:11.492769 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 57652.4us
I20260709 13:18:11.493806 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.491549 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.568401 10031 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:11.566493 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.573292 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.575011 10187 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:11.575230 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.566579 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:11.575868 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.578161 10034 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:11.580288 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.582696 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.584264 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.586061 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:11.586158 10039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 825) took 1755 ms (client timeout 2135 ms). Trace:
I20260709 13:18:11.589617 10189 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
W20260709 13:18:11.586684 10039 rpcz_store.cc:269] 0709 13:18:09.830465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.408240 (+577775us) service_pool.cc:224] Handling call
0709 13:18:11.585988 (+1177748us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400411c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:11.586105 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230622464}
I20260709 13:18:11.589998 10189 pending_rounds.cc:85] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 12
I20260709 13:18:11.590348 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.590344 10189 pending_rounds.cc:107] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:18:11.591269 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.591436 10189 raft_consensus.cc:2889] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.595923 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.600039 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.601409 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.602147 10189 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 15 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:18:11.572849 14981 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.597174 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:11.606058 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.629614 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.608111 15254 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.609159 15309 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:11.583391 15027 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:11.609323 15079 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.611095 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133523a809584dd5b44a19acf589801d"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:11.582080 14662 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:11.593036 15318 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:11.616215 15326 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:18:11.626259 10037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2326) took 2025 ms (client timeout 1630 ms). Trace:
I20260709 13:18:11.631474 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:11.581485 15234 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:11.667616 10710 raft_consensus.cc:606] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.667650 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.677631 10184 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:11.588857 15320 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:11.669560 10004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.069s
W20260709 13:18:11.675926 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44523.9us
W20260709 13:18:11.675513 10037 rpcz_store.cc:269] 0709 13:18:09.601033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.701438 (+100405us) service_pool.cc:224] Handling call
0709 13:18:11.626057 (+1924619us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400066dd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:11.626188 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3741626240}
I20260709 13:18:11.588685 15058 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.605165 14998 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:11.675199 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 257700us
W20260709 13:18:11.683038 10004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.069s
I20260709 13:18:11.664659 15324 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:11.688784 10187 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:11.618887 14980 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:11.690246 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 672804us
I20260709 13:18:11.690956 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.636080 15322 consensus_queue.cc:1243] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:11.644006 14720 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.671391 15027 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:11.694170 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 112655us
I20260709 13:18:11.698659 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:11.702080 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.700379 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.705397 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.684362 15320 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.684176 15246 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:11.710546 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.711138 10184 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.712617 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.713269 10710 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:11.716441 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.717484 10711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ff24b1804914099b167420853598f48"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:11.718366 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.714393 14983 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:11.720755 14983 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:11.688611 14841 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:11.721115 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.721669 14983 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.683995 15318 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.724113 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:11.724828 15302 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.725468 15131 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.726570 10185 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.709473 15246 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:11.707293 15313 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.727152 15302 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:11.720989 15079 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.727697 15131 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.738425 10710 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:11.728137 15246 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:11.740242 15352 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:18:11.741468 15324 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:11.742461 14801 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:11.742897 14801 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.743242 14801 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.728546 10186 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:11.744083 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.745747 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.746842 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.748088 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.725487 15318 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.749334 15318 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:11.749680 15318 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:11.750052 15318 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.676592 15181 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.753897 10180 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:11.755396 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.756956 15254 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.709153 15320 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.759325 15313 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:11.759792 15181 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:11.757761 10180 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:11.705132 15027 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.709715 15253 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.764511 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.764624 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.757836 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.766260 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.735800 10185 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:11.767537 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:11.764205 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.767882 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.769191 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.769469 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.761229 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.770224 10033 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:11.770377 10180 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.771312 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.773149 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.773629 10186 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:11.774996 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.776216 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.776697 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.776813 10037 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:11.777880 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.783866 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:11.787427 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:11.788761 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.788901 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.798277 10036 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:11.799224 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.799834 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.799243 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.801458 10033 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:11.707162 15322 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:11.801378 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.827812 10039 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
W20260709 13:18:11.828210 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57636.3us
I20260709 13:18:11.828814 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.829970 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:11.830757 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 333814us
I20260709 13:18:11.802289 10037 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:11.803033 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.833841 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.804268 15302 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:11.804658 15181 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:11.805256 10710 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:11.806428 10040 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:11.842419 10037 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:11.842613 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.841010 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:11.843291 10040 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:11.808003 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:11.841480 15302 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:11.845705 10031 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:11.812119 15131 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.815514 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.811440 14980 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.847275 15131 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.848007 14998 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:11.849248 15326 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:11.849632 15026 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:11.823618 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.850835 15246 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.825723 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.852408 10033 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:11.801682 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.832811 10715 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:11.723506 15295 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:11.827111 10184 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:11.855569 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:11.840942 10711 raft_consensus.cc:606] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.850026 15131 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:11.858131 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:11.857056 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.839372 10180 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:11.862854 10185 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:11.880528 10186 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:11.827637 15313 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:11.829516 15322 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:11.845642 15302 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:11.901459 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 99835.5us
I20260709 13:18:11.827941 15060 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:11.903115 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:11.903635 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 313364us
I20260709 13:18:11.903681 10184 raft_consensus.cc:2376] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14. Re-sending same reply.
I20260709 13:18:11.865218 15260 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:11.905315 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:11.900156 15313 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.907773 10039 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:11.908356 10188 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.801844 15110 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.902798 15174 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:11.908052 15314 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:18:11.916566 15260 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:11.923249 15295 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:11.925065 15026 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:11.926023 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:11.927863 10715 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:11.902990 15322 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.903697 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:11.942817 15313 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.994627 10188 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:11.996235 10710 raft_consensus.cc:2368] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:11.996917 10032 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:11.998185 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 94552.1us
I20260709 13:18:12.000016 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:12.004017 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.004832 10033 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:11.852022 15255 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:11.909286 15017 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:18:12.011600 10153 leader_election.cc:400] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:11.912865 15131 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:18:11.910030 15217 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.018760 10153 leader_election.cc:403] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:12.029774 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:12.039463 15295 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:12.015710 15079 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.043931 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:12.010965 15026 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.047683 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 929) took 1400 ms. Trace:
I20260709 13:18:12.048226 10707 rpcz_store.cc:276] 0709 13:18:10.647809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.647940 (+   131us) service_pool.cc:224] Handling call
0709 13:18:10.648279 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.432398 (+784119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.047443 (+615045us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54003cee54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:12.047623 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643088768}
I20260709 13:18:12.051522 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.045812 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:12.046437 10031 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:11.995857 15170 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:18:12.056917 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:12.058087 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 356136us
W20260709 13:18:12.056142 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 354120us
I20260709 13:18:12.062103 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.060365 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.064599 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:12.042662 15246 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.078384 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:12.075421 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.017549 15348 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:12.088424 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.058024 15180 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:12.057744 15255 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:12.099408 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.073520 15360 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:12.072923 15131 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:12.087777 10079 leader_election.cc:400] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:12.102329 10079 leader_election.cc:403] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:12.102574 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:12.103091 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.047766 15153 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:12.071935 15015 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.105713 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.114073 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.082939 14762 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.016001 15060 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.079198 15295 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:12.077955 14998 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:12.076471 15318 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.107996 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.078501 15234 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:12.117187 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.075613 15307 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:18:12.058908 15260 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:12.094622 15180 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:12.099072 15274 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:12.096387 14965 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:12.112378 10185 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:12.095685 15361 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:12.126603 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.116670 10183 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.112834 15153 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.108739 15058 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:12.128942 10038 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.077318 15320 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.191049 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.244241 10034 raft_consensus.cc:2368] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:12.127661 15323 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:12.133265 15180 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:12.260381 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 195866us
I20260709 13:18:12.130909 15365 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:12.123734 15027 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.244738 15153 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.242663 15131 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:12.257038 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.247679 15274 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:12.271332 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 168192us
I20260709 13:18:12.264798 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:12.261929 14998 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:12.268255 15361 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:12.269371 15358 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:12.271082 14965 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:12.301635 15361 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:12.302670 15331 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.794s	user 0.000s	sys 0.005s
W20260709 13:18:12.303229 15364 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:12.302845 15358 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.303875 15379 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:12.294092 15170 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:12.301826 14965 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.305461 15358 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.296610 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.306640 14965 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:12.284940 15254 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.303380 15362 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:18:12.307467 15254 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.304395 15379 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.308879 15379 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.284828 15131 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.300108 10038 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:12.309715 15254 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.267889 15295 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:12.320206 10035 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:12.286996 15217 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:12.302578 15367 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:18:12.311134 15359 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
W20260709 13:18:12.354502 15373 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:18:12.355775 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 59272us
W20260709 13:18:12.356200 15375 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:18:12.356437 15372 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:18:12.358287 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.358807 14965 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:12.360575 14965 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:18:12.299634 14998 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.384529 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.391429 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1923) took 1253 ms. Trace:
I20260709 13:18:12.391884 10189 rpcz_store.cc:276] 0709 13:18:11.138304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.602747 (+464443us) service_pool.cc:224] Handling call
0709 13:18:11.603317 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.603663 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.603691 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.604915 (+  1224us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.942847 (+337932us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:11.942890 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.942972 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.391229 (+448257us) raft_consensus.cc:1685] finished
0709 13:18:12.391250 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.391370 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":32643,"thread_start_us":251997,"threads_started":1,"wal-append.queue_time_us":435433}
W20260709 13:18:12.388957 15363 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
I20260709 13:18:12.399531 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.400516 10114 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:12.380012 15368 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:12.407255 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.411626 10035 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.417128 10109 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:12.419059 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.419396 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.419858 10109 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:12.419691 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.420387 10106 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:12.420426 10111 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:12.422443 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.422745 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:12.422472 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:12.423235 10106 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 9.
I20260709 13:18:12.423513 10715 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:12.424489 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.424549 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:12.428557 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.439666 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.441763 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.442339 10112 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:12.443879 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.445127 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.445449 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.446885 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.448311 10109 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.449285 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.450131 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.450872 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.451401 10106 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:12.453076 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.453681 10106 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:12.458930 10111 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.460059 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.436689 15318 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.483655 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.437288 15190 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:12.486757 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.488549 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.489331 10106 raft_consensus.cc:2368] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:18:12.490338 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.491225 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.492945 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:12.493830 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 74171.4us
I20260709 13:18:12.494104 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.494676 10115 raft_consensus.cc:2368] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:12.495386 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.495312 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.494060 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.496227 10106 raft_consensus.cc:2368] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:12.498764 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.499342 10106 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.501140 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.504477 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.505173 10111 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:12.506063 10035 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:12.376925 15274 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.535207 10708 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:18:12.485760 15027 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.437029 15379 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.537726 15170 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:12.542832 15378 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:18:12.509971 15392 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.543951 15392 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:12.545099 15392 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:12.550930 15322 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.002s
I20260709 13:18:12.509580 15234 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:18:12.561113 14801 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.817s	user 0.012s	sys 0.000s
I20260709 13:18:12.561650 14801 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.563267 10113 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:12.568202 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.537616 15387 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.573415 15387 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.515033 14762 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:18:12.539641 15254 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:12.543190 15170 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.570469 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2352) took 1072 ms. Trace:
I20260709 13:18:12.615218 10032 rpcz_store.cc:276] 0709 13:18:11.497944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.558817 (+ 60873us) service_pool.cc:224] Handling call
0709 13:18:11.559061 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.998436 (+439375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.570167 (+571731us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540031ced4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:12.570396 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985076992}
I20260709 13:18:12.602016 10108 raft_consensus.cc:2410] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:18:12.602676 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 105581us
I20260709 13:18:12.601833 15320 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.603827 10106 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:12.604236 15392 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.611402 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.612932 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.614578 10036 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:12.627768 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:12.629048 15379 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:12.633104 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:12.634471 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.636929 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.638090 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.639823 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.641129 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.641719 10106 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:12.642616 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.643683 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.645556 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.646952 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.551450 15322 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.651670 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:12.651052 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:12.656430 10037 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:12.656050 15320 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:12.648180 15079 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.002s
I20260709 13:18:12.658457 10114 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:12.668748 10115 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:12.669772 15079 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:12.670197 15374 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:18:12.648281 15323 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:12.658680 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.671604 10184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2412) took 1140 ms. Trace:
I20260709 13:18:12.672026 10184 rpcz_store.cc:276] 0709 13:18:11.531601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.921153 (+389552us) service_pool.cc:224] Handling call
0709 13:18:11.921459 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.922699 (+  1240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.922729 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.923208 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.094224 (+171016us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:12.094265 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.094337 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.671368 (+577031us) raft_consensus.cc:1685] finished
0709 13:18:12.671390 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.671544 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":855,"raft.queue_time_us":2102,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":170622,"threads_started":1,"wal-append.queue_time_us":328212}
I20260709 13:18:12.689551 15322 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.631718 15390 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.692214 15390 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.669994 15320 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:12.696496 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.617041 15254 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.653312 15379 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:18:12.697100 15320 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:12.714010 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 55796us
W20260709 13:18:12.713215 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 76349.5us
I20260709 13:18:12.715550 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:12.709362 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 74427.1us
I20260709 13:18:12.710050 15079 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:12.716838 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:12.661366 14917 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:18:12.695525 15180 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:12.725325 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.719404 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.728011 15379 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:12.741286 15254 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.723290 15079 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:12.754035 15060 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:12.754377 10081 leader_election.cc:400] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:12.755251 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.755378 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:12.733929 14998 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:12.726989 15153 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.762156 10106 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
W20260709 13:18:12.756415 15313 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.736s	user 0.012s	sys 0.000s
I20260709 13:18:12.774290 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.770313 15079 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:12.777657 15313 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:12.779218 14801 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.779896 15313 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:12.783325 10180 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:12.727612 15361 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:12.763796 15396 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.764250 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.769188 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:12.771723 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.763299 15323 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:12.762974 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.817938 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.819372 10111 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:12.786330 10033 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.821391 15180 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:12.794405 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.832784 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.834359 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.764642 15379 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:12.835457 15379 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:12.838953 15390 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:12.840878 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:12.842185 10709 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.797943 14801 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:12.798586 15394 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:12.799430 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.803977 15256 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.806419 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2899) took 1028 ms. Trace:
I20260709 13:18:12.844709 10039 rpcz_store.cc:276] 0709 13:18:11.778307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.829730 (+ 51423us) service_pool.cc:224] Handling call
0709 13:18:12.806150 (+976420us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54003bd8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:12.806326 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177025920}
I20260709 13:18:12.808166 10034 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:18:12.809852 15110 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:12.811923 15383 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.452s	user 0.003s	sys 0.000s
I20260709 13:18:12.812127 15392 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:12.822113 15153 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:12.825191 15407 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:12.823580 15079 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:12.828425 15403 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:12.882061 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.882820 10039 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.830787 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 1111) took 1306 ms. Trace:
I20260709 13:18:12.884246 10188 rpcz_store.cc:276] 0709 13:18:11.524492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.546380 (+ 21888us) service_pool.cc:224] Handling call
0709 13:18:12.830556 (+1284176us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54002adfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:12.830695 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825442048}
I20260709 13:18:12.885713 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:12.886446 10188 raft_consensus.cc:2368] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:12.847345 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:12.850561 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:12.887646 10188 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:12.852596 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.853219 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.854285 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.891644 10107 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.789471 10106 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:12.848383 15180 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:12.890450 15170 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:12.844514 15256 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:12.903231 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.906243 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:12.892318 15302 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.980s	user 0.018s	sys 0.000s
I20260709 13:18:12.855930 15390 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:18:12.899474 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:12.907835 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:12.948777 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.949409 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:12.911021 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:12.891093 15153 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:12.959434 10039 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:12.960829 10109 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:18:12.924578 15382 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.520s	user 0.003s	sys 0.000s
I20260709 13:18:12.960516 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1951) took 1108 ms. Trace:
I20260709 13:18:12.964844 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.964919 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:12.966015 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.966320 10038 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:12.968043 10107 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:12.962496 10182 rpcz_store.cc:276] 0709 13:18:11.851921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.628968 (+777047us) service_pool.cc:224] Handling call
0709 13:18:12.629272 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.629502 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:12.629807 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.960122 (+330315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.960178 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:12.960228 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.960307 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.960446 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":538,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":99,"thread_start_us":329862,"threads_started":1}
W20260709 13:18:12.973549 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 67642.7us
W20260709 13:18:12.974534 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 75142.6us
I20260709 13:18:12.975420 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:12.922101 15075 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.987582 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:12.910504 15189 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.893678 15392 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:12.961925 15410 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:18:13.012416 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.023316 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 43774.3us
I20260709 13:18:12.893934 15361 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:18:13.025167 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51490 (request call id 31) took 1284 ms. Trace:
I20260709 13:18:13.027082 10711 rpcz_store.cc:276] 0709 13:18:11.716096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.717368 (+  1272us) service_pool.cc:224] Handling call
0709 13:18:13.000721 (+1283353us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540062dc54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e2853 00007f3c744b060a 00007f3c6da367d4 00007f3c6da36762 00007f3c6da36691 00007f3c6da3660c 00007f3c6da358c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.000816 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282677632}
I20260709 13:18:12.986727 15017 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:12.990351 15027 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:12.986842 15358 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.953387 15302 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.022859 15365 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:12.987183 15110 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:18:12.998319 15189 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:12.924607 15256 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:13.059018 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 212034us
I20260709 13:18:13.063911 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:13.066435 10182 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:13.068106 10184 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:13.070442 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:13.079455 10188 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:18:13.141347 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81308.5us
I20260709 13:18:13.142436 10078 leader_election.cc:400] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:13.142819 10078 leader_election.cc:403] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.144249 10189 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:18:13.051406 15079 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.077723 15392 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.143956 15015 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.054436 14998 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:18:13.149173 15396 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:13.181797 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 347488us
I20260709 13:18:13.183928 15404 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.148497 15256 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.155053 15153 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:13.186290 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44034.6us
I20260709 13:18:13.159124 15394 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.178510 15401 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.189448 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.196288 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:13.197899 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 207685us
I20260709 13:18:13.201119 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:13.205041 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.201879 10182 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:18:13.208995 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.186790 15015 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.211665 15015 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.186009 15189 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.201977 15401 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.213348 15318 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:13.213608 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:13.215204 10182 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.216954 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:13.214702 15387 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:13.206441 15396 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:13.214469 15401 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:13.218124 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:13.209791 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:13.218879 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2908) took 1213 ms. Trace:
I20260709 13:18:13.219234 10033 rpcz_store.cc:276] 0709 13:18:12.005962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.006072 (+   110us) service_pool.cc:224] Handling call
0709 13:18:12.006373 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.820088 (+813715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.218650 (+398562us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540031b0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.218823 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782718848}
I20260709 13:18:13.222304 10113 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:13.221987 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:13.225217 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2904) took 1445 ms. Trace:
I20260709 13:18:13.225610 10031 rpcz_store.cc:276] 0709 13:18:11.779554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.846498 (+ 66944us) service_pool.cc:224] Handling call
0709 13:18:11.846794 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.052737 (+205943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.224996 (+1172259us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540031ddd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.225156 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458711808}
I20260709 13:18:13.227900 15318 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.228792 15318 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.230001 15318 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:13.227435 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:13.234256 10180 raft_consensus.cc:2410] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:13.235781 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 805) took 1154 ms. Trace:
I20260709 13:18:13.236389 10180 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:13.236863 15414 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:18:13.236181 10707 rpcz_store.cc:276] 0709 13:18:12.081729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.083613 (+  1884us) service_pool.cc:224] Handling call
0709 13:18:12.084038 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.624973 (+540935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.625010 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.630293 (+  5283us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:12.630343 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.235494 (+605151us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54005f0354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.235544 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.235680 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1243471616}
W20260709 13:18:13.232620 15411 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:18:13.231274 15377 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.875s	user 0.003s	sys 0.000s
I20260709 13:18:13.245287 15322 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:13.245677 15246 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:13.245782 15322 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.246136 15246 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.247062 15246 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.248124 15015 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:13.231479 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.219159 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:13.230924 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 243253us
I20260709 13:18:13.248960 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.256875 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.257400 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.258622 10153 leader_election.cc:400] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:18:13.258863 10153 leader_election.cc:403] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.260294 10036 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:13.178359 15392 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.268782 15392 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:13.270747 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 68364.2us
I20260709 13:18:13.271513 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:13.276022 15060 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:13.276477 15302 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.277304 15317 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.278154 15317 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:13.278928 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:13.279289 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:13.280085 10038 raft_consensus.cc:2368] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:13.281924 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:13.282555 10038 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:13.256223 10033 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:13.262116 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 66289.8us
I20260709 13:18:13.262219 10182 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:13.263950 10181 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:13.284916 10181 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:13.285847 10153 leader_election.cc:400] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:13.287124 15387 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13.
I20260709 13:18:13.192833 15079 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:18:13.265096 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:13.211449 15379 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.196036 15153 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.290239 15379 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.291276 15153 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:13.291476 14998 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:13.291917 15429 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:13.293277 15429 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:13.293437 14998 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:13.294278 15401 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:13.294531 15380 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:13.266990 15321 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.295042 15380 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.288470 15079 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:13.295843 15380 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:13.292217 15420 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:13.297052 15380 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.286784 10153 leader_election.cc:400] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:13.266134 15322 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.296264 15079 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:13.307791 15079 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.310281 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:13.301306 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.313606 10038 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:13.318186 15246 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.294592 15429 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.307832 15322 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.286577 10181 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.322396 15153 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.322962 10181 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.325896 10033 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:13.320544 15429 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.194772 15394 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.327430 15429 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.329504 15394 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:13.336920 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.302704 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45956.5us
I20260709 13:18:13.340797 10714 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:18:13.345259 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.313408 15385 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.958s	user 0.000s	sys 0.005s
I20260709 13:18:13.341245 10714 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:18:13.313647 15377 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 13:18:13.349660 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2900) took 1571 ms. Trace:
I20260709 13:18:13.350087 10040 rpcz_store.cc:276] 0709 13:18:11.778615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.844142 (+ 65527us) service_pool.cc:224] Handling call
0709 13:18:11.844422 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.860683 (+ 16261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:11.911161 (+ 50478us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.144283 (+233122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.258444 (+114161us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.258590 (+   146us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:12.258952 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.267378 (+  8426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.267637 (+   259us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.230710 (+963073us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:13.308366 (+ 77656us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4800080358. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c74411aa1 00007f3c74408b37 00007f3c744089ca 00007f3c7450026f 00007f3c744fff37 00007f3c7451455c 00007f3c74514508 00007f3c74514488 00007f3c74514443 00007f3c745136ec 00007f3c7343da96
0709 13:18:13.349464 (+ 41098us) raft_consensus.cc:1685] finished
0709 13:18:13.349491 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.349603 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23751,"prepare.queue_time_us":50470,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":4171,"raft.queue_time_us":24937,"raft.run_cpu_time_us":12275,"raft.run_wall_time_us":1446684,"spinlock_wait_cycles":44802688,"thread_start_us":173542,"threads_started":1,"wal-append.queue_time_us":376909}
W20260709 13:18:13.353413 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.347438 15144 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:18:13.331478 15404 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
W20260709 13:18:13.366375 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65151.8us
I20260709 13:18:13.368469 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:13.392378 10081 leader_election.cc:400] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:13.394071 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:13.366547 15429 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.366199 10038 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:13.396047 10708 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:13.397316 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.400337 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:13.364352 10181 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:18:13.408151 10181 pending_rounds.cc:85] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 13
I20260709 13:18:13.408485 10181 pending_rounds.cc:107] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:18:13.408743 10181 raft_consensus.cc:2889] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.416841 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 996) took 1288 ms. Trace:
I20260709 13:18:13.392908 15358 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:13.393257 15153 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:13.417361 10710 rpcz_store.cc:276] 0709 13:18:12.128707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.128872 (+   165us) service_pool.cc:224] Handling call
0709 13:18:12.129235 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.129597 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.129625 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.148490 (+ 18865us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.300157 (+151667us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:12.300203 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.300273 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.228942 (+928669us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:13.399732 (+170790us) raft_consensus.cc:1685] finished
0709 13:18:13.399772 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.416765 (+ 16993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":791,"raft.queue_time_us":1888,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11364,"spinlock_wait_cycles":14250240,"thread_start_us":20836,"threads_started":1,"wal-append.queue_time_us":104622}
I20260709 13:18:13.430989 15417 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.432564 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.399492 15404 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:13.424448 15181 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:18:13.391260 15431 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:18:13.425138 15060 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.440783 15309 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.414278 15321 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:18:13.430521 15302 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:13.461191 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.423545 15416 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.416854 15349 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:18:13.476231 15131 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:13.472260 15302 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.479312 15302 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.480902 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:13.481796 10109 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:13.481880 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:13.486559 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.487833 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.435024 15417 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.490646 15417 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:13.440385 15153 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.494546 15153 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.430821 15323 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:13.438881 15058 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:18:13.498625 15260 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.499267 15260 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.500346 10112 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:13.488970 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:13.508335 10113 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.509810 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:13.510017 10707 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:18:13.511504 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:13.511510 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:13.514303 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:13.520007 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.521647 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:13.528594 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1010) took 1119 ms. Trace:
I20260709 13:18:13.529091 10114 rpcz_store.cc:276] 0709 13:18:12.409584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.409974 (+   390us) service_pool.cc:224] Handling call
0709 13:18:12.430584 (+ 20610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.669395 (+238811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.528297 (+858902us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540017d754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.528521 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523559680}
I20260709 13:18:13.530440 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:13.532346 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2416) took 1902 ms. Trace:
I20260709 13:18:13.532783 10185 rpcz_store.cc:276] 0709 13:18:11.630043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.143990 (+513947us) service_pool.cc:224] Handling call
0709 13:18:12.248698 (+104708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.349083 (+100385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.349119 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.349163 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:12.349197 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.532103 (+1182906us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002d46d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.532156 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.532284 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229979904}
I20260709 13:18:13.535771 15416 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:13.536772 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2358) took 1433 ms. Trace:
I20260709 13:18:13.537186 10034 rpcz_store.cc:276] 0709 13:18:12.103421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.295291 (+191870us) service_pool.cc:224] Handling call
0709 13:18:12.807898 (+512607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.846113 (+ 38215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.536570 (+690457us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54003bd8d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.536709 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177740160}
I20260709 13:18:13.538610 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.539177 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1938) took 2044 ms. Trace:
I20260709 13:18:13.539561 10186 rpcz_store.cc:276] 0709 13:18:11.495182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.778624 (+283442us) service_pool.cc:224] Handling call
0709 13:18:11.880334 (+101710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.888133 (+  7799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.538986 (+1650853us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54002db9d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.539116 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233220864}
I20260709 13:18:13.537633 10113 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:13.541196 10186 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:18:13.541563 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.542685 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:13.544518 14721 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:13.545259 14721 consensus_queue.cc:1243] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:13.546044 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1929) took 2178 ms. Trace:
I20260709 13:18:13.546427 10183 rpcz_store.cc:276] 0709 13:18:11.367972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.641598 (+273626us) service_pool.cc:224] Handling call
0709 13:18:12.116490 (+474892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.174418 (+ 57928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.545825 (+1371407us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003f1bd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.545977 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091469184}
I20260709 13:18:13.543632 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.541538 10186 pending_rounds.cc:85] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 9
I20260709 13:18:13.549858 10186 pending_rounds.cc:107] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:18:13.550153 10186 raft_consensus.cc:2889] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.552781 15189 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.549448 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.549538 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.554863 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.549533 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:13.564354 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.563915 15416 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:13.588030 10113 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:13.585372 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:13.590390 10114 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:13.578599 15295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.026s	sys 0.038s
I20260709 13:18:13.592517 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.583387 15302 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.609211 10115 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
W20260709 13:18:13.593792 15295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.026s	sys 0.038s
I20260709 13:18:13.593274 15181 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:13.596668 15416 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.616888 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:13.619861 10110 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:13.623492 10108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3099) took 1177 ms. Trace:
I20260709 13:18:13.624467 10108 rpcz_store.cc:276] 0709 13:18:12.446522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.446627 (+   105us) service_pool.cc:224] Handling call
0709 13:18:13.619286 (+1172659us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400189554. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.623428 (+  4142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346702208}
W20260709 13:18:13.627533 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 190000us
I20260709 13:18:13.627858 15295 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:13.616663 15317 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:13.616904 15181 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:13.634624 15181 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.626883 15302 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.638044 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.632613 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.642570 14981 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:13.626341 15416 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.648546 15317 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.649760 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.644675 15302 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:13.653403 15302 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.651590 15317 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.656314 15416 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:13.656580 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 1949) took 1805 ms. Trace:
I20260709 13:18:13.656967 10189 rpcz_store.cc:276] 0709 13:18:11.851359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.395157 (+543798us) service_pool.cc:224] Handling call
0709 13:18:12.401672 (+  6515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.144729 (+743057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.656334 (+511605us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54000febd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.656520 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567828352}
I20260709 13:18:13.652235 15444 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.652698 15356 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.659468 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:13.658291 14981 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:13.665210 15356 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.666117 15356 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.668434 15444 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.677461 15170 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:13.677884 15170 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:13.678658 15170 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.679886 15260 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:13.668862 14981 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:13.681371 15302 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.682477 15079 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.682307 14981 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.683316 15302 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.671912 15356 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:13.685788 15413 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.443s	user 0.003s	sys 0.000s
I20260709 13:18:13.695811 15390 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:13.696261 15390 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.697436 15444 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:13.697368 15390 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.698525 15389 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.699167 15389 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:13.699764 15389 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.699803 15390 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.701444 15389 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:13.735009 10112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3107) took 1275 ms (client timeout 1607 ms). Trace:
W20260709 13:18:13.739676 10112 rpcz_store.cc:269] 0709 13:18:12.459554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.459726 (+   172us) service_pool.cc:224] Handling call
0709 13:18:13.734400 (+1274674us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540026cfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.734739 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390846720}
I20260709 13:18:13.690531 15170 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.760968 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:13.762367 10180 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
W20260709 13:18:13.766906 10712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42392 (request call id 937) took 3102 ms (client timeout 1839 ms). Trace:
W20260709 13:18:13.768214 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.770218 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 948) took 1347 ms. Trace:
I20260709 13:18:13.775957 15017 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:13.776633 15017 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:13.777151 15017 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.778856 10189 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:13.781446 10182 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:18:13.781925 10182 pending_rounds.cc:85] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 7
I20260709 13:18:13.782205 10182 pending_rounds.cc:107] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:13.782474 10182 raft_consensus.cc:2889] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.782804 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2417) took 2145 ms. Trace:
I20260709 13:18:13.784335 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:13.783260 10187 rpcz_store.cc:276] 0709 13:18:11.637538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.295896 (+658358us) service_pool.cc:224] Handling call
0709 13:18:12.296205 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.926392 (+630187us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:13.352165 (+425773us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b18002df0a0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf
0709 13:18:13.352312 (+   147us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.565110 (+212798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.565170 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:13.565215 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.748448 (+183233us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54002d3cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:13.748535 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.782610 (+ 34075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21109,"prepare.queue_time_us":71821,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2694,"raft.queue_time_us":1707,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":1455584896,"thread_start_us":294372,"threads_started":2,"wal-append.queue_time_us":215974}
I20260709 13:18:13.785838 15302 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.791080 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:13.797439 15027 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.807507 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.808857 10112 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
W20260709 13:18:13.767482 10712 rpcz_store.cc:269] 0709 13:18:10.663972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.664112 (+   140us) service_pool.cc:224] Handling call
0709 13:18:13.766245 (+3102133us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54006919d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.766522 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6253714688}
I20260709 13:18:13.817031 10714 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.770818 10713 rpcz_store.cc:276] 0709 13:18:12.422968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.423646 (+   678us) service_pool.cc:224] Handling call
0709 13:18:12.423937 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.424150 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:12.434601 (+ 10451us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.768772 (+1334171us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b1800491c80. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:18:13.769310 (+   538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.769413 (+   103us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:13.769533 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.769697 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.769962 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35278,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"spinlock_wait_cycles":8756480,"thread_start_us":69881,"threads_started":1,"wal-append.queue_time_us":121807,"wal-append.run_cpu_time_us":1198,"wal-append.run_wall_time_us":1001224}
I20260709 13:18:13.821377 15079 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:13.824455 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2066) took 1333 ms. Trace:
I20260709 13:18:13.824921 15110 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:13.825501 15110 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:13.826961 15110 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.824924 10110 rpcz_store.cc:276] 0709 13:18:12.491161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.496660 (+  5499us) service_pool.cc:224] Handling call
0709 13:18:13.619454 (+1122794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.623963 (+  4509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.824037 (+200074us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400189550. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:13.824266 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581561088}
I20260709 13:18:13.828128 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:13.829166 10109 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:13.843834 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:13.852144  9935 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 15, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 15 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:13.855645 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.859007 14762 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:13.860092 15435 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:13.798751 15027 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.836237 15079 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:13.883595 15079 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.884163 10034 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:18:13.882198 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.893220 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:13.894448 15181 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.894892 15181 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:13.895268 15181 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.895924 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:13.896433 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 849) took 1115 ms. Trace:
I20260709 13:18:13.896687 10111 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:13.890128 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 633199us
I20260709 13:18:13.900476 10180 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:13.902459 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:13.904707 15401 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:13.905218 15401 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.905603 15401 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.909073 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.917801 15401 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.921099 15217 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:13.923141 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:13.924616 15457 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.927966 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:13.923835 10037 rpcz_store.cc:276] 0709 13:18:12.780584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.780748 (+   164us) service_pool.cc:224] Handling call
0709 13:18:12.781054 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.781270 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:12.781600 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.992112 (+210512us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.695225 (+703113us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b180038ac40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:13.746025 (+ 50800us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b180038ac40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:18:13.850313 (+104288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.872894 (+ 22581us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:13.895922 (+ 23028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.896029 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.896229 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":816913,"prepare.queue_time_us":1704,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":814764,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":25971,"spinlock_wait_cycles":27094016,"thread_start_us":247814,"threads_started":2,"wal-append.queue_time_us":275554}
I20260709 13:18:13.887892 15302 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:13.947329 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51755.3us
I20260709 13:18:13.949334 10113 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:13.950096 10714 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:13.950970 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 740915us
I20260709 13:18:13.958210 15027 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.960850 15027 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:13.962910 15302 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.963531 15302 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:13.964249 15302 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.971709 14981 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:13.972419 14981 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.974404 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:13.974768 14981 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.975242 10031 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:13.964078 15180 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:13.986289 15181 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.972062  9935 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.988754 15181 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:13.981304 15017 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:13.991008 15246 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:13.991106 15260 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:13.994594 15324 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.997682 15324 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:13.998814 15324 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:13.992113 15365 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:18:14.001523 15324 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.991703 15017 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:14.020017 15180 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.044746 10111 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:14.045840 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:14.047057 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 124128us
I20260709 13:18:14.036150 15401 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:14.053694 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59752.8us
W20260709 13:18:14.057281 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47161.6us
I20260709 13:18:14.057924 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:14.087543 10111 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:14.047191 15180 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.094254 15181 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:14.094952 15181 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:18:14.096658 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46590.3us
W20260709 13:18:14.098137 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.102679 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:14.092142 15302 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:14.103895 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.107892 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.118564 15457 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:14.116590 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:14.125823 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.119989 14981 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:14.129108 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:14.127339 15170 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:14.133378 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:14.140174 10189 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.144999 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:14.120342 15181 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.136879 14762 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:14.173202 10110 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:18:14.159478 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 66581.3us
I20260709 13:18:14.143575 15217 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:14.179977 15461 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:14.159144 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:14.185706 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:14.193333 10112 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:14.146157 15170 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:14.210175 10040 raft_consensus.cc:606] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:14.225435 10714 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:18:14.227836 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.229879 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72373.3us
I20260709 13:18:14.148018 15260 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:18:14.234575 10039 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:14.239709 10189 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:14.240605 10111 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:14.229624 14762 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:14.248011 15360 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:18:14.250890 15404 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:18:14.236231 15217 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.212167 14981 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.233671 15302 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:14.257458 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:14.259224 15390 consensus_meta.cc:287] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.005s
I20260709 13:18:14.259686 15170 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.267174 10034 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:14.272518 14762 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.273247 14762 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:14.273738 14762 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:14.276302 10106 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:14.246860 15027 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:18:14.284523 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:14.285760 10031 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:14.287156 15217 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:14.288492 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58933.8us
I20260709 13:18:14.289795 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.291802 15461 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.294129 10035 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:14.295713 10033 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:14.299081 14762 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.300283 10107 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:18:14.303898 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.307161 15401 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:14.309137 15401 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:14.311242 15401 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:14.273917 15180 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.312827 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:14.314369 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:14.314436 15361 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:14.315049 10107 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.315868 15180 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:14.316608 15180 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:14.291548 10004 leader_election.cc:400] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
I20260709 13:18:14.324437 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:14.325254 10107 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:14.325489 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:14.326098 10038 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:14.311640 15401 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:14.315976 14841 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:14.332099 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:14.331164 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:14.396270 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59859.5us
I20260709 13:18:14.333333 14841 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.399196 10682 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:14.334340 15361 consensus_queue.cc:1243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:14.333592 15217 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.416458 15234 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:14.418098 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 105399us
I20260709 13:18:14.400367 14841 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.428841 10714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
W20260709 13:18:14.421540 10155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.193:38563 timed out after 1.900s (SENT) [suppressed 9 similar messages]
W20260709 13:18:14.430721 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 173312us
I20260709 13:18:14.438607 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.439467 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:14.440200 10714 raft_consensus.cc:606] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:14.447222 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.435985 15170 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:14.453837 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 162529us
W20260709 13:18:14.472061 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 78403us
I20260709 13:18:14.423993 15401 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.475351 15401 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.453971 15389 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:14.480538 15389 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:14.481470 15389 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.472062 10189 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:14.435926 15217 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.501931 10185 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:14.442034 15234 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.515465 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.497577 15390 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:14.525986 10714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:14.526718 10714 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:14.527081 10714 raft_consensus.cc:614] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:14.531239 15192 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.531713 15192 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.535099 15027 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:14.532140 15192 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.498337 15170 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:14.584100 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82271.6us
I20260709 13:18:14.546008 15390 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.594172 10714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:14.599474 15474 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.601924 15481 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:14.601769 15474 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.598242 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:14.608378 15474 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.608631 15457 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:14.609141 15027 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:14.611533 15457 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:14.578665 15260 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:18:14.617447 15193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.009s	sys 0.005s
W20260709 13:18:14.618863 15193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.010s	sys 0.006s
I20260709 13:18:14.619297 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:14.620069 10035 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:14.620496 15324 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:14.620937 15324 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:14.621049 15477 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:14.621861 15324 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.623152 15324 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:14.626575 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:14.631945 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.635628 15390 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.636116 15457 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.637217 15217 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:14.637812 15483 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:18:14.640434 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.640758 15027 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.616755 15404 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.648231 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.649120 10189 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 10: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:14.654678 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.656314 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.657649 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.658979 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:14.659682 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.661046 15017 raft_consensus.cc:993] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:14.662148 10714 raft_consensus.cc:606] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.662559 10714 raft_consensus.cc:614] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:14.663693 15461 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.664510 15461 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:14.665658 15461 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:14.666091 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.666304 15461 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.691649 10115 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:14.692195 15461 raft_consensus.cc:1081] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:14.693256 15461 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:14.693976 15461 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:14.695499 15461 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.686362 15027 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:14.701128 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93008.4us
I20260709 13:18:14.689698 15217 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:14.646366 15404 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.702466 15246 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.729398 14998 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.730042 14998 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.743574 15365 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:14.744328 15365 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.746574 15365 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.754859 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:14.761456 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 102626us
I20260709 13:18:14.754201 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:14.732617 15234 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.747437 15480 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.765723 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:14.768226 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.760373 15170 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:14.733206 15246 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.772240 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:14.772712 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.783396 10184 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:14.775995 14981 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.777074 15302 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:14.784281 15246 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.784741 15302 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.777185 15404 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.777825 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:14.781065 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.755862 14841 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.764038 15461 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:14.797397 14841 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.788697 10185 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:14.789157 15170 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:14.791893 15492 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:14.784413 15401 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.894550 10184 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:14.894362 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:14.870244 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 49500.7us
W20260709 13:18:14.818878 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.867475 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51720.3us
I20260709 13:18:14.895116 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.897557 10181 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:14.936316 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:14.860495 15015 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.947463 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.948189 10180 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:14.949536 10180 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:14.894855 14662 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:14.777733 15480 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:14.940673 15180 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:14.941134 15170 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.942915 15492 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:14.943325 15498 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:18:14.945726 15496 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:14.946571 15489 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:18:14.859714  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:18:14.939321 15490 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:14.904422 15401 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.953228 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:14.947144 15015 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.798028 14998 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:14.964730 10107 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:14.955763 15193 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:14.972064 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:14.965163 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:14.988900 10180 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:18:14.966290 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:14.964396 15389 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.929723 15192 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:14.950824 15365 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:18:14.975108 15498 consensus_queue.cc:1243] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:14.991148 15401 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.030206 15153 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.030939 15153 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.032218 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:14.993266 15193 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:15.031386 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:15.038328 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.046198 10187 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:18:15.032779 10181 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:14.993676 15496 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:18:15.047551 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 89428.3us
I20260709 13:18:15.000057 10182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:18:15.049811 10182 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:15.050303 10182 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.044013 15193 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:15.051630 10710 raft_consensus.cc:2368] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:15.053532 15464 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:18:15.052179 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.033366 15302 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.021236 15180 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.063037 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.070194 15456 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:18:15.070753 10184 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:15.071920 14721 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:18:15.051513 14762 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:15.075013 14762 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:15.075459 14762 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:15.076140 15504 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:15.076059 15302 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:15.076686 15504 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.077003 15181 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:15.077716 15181 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:15.078642 15181 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.080278 15302 consensus_queue.cc:1243] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:15.069175 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:15.082044 15015 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:14.986449 14662 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.072088 10184 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:15.028303 15389 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.077091 15504 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.082921 15234 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:15.121898 10714 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:15.102701 15017 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:15.075565 15180 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.049412 15457 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:18:15.132098 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 144477us
I20260709 13:18:15.127717 15017 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:15.137748 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:15.138852 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 182652us
I20260709 13:18:15.105919 15234 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:15.105428 15497 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.127115 15492 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:15.161527 10181 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:15.157239 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:15.143823 15234 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:15.170576 10115 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:15.171681 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 199753us
I20260709 13:18:15.170910 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:15.176015 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:15.176371 10113 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:15.176760 10108 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:15.176390 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.177613 15404 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.180670 10112 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:15.141670 15180 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:15.176666 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.183198 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.188014 10180 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:15.159838 15361 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.177546 10037 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:15.189507 10033 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:15.200281 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.201000 10033 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.209956 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:15.189450 15492 consensus_queue.cc:1243] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:15.207769  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:15.215358 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 74056.4us
I20260709 13:18:15.192193 15170 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:15.213435  9935 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 8, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 8 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:15.222975 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:15.225731 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:15.232420 15495 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:15.233592 15153 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.234463 10184 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:15.222470 15192 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:15.237872 15511 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:18:15.239992 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43734.9us
I20260709 13:18:15.240955 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:15.241201 15153 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:15.242717 15135 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:15.244586 15505 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:18:15.244845 15360 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:18:15.234511 15500 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:15.247517 15360 consensus_queue.cc:1243] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:18:15.248086 15360 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:15.248382 15360 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:15.249305 15360 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.250568 15360 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.251564 15389 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.254072 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:15.254848 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:15.255491 15217 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.256120 15217 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.256233 15456 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:15.257959 15456 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.258771 15217 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.259968 15456 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.265287 15515 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.266016 15515 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.266927 15170 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:15.199128 15361 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:15.268114 15502 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:18:15.295089 10180 raft_consensus.cc:1217] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Deduplicated request from leader. Original: 12.6->[14.7-14.7]   Dedup: 14.7->[]
I20260709 13:18:15.164551 15497 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.255647 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:15.295673 10180 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:18:15.293195 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:15.197747 15180 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.215538 15480 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.294078 15153 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.294143 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71256us
W20260709 13:18:15.300565 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.294814 15389 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:15.289703 10715 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:15.192562 15017 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.226284 15079 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:15.295476 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.306782 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.306444 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:15.307327 10180 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:15.288973 15170 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:15.313232 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:15.320161 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.320814 10037 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:15.309427 15480 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:15.305779 15389 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:15.306197 15079 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:15.330129 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.318392 15246 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:15.340984 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 85420.3us
I20260709 13:18:15.334621 15389 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:15.342893 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:15.305554 14762 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.332418 15480 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:15.349540 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.338970 15079 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:15.352200 15517 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:15.342309 15509 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:15.356002 15479 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:15.369652 15479 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.370134 15479 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.357739 15404 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:15.372361 15499 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.319s	user 0.000s	sys 0.002s
I20260709 13:18:15.372732 15170 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.374256 15170 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.374675 15457 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:15.375078 15457 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:15.375998 15457 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.376449 15193 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.377060 15457 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.377818 15497 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.378751 15193 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.382881 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:15.383667 10180 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.385324 15361 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.333681 14662 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.343006 15246 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.324599 15153 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.386459 15480 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.400718 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:15.397434 15217 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:18:15.402668 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:15.396121 15515 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.398483 15517 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:15.392815 15246 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.412117 15496 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:15.420022 10033 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:15.422113 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.422415 15464 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:15.422142 15217 consensus_queue.cc:1243] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:15.423727 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.410845 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:15.446787 10040 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:15.389505 15401 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.453527 10184 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:15.453742 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.455960 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:15.456627 10185 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:15.457170 14762 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:15.457644 15523 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:18:15.458313 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:15.458992 15153 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:15.462442 15234 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.463644 10713 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:15.465422 15234 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:15.469040 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 58263.3us
I20260709 13:18:15.472843 10106 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:15.454766 15496 consensus_queue.cc:1243] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:15.447180 15464 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:15.472915 10182 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.492923 10714 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:15.493418 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.485626 10180 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:15.496380 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.474283 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:15.494549 15496 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:15.493091 15464 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:15.500178 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:15.502702 15493 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.787s	user 0.005s	sys 0.001s
I20260709 13:18:15.507470 15473 raft_consensus.cc:993] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:15.513372 15473 raft_consensus.cc:1081] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:15.510712 10153 leader_election.cc:400] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:15.514482 10153 leader_election.cc:403] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.515305 15506 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:15.511831 15458 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:15.516294 15458 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:15.512485 15027 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:15.517088 15027 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:15.518030 15027 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.520004 15180 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.521077 15356 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.521580 15356 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.483618 15515 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 13:18:15.524542 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 183033us
I20260709 13:18:15.529675 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.519551 15027 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.532220 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.553298 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:15.550971 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 201599us
W20260709 13:18:15.561918 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87732.3us
I20260709 13:18:15.601810 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.493743 15079 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.605518 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.604146 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.610939 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.491622 15389 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.618181 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.560761 15260 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:15.551366 15492 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:15.529112 15498 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:15.804052 10037 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:15.807986 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.882318 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.871033 15079 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.870541 15356 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:15.867213 10036 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:15.805759 15365 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:15.889894 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:15.890239 10115 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:15.891155 10107 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:15.890646 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.892951 10032 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:18:15.879645 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:15.890663 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:15.906242 10109 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:15.885404 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 324238us
I20260709 13:18:15.897601 10187 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 11.
I20260709 13:18:15.869534 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:15.881008 15504 consensus_meta.cc:287] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.753s	user 0.017s	sys 0.000s
W20260709 13:18:15.899142 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 373944us
I20260709 13:18:15.908134 10081 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:15.892757 15519 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.516s	user 0.002s	sys 0.000s
I20260709 13:18:15.875192 15492 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.869227 15260 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:15.883863 15170 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.018s
I20260709 13:18:15.896075 15513 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:15.890415 15390 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.923799 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:15.894330 15217 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:15.940752 15390 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:15.941814 15479 consensus_meta.cc:287] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.005s
I20260709 13:18:15.942986 15390 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.943382 15512 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:15.937424 15217 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:15.944363 10034 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:18:15.944932 10034 pending_rounds.cc:85] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 13
I20260709 13:18:15.945137 10034 pending_rounds.cc:107] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:18:15.945365 10034 raft_consensus.cc:2889] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.948899 10106 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:15.951499 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:15.927186 15504 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.934957 15260 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.931115 15492 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.928607 15517 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.954294 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:15.930794 15404 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:15.893545 15480 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.955572 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:15.953166 10115 pending_rounds.cc:85] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 5
I20260709 13:18:15.942283 15479 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.957645 10037 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:15.961588 10115 pending_rounds.cc:107] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:15.910588 15365 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.943977 15512 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:15.967104 15526 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:15.904461 15498 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:15.968822 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.951390 15170 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:15.969161 10115 raft_consensus.cc:2889] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.983620 10181 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:15.962515 15401 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.968001 14841 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.985044 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:15.985193 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 430742us
I20260709 13:18:16.042186 10033 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:15.985795 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.987856 15365 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.988426 10109 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:15.960937 15404 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.992208 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:15.992635 15217 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:15.996673 15389 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:15.998878 15480 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.004266 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.003928 15517 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.058380 10038 raft_consensus.cc:2368] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
W20260709 13:18:16.009352 15246 consensus_meta.cc:287] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 13:18:16.009689 15464 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.011216  9935 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:16.020119 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.019444 10710 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:18:16.061450 10710 pending_rounds.cc:85] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 14
I20260709 13:18:16.061686 10710 pending_rounds.cc:107] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:18:16.061889 10710 raft_consensus.cc:2889] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.025374 15504 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:16.025671 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.026155 10107 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:16.027118 15479 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:15.937201 15513 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.045739 14841 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.065011 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:16.065789 15513 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.045104 10040 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:16.067006 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.041854 15170 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.068168 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.068787 15401 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:16.069191 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.043918 10036 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:16.069571 15170 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.070760 10714 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:16.071157 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.072249 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.072130  9935 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 11, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 11 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.073575 10032 raft_consensus.cc:2410] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:18:16.074115 15017 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.073848  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.074513 15534 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.075003 15534 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.077055 15534 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.077368 15512 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.055660 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:16.056670  9938 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 288) took 48939 ms (client timeout 15000 ms). Trace:
I20260709 13:18:16.053056 15516 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.053665 15404 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:16.065353 15458 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.065928 14841 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.078711 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.074360 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.081388 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.082110 10035 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:16.089113 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.089928 10038 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:16.090910 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.091634 10714 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:16.080075 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.088313 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.093309 10181 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:16.095059 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.094877 10183 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:16.097216  9935 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:16.103209 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 174578us
I20260709 13:18:16.104427 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:16.105693 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 177788us
I20260709 13:18:16.107046 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.088515 15360 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:16.112403 10182 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.089556 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:16.085557 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.080760 15180 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:18:16.085664 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 246448us
I20260709 13:18:16.087090 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.104873 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.127593 10038 raft_consensus.cc:2368] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:16.105306 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.108826 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:16.031118 15496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.048s
I20260709 13:18:16.096570 15153 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.097666 15217 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:16.116716 15512 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:16.116490  9935 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 9, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 9 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.119151 10111 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:16.119843 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.100442 15498 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.121733 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.084513 15461 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:16.124024 10114 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:18:16.130532 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.088364 15516 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.140604 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.159487 10040 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:16.160248 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.143615 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.082445 15246 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.120612 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.147635 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39166 (request call id 2441) took 1169 ms. Trace:
W20260709 13:18:16.138557 15496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.000s	sys 0.049s
I20260709 13:18:16.146495 10113 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:16.023411 15260 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:16.192313 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.152288 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.193429 10040 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:16.197516 10031 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:18:16.198537 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 82085.7us
I20260709 13:18:16.156570 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.156776 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.263304 10189 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:16.263456 10185 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:16.153560 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.116685 15389 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:16.191449 15498 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.126700 15180 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:16.163002 10112 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:16.109403 15458 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.154767 15360 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:16.163512 10182 rpcz_store.cc:276] 0709 13:18:14.945129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.985311 (+ 40182us) service_pool.cc:224] Handling call
0709 13:18:16.106935 (+1121624us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4c002ac400. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6d7b4a20 00007f3c6d7c5a29 00007f3c6d7c613f 00007f3c6d78a2ab 00007f3c6d7b7f3c 00007f3c6d7b83fe 00007f3c6da4588b 00007f3c6f444495 00007f3c6f49530f 00007f3c6f4dfa55 00007f3c744afcd0
0709 13:18:16.114460 (+  7525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11291392}
I20260709 13:18:16.255765 10039 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.261550 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.191913 15496 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:16.200230  9935 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 14, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 14 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:16.151768 15153 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:16.273958 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.163407 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.292205 15497 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.293058 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:16.294071 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 140604us
I20260709 13:18:16.302517  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:16.303119 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:16.256366 15530 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:16.260980 15461 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.315788 15461 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.317472 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.317951 15461 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.318605 15497 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.320770 15497 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.321477 10040 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:16.263608 15540 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:16.323953 15540 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:16.325084 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.325558 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.328622 15027 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.328747 10040 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:16.333042 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.312958 10189 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.313675 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.314875 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.314736 15360 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:16.325831 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.335456 10040 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:16.338399 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.345484 14762 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:16.265702 15389 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.339994 10038 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 14: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:16.341519 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.324774 14841 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.078087  9938 rpcz_store.cc:269] 0709 13:17:27.162157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.166111 (+  3954us) service_pool.cc:224] Handling call
0709 13:18:16.030619 (+48864508us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:05.482018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:05.712081 (+230063us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:05.712147 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:18:05.712192 (+    45us) tablet.cc:662] Decoding operations
0709 13:18:05.713168 (+   976us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:05.713272 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:05.713306 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:05.714052 (+   746us) tablet.cc:701] Row locks acquired
0709 13:18:05.714120 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:18:05.714282 (+   162us) write_op.cc:270] Start()
0709 13:18:05.714444 (+   162us) write_op.cc:276] Timestamp: P: 1783603085714223 usec, L: 0
0709 13:18:05.714489 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:18:05.860238 (+145749us) log.cc:844] Serialized 3253 byte log entry
0709 13:18:06.228553 (+368315us) op_driver.cc:464] REPLICATION: finished
0709 13:18:06.513598 (+285045us) write_op.cc:301] APPLY: starting
0709 13:18:06.520952 (+  7354us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:06.569690 (+ 48738us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:06.569822 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:06.707103 (+137281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:06.707427 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:18:06.707488 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:06.707872 (+   384us) log.cc:844] Serialized 81 byte log entry
0709 13:18:06.725683 (+ 17811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:06.726382 (+   699us) write_op.cc:454] Released schema lock
0709 13:18:06.726465 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:06.780008 (+ 53543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:06.780056 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":169477,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":231781,"apply.run_cpu_time_us":14094,"apply.run_wall_time_us":292976,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":259339,"prepare.run_cpu_time_us":35512,"prepare.run_wall_time_us":539587,"raft.queue_time_us":218230,"raft.run_cpu_time_us":67039,"raft.run_wall_time_us":166025,"replication_time_us":513896,"thread_start_us":557630,"threads_started":4,"wal-append.queue_time_us":144459,"wal-append.run_cpu_time_us":25456,"wal-append.run_wall_time_us":1712375}]]}
I20260709 13:18:16.352408 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.304311 15536 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:16.353124 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.353571 15193 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:16.341970 15234 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.361606 14721 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:16.362828 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.361434 10185 raft_consensus.cc:2410] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:18:16.324991 15540 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.363626 10184 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:18:16.367542 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.336033 15530 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:16.370393 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.377578 15504 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.378168 15504 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.380287  9935 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 6 to 15, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 15 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.382084  9935 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.383083 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.384341 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.385392 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.386396 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.391398 10032 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.383505  9935 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 14, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 14 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:16.396237 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.342592 15474 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.373128 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.399484 10038 raft_consensus.cc:2368] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:16.354648 15389 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.403822 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.395654 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:16.405100 10039 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:16.402815 15365 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.329242 15027 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.404498 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:16.307579 15498 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.406267 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.406905 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.403321 15180 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.410211 15324 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:16.393079 15535 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:18:16.408768 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.411579 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:16.411898  9935 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 8 to 14, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 14 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.356377 15464 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.360090 14841 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.414296 15473 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:16.361438 15234 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.373725 15508 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.403249 15260 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.429418 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.425804 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.432654 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.445077  9935 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.449263 10040 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 11: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:16.414287 15246 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.451565 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.426088 15324 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:16.434072 15180 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.453501 15234 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.412989 15365 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.449422 15508 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.449247 15473 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:16.419883 15517 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.457894 10038 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.434053 15512 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.440320 15480 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:16.431577 15546 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:16.459398  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.464084 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.524142 10040 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:16.445174 15456 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.456554 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.413163 15474 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.543134 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.545799 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:16.543870 10040 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:18:16.553670 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97172.4us
I20260709 13:18:16.554152 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.523602 15480 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.475734 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.478032 15365 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.478179 15508 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.464881 15260 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:16.462437 15401 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.575040 15401 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.480321 15504 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.482262 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.560809 15356 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:16.576258 10181 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:16.485392 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:16.577140 10180 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.549582 14998 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.579988 14998 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.582702 14998 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.583995 15504 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:16.488821 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.584645 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.585502 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:16.490437 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 2000) took 1162 ms. Trace:
I20260709 13:18:16.497069 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.587895 10187 rpcz_store.cc:276] 0709 13:18:15.327801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.338498 (+ 10697us) service_pool.cc:224] Handling call
0709 13:18:16.490226 (+1151728us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54001004d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:16.490343 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251110784}
I20260709 13:18:16.498021 10183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:16.508098 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.589197 10183 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.589608 10183 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.511924 15170 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.585404 10040 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:16.513137 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:16.592434 10039 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.503753 14841 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.520828 15027 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.463111 15324 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:16.595417 15523 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.293s	user 0.000s	sys 0.005s
I20260709 13:18:16.530332 10032 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:16.533102 15456 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.435073 15496 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.635823 10034 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:16.556572 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.530987 15546 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.584820 10711 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:16.552945 15390 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.640094 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.639439 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.512614 15234 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.597007 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:16.641270 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44367.3us
I20260709 13:18:16.600659 15498 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.540036 15517 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.465920 15530 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.607497 15474 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.612600 15153 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.470885 14662 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:16.516585 15492 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.009s
W20260709 13:18:16.615096 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54044.9us
I20260709 13:18:16.567088 15480 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.593185 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.618139 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.622210 10039 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:16.622248 10031 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:16.666924 10038 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:16.652309 15390 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:16.669116 15217 consensus_meta.cc:287] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.005s
I20260709 13:18:16.669450 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.669972 15390 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.670646 15390 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:16.671156 15390 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:16.639506 15546 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.672165 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.673702 10181 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:16.675866 15492 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.677215 10035 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:16.678215 15492 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.676556 15457 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.656821 15356 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.684612 14662 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.685091 15180 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.685679 15180 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.687204 14662 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.688891 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:16.689183 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.679284 15457 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.689540 10108 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.690526 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.660490 15361 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:16.692154 15361 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.692521 15361 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.694572 15180 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.697072 15456 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.697695 10181 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:16.474884 10189 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:16.593168 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:16.532562 15512 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:16.639084 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82609.1us
I20260709 13:18:16.700052 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.590839 15170 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.701086 15512 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.702379 15170 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:16.638798 15461 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.650839 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:16.706127 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.651702 10187 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:18:16.697613 10108 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:16.582963 15401 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:16.616819 15027 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.657869 10106 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:16.658651 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.659794 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.580138 15473 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.662207 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.656032 15234 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.659526 15517 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.683562 10037 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:18:16.642473 10180 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:16.701846 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.724803 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:16.741225 10111 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:16.678390 10183 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.701314 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.527760 10182 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:16.653923 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:16.743036 10109 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.698943 15389 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.737733 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:16.738890 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 76797.3us
I20260709 13:18:16.745124 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.742722 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.718019 10036 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:16.657701 15260 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.703044 15530 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.749624 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.751598 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.751549 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.754365 10038 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:16.768311 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:16.769631 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.770620 10188 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:16.773309 10106 raft_consensus.cc:1217] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.5->[12.6-14.7]   Dedup: 14.7->[]
I20260709 13:18:16.773893 10106 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [12.6-14.7]
I20260709 13:18:16.717247 15534 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.742231 15458 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:16.779541 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.783588 10183 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:16.786528 10110 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:16.789824 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:16.775264 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:16.799404 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.799233 10711 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:16.799219 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.802852 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.805190 10714 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:16.807366 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:16.775275 15153 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:16.814796 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.815172 10114 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:16.775625 15508 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:16.718438 15461 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.744617 15180 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:18:16.796890 15464 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:16.782883 15456 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.826905 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.827404 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.827579 10034 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:16.747862 15497 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:18:16.767045 15027 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.823066 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.811957 10711 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:16.835139 10711 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:16.811652 15492 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:16.770335 15260 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.843621 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.844638 10039 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:16.796994 15534 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.839778 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:16.831972 10109 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:16.814303 15153 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.841984 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.821460 15508 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.858626 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.860313 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.862432 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.865432 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.866214 10106 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:16.866000 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:16.843079 10711 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.873277 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.874229 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.888705 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:16.888972 10109 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:16.889832 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.839874 15464 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:16.824441 15458 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:16.892395 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.893724 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:16.861359 15404 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.004s
I20260709 13:18:16.910164 10114 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:16.867170 15153 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:16.916765 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 43514.5us
I20260709 13:18:16.867857 15508 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.836746 15110 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:18:16.921761 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:16.872318 15543 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:16.933568 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 408568us
I20260709 13:18:16.934593 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:16.824666 15390 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.891155 15512 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:16.910006 15533 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:16.939252 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:16.941365 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:16.910329 15514 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:16.921181 15492 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.920549 15504 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:16.919601 15545 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:16.922803 15017 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:16.912199 15498 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:16.938180 15180 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:16.992161 15180 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:16.992939 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71268.5us
I20260709 13:18:16.993803 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:16.951833 15540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.022s
W20260709 13:18:16.995127 15540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.022s
I20260709 13:18:16.984920 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:18:16.995920 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 80285.4us
I20260709 13:18:16.917793 15404 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:16.994503 15180 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
W20260709 13:18:17.018586 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 84176.7us
I20260709 13:18:17.023020 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:16.991009 15545 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.036773 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:16.940002 15324 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.000386 15512 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:16.996174 15504 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:16.941838 15543 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:16.949579 15480 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.050416 15562 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:17.050938 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.051949 15517 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.055953 15180 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:17.059594 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:17.075145 10707 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:17.075318 10714 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.983672 15456 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:17.064687 10115 raft_consensus.cc:2368] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:18:17.019387 15389 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.075968 10110 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:18:16.978895 15514 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.055856 15260 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.081357 10112 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:17.082149 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.046587 15545 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.074947 15180 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:17.075073 15551 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 13:18:17.079730 15456 consensus_queue.cc:1243] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:18:17.094182 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 125905us
W20260709 13:18:17.092799 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69875.1us
I20260709 13:18:17.090847 15180 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.081157 15562 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:17.101382 10107 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.108366 10714 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:17.075464 15576 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.092444 15360 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.112471 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 53211.5us
I20260709 13:18:17.116786 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:17.118180 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.094388 15575 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.109725 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.133801 15324 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:17.136262 15561 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:17.136917 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.138495 15546 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.139178 15217 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:17.140230 15562 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.142987 15361 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.080492 15464 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.145045 15480 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.146025 15404 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.119010 15566 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.128144 15569 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:17.155014 10107 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:17.155915 15170 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:17.156559 15563 log.cc:927] Time spent T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:17.156821 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45761.9us
I20260709 13:18:17.157027 15516 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:17.119148 15534 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.164561 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.127027 15556 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:17.139632 15217 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:17.176556 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2932) took 1189 ms. Trace:
I20260709 13:18:17.172945 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.183961 10113 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:17.158244 15571 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.179766 10111 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
W20260709 13:18:17.188632 10037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 2935) took 1195 ms (client timeout 1550 ms). Trace:
I20260709 13:18:17.121567 15360 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.178450 15361 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.180462 10036 rpcz_store.cc:276] 0709 13:18:15.987370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.162765 (+175395us) service_pool.cc:224] Handling call
0709 13:18:16.659993 (+497228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.746573 (+ 86580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.176353 (+429780us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540031e2d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:17.176491 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142664960}
W20260709 13:18:17.189168 10037 rpcz_store.cc:269] 0709 13:18:15.988151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.055050 (+ 66899us) service_pool.cc:224] Handling call
0709 13:18:17.183095 (+1128045us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400164c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:17.183195 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336177024}
I20260709 13:18:17.211730 15569 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:17.217563 15571 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.218333 15569 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.212324 15578 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.220868 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:17.221715 10187 raft_consensus.cc:2410] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:17.223127 15556 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:17.224355 15180 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.225327 15360 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:17.226547 15180 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.210893 15170 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:17.230731 15170 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.213315 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.210119 15580 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:17.232877 15580 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:17.210752 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47596us
I20260709 13:18:17.116781 15576 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.236068 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:17.227063 15234 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:17.244349 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 114614us
I20260709 13:18:17.126932 15504 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.253525 15512 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:17.259939 15217 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.261364 15217 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:17.268819 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55608.4us
I20260709 13:18:17.270805 15575 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.272212 15512 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.273638 15576 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.275594 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:17.276276 10187 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:17.279450 15580 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:17.254122 15180 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.287755 15180 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.283303 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:17.254377 15566 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.252281 15473 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:17.252418 15571 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.291313 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.291963 15572 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:17.299293 15572 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.299662 15546 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.300400 15180 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:17.300753 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.300977 15180 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.302140 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.303448 10155 leader_election.cc:400] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:17.305472 10183 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:17.305830 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:17.306092 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 2005) took 1175 ms. Trace:
I20260709 13:18:17.306917 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.309214 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.306519 10188 rpcz_store.cc:276] 0709 13:18:16.130362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.145318 (+ 14956us) service_pool.cc:224] Handling call
0709 13:18:17.305905 (+1160587us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54003f1bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:17.306036 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401549184}
I20260709 13:18:17.313112 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.313246 10187 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:17.250979 15508 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.316215 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.319304 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.320217 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.321198 10037 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:17.322103 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.325084 15153 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.301760 15180 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:17.328099 10181 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:17.330111 15508 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:17.306447 15473 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.337198 15473 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.319911 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.317625 15566 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:17.299775 15572 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:17.343614 15545 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.346350 15545 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.350989 10035 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:17.346688 15492 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:17.355620 15492 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:17.356639 15492 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.358004 15492 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:17.360249 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54495.3us
I20260709 13:18:17.360643 15582 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:17.360308 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47558.1us
I20260709 13:18:17.361133 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:17.393352 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54918us
I20260709 13:18:17.327502 15153 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:17.361092 15582 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:17.406699 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 99851.5us
I20260709 13:18:17.407608 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.398957 15562 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:17.396956 15180 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:17.425269 15457 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:17.428570 15594 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:18:17.429105 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:17.430126 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.432696 15573 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.433094 15457 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:17.433775 15538 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.434157 15458 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:17.434352 15538 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.435309 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.436671 15538 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.455583 14998 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:17.456265 14998 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:17.457181 14998 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.438954 10032 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:17.402802 15582 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.403698 15170 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:17.442035 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.442595 15135 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:17.469410 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54524.1us
I20260709 13:18:17.444525 15458 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:17.474180 15458 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.445119 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:17.397125 15473 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:18:17.453193 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.453634 15514 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.461136 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.437942 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.477458 10036 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.465556 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.479188 10038 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.480203 15496 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:17.480645 15496 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:17.477305 14662 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:17.481396 14662 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:17.481496 15496 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.482317 14662 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.469853 15193 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.469614 15569 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:17.466774 15170 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.493803 15543 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.443957 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.494695 10033 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:17.495200 15170 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.474335 15389 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:17.497079 10716 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:17.475426 15458 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.438827 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.476971 10155 leader_election.cc:400] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:17.477368 15533 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.489092 10153 leader_election.cc:400] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:18:17.441299 15027 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.491570 10713 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:17.503784 10153 leader_election.cc:403] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:17.420645 15512 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.514679 15461 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.517952 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.518554 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:17.519343 10110 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:17.520152 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:17.521100 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52611.7us
I20260709 13:18:17.521425 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.520704 10110 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.531430 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:17.531703 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 169709us
I20260709 13:18:17.536285 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:17.537158 10106 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.532188 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.539714 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.540684 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:17.541632 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.545675 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:17.549969 15514 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.552832 14762 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:17.550477 15514 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.560328 15514 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.558229 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:17.561327 10181 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:17.530805 15512 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:17.564553 15513 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:17.565332 15543 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:17.567032 15573 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.567818 10112 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:17.571774 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:17.518697 15153 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:17.572168 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.577751 10033 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:17.578116 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:17.584501 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.585314 10034 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:17.587508 10110 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:17.590394 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.590298 10038 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:17.591810 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.593111 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:17.591499 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 114641us
I20260709 13:18:17.594839 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.596328 10106 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:17.596697 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:17.597770 15566 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:17.597894 15513 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.598754 15513 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.599366 15566 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.599844 15566 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:17.600204 15566 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.601114 15569 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:17.601567 15569 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:17.601949 15569 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.602213 15513 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.603154 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.604032 10038 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
W20260709 13:18:17.597883 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.609362 15498 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.610291 15498 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:17.610670 15498 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:17.611014 15498 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.612879 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:17.613893 15027 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:17.614321 15027 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:17.614684 15027 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.623869 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.625029 15497 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.627331 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:17.630513 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:17.631315 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.654726 15180 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:17.654980 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.655198 15180 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:17.655715 15180 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:17.656884 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.657881 15027 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.662681 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.646786 15498 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.666128 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.667279 15498 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.679522 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:17.680500 10186 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:17.680608 10188 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:17.683207 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.686986 15492 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:17.631192 15153 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.694238 10036 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:17.653710 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.695577 15492 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.698765 15492 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:17.699183 15572 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.700511 10037 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:17.701525 15572 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.655787 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.706041 15153 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:17.706684 15153 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:17.707118 15153 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.699824 15492 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.707837 14662 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:17.583962 15598 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.708779 15598 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:17.709189 15598 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.710512 15492 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:17.712870 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52012.7us
I20260709 13:18:17.714749 10112 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:17.720199 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:17.721181 10183 raft_consensus.cc:2368] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:17.732313 10180 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:17.735772 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.737191 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 813) took 1270 ms. Trace:
I20260709 13:18:17.740882 10711 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.743258 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:17.753592 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 98801.5us
I20260709 13:18:17.754662 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:17.756163 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.757211 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.745288 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.740111 10710 rpcz_store.cc:276] 0709 13:18:16.467269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.467437 (+   168us) service_pool.cc:224] Handling call
0709 13:18:16.477217 (+  9780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.477476 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:18:16.636068 (+158592us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.412045 (+775977us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b180039bb00. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:18:17.736800 (+324755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.736863 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:17.736931 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.737003 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.737125 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":365449,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":7271,"raft.queue_time_us":27472,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":13207808,"thread_start_us":737560,"threads_started":3,"wal-append.queue_time_us":264764}
I20260709 13:18:17.765668 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.766408 10112 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:17.736462 15512 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:18:17.769328 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.763806 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:17.766860 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 364559us
I20260709 13:18:17.637449 15569 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.777823 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.772500 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:17.742532 15539 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:17.791585 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.774081 15532 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:17.775667 15513 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:17.800859 10106 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:18:17.776353 15504 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.785383 15575 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:17.788957 15562 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:17.807327 15512 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:17.784389 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.789887 15539 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.802806 15496 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.806928 15532 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.822582 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.825093 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:17.824011 10106 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:17.797801 15538 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:17.828473 10113 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:17.829468 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45175.1us
I20260709 13:18:17.812685 15562 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.835095 14762 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:17.814041 15027 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.836354 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.815526 15513 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:17.824098 15539 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:17.840705 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 218549us
W20260709 13:18:17.839339 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 61600.2us
I20260709 13:18:17.846372 10034 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:17.828171 15532 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:17.848958 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.840967 15562 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.838685 15474 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:17.853757 10035 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:17.827986 15512 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:17.856928 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.875093 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:17.878803 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:17.859097 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.861722 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.867952 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.880646 10033 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.881173 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.832484 15514 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.871979 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:17.839186 15538 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:17.868028 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.890421 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:17.890759 10038 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:17.883188 10708 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:17.890842 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:17.891999 10032 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.893349 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.894176 10040 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:17.898440 10033 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:17.900138 10187 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:17.903820 15512 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.907064 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:17.907438 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:17.907719 10004 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13.
I20260709 13:18:17.908223 10110 raft_consensus.cc:2368] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:17.908720 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:17.913862 10039 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:17.914759 15543 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:17.915343 10039 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:18:17.915719 10039 pending_rounds.cc:85] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 11
I20260709 13:18:17.915962 10039 pending_rounds.cc:107] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:17.916173 10039 raft_consensus.cc:2889] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.921404 15389 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:17.921871 15389 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:17.922047 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.923231 10711 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:17.925688 15180 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.926870 15492 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:17.928311 15514 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:17.928642 10003 leader_election.cc:400] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:17.929001 10003 leader_election.cc:403] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:17.930056 15027 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.930964 15562 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.923410 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:17.907893 10113 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:17.933614 10106 raft_consensus.cc:2368] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
W20260709 13:18:17.934063 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50269.3us
I20260709 13:18:17.937978 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:17.945974 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1023) took 1127 ms. Trace:
I20260709 13:18:17.939280 15492 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.949331 15492 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.949702 15492 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.950925 15498 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:17.952852 10038 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:17.853372 15586 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:18:17.954879 15538 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.960177 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.961050 10708 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:17.961740 15389 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:17.962920 15389 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.965081 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:17.859581 15566 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.968922 15566 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:17.971496 15582 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 13:18:17.971982 15582 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:17.972842 10036 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:17.974174 15569 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:17.976825 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:17.977648 14841 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:17.985190 15180 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:17.987715 15601 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:18.001771 14762 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:17.959949 15497 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:17.990768 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.016098 10106 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.011868 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:17.946430 10711 rpcz_store.cc:276] 0709 13:18:16.806992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.807103 (+   111us) service_pool.cc:224] Handling call
0709 13:18:17.499712 (+692609us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b18000ebce0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f523646 00007f3c6f45d58e 00007f3c6f4def9e 00007f3c6f4e07de 00007f3c6f4ec27c 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c
0709 13:18:17.734065 (+234353us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b58004c91d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4440aa 00007f3c6f4c6447 00007f3c6f4defe7 00007f3c6f4e07de 00007f3c6f4ec27c 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c
0709 13:18:17.923728 (+189663us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791802624}
I20260709 13:18:18.044332 10716 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:17.996490 10034 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:18:17.997596 10035 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:18.047259 10034 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:18.027104 10032 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:18.061617 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2431) took 1654 ms. Trace:
W20260709 13:18:18.061645 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 70984.5us
W20260709 13:18:18.062667 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50922.7us
I20260709 13:18:18.065840 10004 leader_election.cc:400] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:18.068840 10004 leader_election.cc:400] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:18.069238 10004 leader_election.cc:403] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.062239 10031 rpcz_store.cc:276] 0709 13:18:16.407653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.666956 (+259303us) service_pool.cc:224] Handling call
0709 13:18:17.119190 (+452234us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b5800010e98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:17.119382 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.119593 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:17.130641 (+ 11048us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.411549 (+280908us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b18003cfd60. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:18:17.987148 (+575599us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:18.041820 (+ 54672us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.061292 (+ 19472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.061350 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:18.061399 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.061460 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.061560 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19163,"prepare.queue_time_us":8820,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":96,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11259,"spinlock_wait_cycles":127000704,"thread_start_us":596405,"threads_started":2,"wal-append.queue_time_us":711906}
I20260709 13:18:18.073323 10711 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:18.072129 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 137299us
I20260709 13:18:18.076056 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:18.073428 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.080745 10038 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.042343 15549 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:18.071029 15533 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:18.067965 15458 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:18.077706 15602 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.100536 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 189494us
I20260709 13:18:18.074965 15170 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:18.107112 10035 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.116412 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.075138 15599 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:18.077953 15577 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:18:18.102718 15540 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:17.996019 15513 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.121628 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:18.139977 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.117419 15569 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.105788 15533 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:18.096858 15549 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.107384 15602 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.182932 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.144676 10038 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:18.111205 15246 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:18.103667 15598 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:18.206673 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85087.8us
W20260709 13:18:18.232522 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.234537 15566 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.235059 15566 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.237215 15566 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:18.238472 10186 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:18.243258 10187 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:18.254726 15135 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:18.256018 15234 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:18.257467 15444 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:18.257885 15444 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:18.226166  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:18.225636 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:18.303016 10713 raft_consensus.cc:2410] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:18.169639 15562 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:18.217950 15461 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:18.220044 15575 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.119762 15170 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:18.307832 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82295.3us
I20260709 13:18:18.308981 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.309641 10180 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.145453 15540 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:18.225021 15572 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:18.202142 15473 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:18:18.322578 10110 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:18.324226 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:18.326251 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.326869 10106 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:18.327014 10184 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:18.327524 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.328186 10183 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.331606 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:18.331801 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.334455 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.335304 15492 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.356199 10711 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:18.358322 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.359341 15598 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.360635 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.361004 15602 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.361230 10181 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:18.362113 15610 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:18:18.363114 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.366773 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.367528 10181 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:18.369076 10188 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:18.369294 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.370446 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.371771 10111 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:18.409418 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:18.376776 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:18.379501 10180 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:18.380237 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:18.381354 10109 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:18.392467 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:18.314079 15569 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:18.404896 10183 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
W20260709 13:18:18.329628 15153 consensus_meta.cc:287] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.622s	user 0.002s	sys 0.009s
I20260709 13:18:18.417593 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:18.329355 15575 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:18.327198 15582 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:18.425438 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.426409 10180 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:18.379271 15458 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.357743 15492 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:18.418687 15600 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.453s	user 0.000s	sys 0.004s
I20260709 13:18:18.328683 15572 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:18.445785 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 365176us
I20260709 13:18:18.451279 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.451845 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:18.430399 15598 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.439765 15616 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:18.436236 15569 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:18.487784 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.488555 10180 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.444341 15234 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.422106 15153 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:18.497220 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 421262us
I20260709 13:18:18.439916 15458 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.527864 15566 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.447175 15586 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:18:18.545782 10180 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
W20260709 13:18:18.549361 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 479154us
I20260709 13:18:18.547468 10184 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:18.427824 15533 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.444119 15508 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:18:18.489858 15538 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.492264 15598 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:18.547756 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.460131 15512 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
W20260709 13:18:18.548336 15027 consensus_meta.cc:287] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.007s
W20260709 13:18:18.542582 15610 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:18.568805 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.504771 15616 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:18.579147 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:18.579869 10109 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.593072 15217 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:18.593804 15217 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.617453 15458 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.618112 15458 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.618570 15458 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.571774 15538 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:18.620728 15538 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:18.624533 15615 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:18:18.628528 15532 consensus_meta.cc:287] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.752s	user 0.006s	sys 0.004s
I20260709 13:18:18.629098 15532 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.498965 15234 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.640554 15498 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:18.490617 15540 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.649278 15569 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.493440 15613 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:18:18.689558 10109 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:18.578344 15027 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15.
I20260709 13:18:18.659317 15549 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.705799 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.708788 15153 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:18.656149 15496 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:18:18.697439 15170 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:18.665516 15532 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:18.697359 15539 consensus_meta.cc:287] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.843s	user 0.005s	sys 0.009s
I20260709 13:18:18.720063 15628 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:18.740610 10188 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:18.720826 15616 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.728070 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.744793 10185 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:18.730324 15389 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.001s
I20260709 13:18:18.565246 15575 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.738265 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.757632 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:18.758939 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.755025 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.760288 10189 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:18.761368 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.763940 10182 raft_consensus.cc:2410] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:18:18.764097 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.764325 15017 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.762858 10188 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:18:18.765161 15017 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.767520 15017 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:18.770726 15017 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.772934 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:18.733633 15027 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:18.779201 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.785895 10189 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:18.739830 15628 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:18.743461 15496 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.789793 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:18.774122 15512 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:18.755772 15621 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:18.752454 15217 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.776192 15180 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.727478 15598 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.796589 15621 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.797781 15628 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.811771 10185 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:18.789783 15613 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:18.816085 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 252155us
W20260709 13:18:18.799623 10079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.009s	sys 0.025s
I20260709 13:18:18.782703 15389 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.744153 15539 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.779356 15586 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:18.821225 10079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.010s	sys 0.025s
I20260709 13:18:18.795055 15508 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:18.825623 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:18.827142 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:18.831513 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 747089us
I20260709 13:18:18.833042 10716 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:18.835952 10112 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:18.837898 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.790580 15027 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.771266 15017 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.841678 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:18.791646 15170 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:18.868260 10032 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:18.795270 15153 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:18:18.843566 15577 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:18.845124 10039 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:18.852150 15017 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.853263 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:18.827353 15549 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.794298 15496 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.872325 15549 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.873917 15496 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:18.874576 15549 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.825440 15217 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:18.863516 15621 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:18.863708 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.862018 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.831800 15458 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.866554 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:18.875656 15217 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:18.879438 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:18.864833 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:18.880124 10032 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.829373 15539 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:18.871151 15577 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.872699 15639 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.873970 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 824) took 1284 ms. Trace:
I20260709 13:18:18.886693 10713 rpcz_store.cc:276] 0709 13:18:17.589932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.590142 (+   210us) service_pool.cc:224] Handling call
0709 13:18:18.873723 (+1283581us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54005dff54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:18.873871 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631910272}
W20260709 13:18:18.886030 15624 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:18:18.878851 15549 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.896809 10032 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:18.871001 15444 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.908847 15444 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.909387 15027 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.894639 15639 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:18.910871 15639 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.885462 15217 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:18.912349 15217 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.885898 15017 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:18.920150 15017 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.920554 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:18.922340 15017 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:18.922894 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:18.923982 10037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0be325f96e974db28d904978cd65157d"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:18.924479 15234 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.926016 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:18.927922 15549 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.929023 10716 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:18.930243 15549 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:18.923550 10114 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:18.932569 10113 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.885984 15577 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:18.926092 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.937304 15577 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.938592 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.939522 15582 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.943471 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:18.941054 15536 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.947430 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:18.949424 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:18.950316 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:18.951061 10713 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:18.954134 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:18.925817 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2119) took 1139 ms. Trace:
I20260709 13:18:18.956451 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:18.956358 10113 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:18.956849 10112 rpcz_store.cc:276] 0709 13:18:17.786262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.791249 (+  4987us) service_pool.cc:224] Handling call
0709 13:18:18.925618 (+1134369us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000dbe54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:18.925761 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385512192}
I20260709 13:18:18.963974 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:18.938621 15577 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.974933 10037 raft_consensus.cc:606] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:18.973076 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:18.972231 15153 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:18.985672 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.988407 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:18.990541 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:18.992296 10113 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:18.996269 10108 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:18:18.959518 15536 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:18.957182 15640 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.998131 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:18.997506 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.001605 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.007685 14662 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:19.009303 15153 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:19.009366 14662 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.010138 15153 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.010190 14662 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.976505 15170 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:19.012337 15170 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:19.013309 15170 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.023684 14662 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:18.980487 15613 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.975608 15458 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.037248 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:18.955068 15586 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:18:19.008769 10113 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:19.040208 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.038254 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:18.957131 15234 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:18:18.956955 15508 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:19.042025 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:19.048228 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.007023 15027 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.999069 15536 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.097057 15536 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.098142 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.098966 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.059062 14662 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:19.059875 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.100085 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.100240 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.100737 10180 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:18:19.099498 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.101874 10187 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.102288 10189 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:19.007305 15533 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.103451 15533 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.105644 15533 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.107385 15572 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:19.108680 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.109269 15153 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.007196 15642 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.110244 15642 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.112150 10187 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:19.112586 15642 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.113183 15642 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.113644 15642 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.057289 15458 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.120347 15458 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.122617 15616 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:19.123126 15616 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:19.063786 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:19.125196 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:19.065191 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.066438 15461 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.045444 15496 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:19.056419 15539 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:19.056515 15497 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.126035 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:19.043514 15613 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.060371 15638 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:19.084481 15217 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.141880 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.089097 15599 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:19.094137 15628 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:19.095240 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.126080 10114 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.088457 10185 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:18:19.174152 10185 pending_rounds.cc:85] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 7
I20260709 13:18:19.174443 10185 pending_rounds.cc:107] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:18:19.174675 10185 raft_consensus.cc:2889] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.142130 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.147421 10035 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:19.142838 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.142825 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:19.129598 15246 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.153316 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.155121 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.161055 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.186537 10183 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:19.166734 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.144182 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.140960 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.129912 15496 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.171190 10113 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
W20260709 13:18:19.147930 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 297515us
I20260709 13:18:19.178519 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.179592 10115 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:19.176437 10186 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:19.139945 15638 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:19.187587 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44859us
I20260709 13:18:19.197685 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.187618 10110 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:19.228164 10181 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:19.229809 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:19.227583 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.246039 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.246848 10187 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:19.248395 15586 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.250041 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.252116 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.253448 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.253759 15569 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:19.255818 15572 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:19.232499 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.233438 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:19.129128 15027 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.265000 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.265793 10189 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:19.235474 10111 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:18:19.237604 15644 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.238406 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.135207 15642 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.173133 15599 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:19.232950 15638 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.233158 15496 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.161093 15217 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.168392 15616 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.193066 15246 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.242030 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.257179 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.139153 15539 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.272037 14662 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:19.274497 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:19.274744  9935 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 186) took 14000 ms (client timeout 15000 ms). Trace:
I20260709 13:18:19.278822 10114 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:19.279758 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.286012 15567 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:18:19.270205 15644 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:19.301565 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44646.9us
I20260709 13:18:19.301888 14662 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:19.302872 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.298656 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.323819 10108 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:19.278666 15497 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:19.327800 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.330175 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.325874 14662 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:19.296758  9935 rpcz_store.cc:269] 0709 13:18:05.282133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.284600 (+  2467us) service_pool.cc:224] Handling call
0709 13:18:19.263545 (+13978945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:17.050898 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:17.051667 (+   769us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:17.051730 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:18:17.051767 (+    37us) tablet.cc:662] Decoding operations
0709 13:18:17.053367 (+  1600us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:17.053483 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:17.053513 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:18:17.054998 (+  1485us) tablet.cc:701] Row locks acquired
0709 13:18:17.055043 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:18:17.055222 (+   179us) write_op.cc:270] Start()
0709 13:18:17.055367 (+   145us) write_op.cc:276] Timestamp: P: 1783603097055151 usec, L: 0
0709 13:18:17.055397 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:18:17.060104 (+  4707us) log.cc:844] Serialized 7048 byte log entry
0709 13:18:17.257179 (+197075us) op_driver.cc:464] REPLICATION: finished
0709 13:18:17.284668 (+ 27489us) write_op.cc:301] APPLY: starting
0709 13:18:17.284780 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:17.562630 (+277850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:17.562753 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:18.074993 (+512240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:18.141797 (+ 66804us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 13:18:18.163843 (+ 22046us) write_op.cc:312] APPLY: finished
0709 13:18:18.164353 (+   510us) log.cc:844] Serialized 164 byte log entry
0709 13:18:18.164579 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:18.164761 (+   182us) write_op.cc:454] Released schema lock
0709 13:18:18.164842 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:18.165306 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:18.165336 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8305431,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":27040,"apply.run_cpu_time_us":28364,"apply.run_wall_time_us":880631,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79259,"num_ops":18,"prepare.queue_time_us":373455,"prepare.run_cpu_time_us":29102,"prepare.run_wall_time_us":164445,"raft.queue_time_us":39238,"raft.run_cpu_time_us":26079,"raft.run_wall_time_us":30715,"replication_time_us":198383,"spinlock_wait_cycles":40320,"thread_start_us":464090,"threads_started":4,"wal-append.queue_time_us":150979,"wal-append.run_cpu_time_us":9861,"wal-append.run_wall_time_us":1958285}]]}
I20260709 13:18:19.334185 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.304338 15572 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:19.338212 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.300791 15577 raft_consensus.cc:2764] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:19.347091 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.342344 15622 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.340009 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.324055 15642 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:19.324268 15458 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.329691 15644 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.333604 15573 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:19.351704 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.356391 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.359047 10716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:19.363116 10716 raft_consensus.cc:606] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.363492 10716 raft_consensus.cc:614] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:19.344516 15498 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:19.368659 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.344970 15572 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.305328 15637 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
W20260709 13:18:19.381740 15649 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:19.382620 15654 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:18:19.384637 10710 raft_consensus.cc:2393] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:19.385180 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.354022 15642 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.390970 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.395800 15389 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:19.364634 15027 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.385345 15572 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:19.425002 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54758.1us
I20260709 13:18:19.363952 15458 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.399682 15536 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.376147 15540 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.405486 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.427063 10033 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:19.429764 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.413466 10036 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:19.401500 15492 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:19.409181 15642 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.384738 15498 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.456770 10033 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:19.410894 15389 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:19.455018 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.468976 10708 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:19.457772 15538 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:19.470784 10711 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:18:19.462296 10036 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:19.471184 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 65822us
I20260709 13:18:19.465258 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.437765 15623 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:19.472916 10682 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.432122 15027 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.433926 15622 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:19.458686 15613 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.466331 15234 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:19.488478 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 147182us
I20260709 13:18:19.474365 15461 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.460593 15492 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.487916 15170 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.488175 15549 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.511859 10036 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:19.470170 15637 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:19.515879 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:19.519816 10115 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:19.520133 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.492923 15444 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:19.519241 10110 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:19.513773 14762 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:19.497574 15234 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.528434 15234 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.533839 15217 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:19.536610 15656 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:18:19.546559 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 190236us
I20260709 13:18:19.509778 15492 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.509096 15539 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.514307 15389 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.557801 15536 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.563021 15458 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.506089 15246 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.586009 10038 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:18:19.572335 15543 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:19.564956 15614 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.913s	user 0.004s	sys 0.001s
I20260709 13:18:19.577883 15498 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.568931 15497 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:19.596848 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 135433us
I20260709 13:18:19.547573 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:19.604902 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 257911us
W20260709 13:18:19.588766 15645 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:18:19.599074 15638 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:19.588630 15658 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:18:19.588902 15660 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:18:19.606519 15657 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:19.629587 10038 pending_rounds.cc:85] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 7
W20260709 13:18:19.623238 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 107432us
I20260709 13:18:19.635529 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.636541 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.642148 10187 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
W20260709 13:18:19.643385 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 95906us
I20260709 13:18:19.644670 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.648486 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.648767 10032 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:19.650128 10032 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:19.651297 10032 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:19.642095 10038 pending_rounds.cc:107] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:18:19.653463 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.659174 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.653337 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.653398 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.661245 10185 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:19.662755 10038 raft_consensus.cc:2889] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.657625 15639 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:19.668437 15639 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.668865 15639 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.669183 15234 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.672519 15621 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:19.671576 15234 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.677155 15532 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:19.665475 10035 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:19.634209 15623 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.624406 15543 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:19.679891 15623 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:19.666787 10186 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:19.667268 10181 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:19.634750 15497 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:19.687012 10032 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:19.642899 15389 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:19.686379 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.685463 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.646337 15539 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:19.699559 10035 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:19.706982 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 2974) took 1848 ms. Trace:
I20260709 13:18:19.682471 15498 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:19.680281 15623 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:19.690335 15217 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:19.700295 15027 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:19.680266 15543 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.692866 15664 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:19.707468 10040 rpcz_store.cc:276] 0709 13:18:17.858067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.894725 (+ 36658us) service_pool.cc:224] Handling call
0709 13:18:17.895052 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.897187 (+  2135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.897218 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.897667 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.202589 (+304922us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:18.655906 (+453317us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.656128 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.656207 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.564292 (+908085us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:19.703858 (+139566us) raft_consensus.cc:1685] finished
0709 13:18:19.706770 (+  2912us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.706916 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":245830,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":109869,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":34965,"spinlock_wait_cycles":6080896,"thread_start_us":757445,"threads_started":2,"wal-append.queue_time_us":649019}
I20260709 13:18:19.724071 10038 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:19.658855 15640 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:18:19.726172 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 80375.2us
I20260709 13:18:19.709427 15170 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.684341 15496 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.636281 15644 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.731312 15246 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:19.707464 15539 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:19.736155 15628 consensus_meta.cc:287] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.001s
I20260709 13:18:19.719280 15027 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.755242 15027 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.743674 15623 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.746135 15170 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.760164 15639 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.761268 15170 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:19.755348 15401 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:19.762238 15401 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:19.763013 15401 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.763952 15401 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.769191 15539 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.776075 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:19.779488 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.780294 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.781150 10187 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:19.784235 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.785485 10037 raft_consensus.cc:2368] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:19.793478 10188 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:19.739429 15572 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.797853 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.760314 15644 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.798719 14662 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:19.801532 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.802160 10182 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.803507 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.804304 10710 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:19.785197 15639 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.809463 10187 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:19.810250 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.811189 10185 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:19.812566 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.785274 15671 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:19.816206 10182 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:19.808156 15667 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:19.810447 15664 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.809172 15638 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.826861 15497 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.807323 15492 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.828982 15496 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.831125 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.831565 10708 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:19.831754 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.832598 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:19.836417 10710 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:19.836612 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.837102 10185 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:18:19.835925  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:19.841758 15492 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.820497 15664 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.843968 15664 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.847223 15497 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.852576 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.826767 15642 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.857700 15642 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.861075 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.861689 10181 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.864661 15572 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.868722 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:19.870188 10187 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.870596 10107 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:19.875696 10114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:19.876364 10114 raft_consensus.cc:606] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:18:19.871855 10185 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:19.873193 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.873360 10106 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:18:19.877431 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 221996us
I20260709 13:18:19.878201 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.881517 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.882457 15673 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.889626 10186 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:18:19.890445 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.892541 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.898332 10112 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:18:19.894456 15401 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:19.902022 15684 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:19.902144 15234 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:19.905081 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.905275 10187 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:19.913964 15401 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:19.913578  9936 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:19.914951 15401 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.916829 10181 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:19.920790 10110 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:19.923554 15599 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.918208 15360 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.924818 15360 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.925697 15662 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:19.926064 15662 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:19.929309 15498 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.929731 15498 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.930145 15599 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.908496 15582 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.932886 15582 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.934996 15582 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.935290 15623 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.933003 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:19.935992 10710 raft_consensus.cc:606] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.940056 15572 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.940555 15572 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.941138 15586 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.941641 15586 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.942579 15572 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.943925 15679 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:19.944458 15679 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.945570 15567 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:19.946146 15567 consensus_queue.cc:1243] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:19.946492 15679 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:19.947077 15679 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:19.948087 15543 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.948561 10112 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:19.949712 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.950898 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.952275 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.952440 15613 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:19.953086 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.953910 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:19.936223 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.954806 15533 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:19.955407 15533 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:19.955828 15616 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.956537 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.956234 15533 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:19.957088 10112 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.957692 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.960044 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.960570 15027 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.961138 15662 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.961962 15572 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:19.962466 15572 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:19.962481 15662 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.963981 15684 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:19.954589 15667 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:19.964584 15532 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:19.959924 15497 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:19.965679 15497 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:19.965880 15667 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:19.966609 15497 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.966747 15667 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.962572 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:19.965324 15684 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:18:19.961853 15562 consensus_queue.cc:1175] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 13:18:19.969841 15586 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:19.971223 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:19.972195 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:19.972886 10711 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:19.971812 10716 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.974151 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:19.976661 15562 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.977349 15027 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.914999  9936 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 11, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 11 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:19.979631 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.979938 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:19.927496 15360 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:19.983494 15664 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:19.985199 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:19.985767 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49629.2us
I20260709 13:18:19.987114 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:19.987628 10708 raft_consensus.cc:606] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:19.993764 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:19.995915 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:19.996532 10032 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:20.002807 10036 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:20.003079 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.004892 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:19.980613  9936 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 10, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:20.008020 10187 raft_consensus.cc:2376] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16. Re-sending same reply.
I20260709 13:18:20.009315 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:20.011045 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:20.013336 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.013336 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.023917 10111 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:20.024854 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:20.026844 10181 raft_consensus.cc:2376] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17. Re-sending same reply.
I20260709 13:18:20.014580 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.015758 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:20.027609 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.028147 10183 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21.
I20260709 13:18:20.016994 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:20.028594 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.018409 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:20.018826 10035 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:20.030534 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:20.031085 10035 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:20.031945 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:20.019304 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.015820 10184 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:20.020543 10036 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:20.017745 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:20.033269 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.034600 15389 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:20.035956 15567 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:20.038460 10112 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:20.039915 10040 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:20.040103  9936 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 11 to 12, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:20.041464  9936 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.042629  9936 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 10, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.045305 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.047379 10716 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:20.031668 10181 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:20.005270 15017 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:20.051756 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:20.052261 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:20.054946 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.006716 15217 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.053442 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.056531 10182 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:20.034123 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:20.060140 10183 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:20.047654 10110 pending_rounds.cc:85] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 6
I20260709 13:18:20.061084 10110 pending_rounds.cc:107] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:18:20.061245 10187 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.060691 10182 pending_rounds.cc:85] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 12
I20260709 13:18:20.061334 10110 raft_consensus.cc:2889] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.052879 10181 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:20.025467 15647 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:20.064841 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:20.065079 10182 pending_rounds.cc:107] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:18:20.020583 15640 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:20.066425 10032 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:20.083602 10182 raft_consensus.cc:2889] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.087555  9936 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 10, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 10 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.079665 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:20.089792  9936 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 9, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.086877 10188 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:20.084022 10187 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:20.005008 15027 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:18:20.085539 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.087528 10183 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:18:20.101577 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 46699.1us
I20260709 13:18:20.006484 15642 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:19.975662 15572 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.054340 15492 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:20.127640 10035 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:20.112483 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:20.112592 10040 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:20.106613 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:20.129516 10708 raft_consensus.cc:606] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.094658 10181 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:20.024796 15602 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:18:20.131107 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:20.111330 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:20.039553 15498 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.080528 15496 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.143352 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:20.138592  9936 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.025311 15613 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:18:20.097815 15536 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:20.087218 15508 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:20.151401 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:20.152136 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:20.152942 10189 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:20.150956 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:20.124900 15638 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:20.108217 15680 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:20.098500 15664 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:20.107920 15644 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:20.161897 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.162899  9936 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 13, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.063923 15135 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:18:20.050467 15153 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
W20260709 13:18:20.154026 15669 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:20.081521 15217 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.148779 15598 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:20.176328 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 144464us
W20260709 13:18:20.158525 15660 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:20.155664 15642 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:20.106184 15640 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.150391 15678 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:20.165771 15536 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.209656 10708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
W20260709 13:18:20.168231 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 145108us
I20260709 13:18:20.175848 15680 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:20.224150 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 80011.1us
I20260709 13:18:20.230197 10155 leader_election.cc:400] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:20.230732 10155 leader_election.cc:403] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:20.226202 10708 raft_consensus.cc:606] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.225117  9936 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.203017 15679 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.231539 10708 raft_consensus.cc:614] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:20.203197 15664 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:20.239918 15621 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:20.240463 15621 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:20.241012 15498 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:20.241436 15694 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:20.242174 15687 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:20.174618 15539 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:18:20.212008 15598 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.248708  9936 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.251868 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:20.252166 10109 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:20.253144 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.264988 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.230302 15536 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:20.243006 15679 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.269265 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.280140  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:18:20.236367 15680 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:20.272360 10032 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:20.269752 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.229233 15642 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:20.293795  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:20.295292  9936 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 12, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 12 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.249526 15586 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:20.303191 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:20.262831 15598 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.268210 15613 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:20.308029 10113 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:20.315299 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.264271 15694 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:18:20.327669 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:18:20.328078 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58419.9us
I20260709 13:18:20.330323 10078 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21.
I20260709 13:18:20.331267 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:20.315678 15689 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:20.347888  9936 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.314628 15573 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:20.241355 15621 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.357882 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:20.312533 15692 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.369133  9936 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 13, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 13 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:20.380702  9936 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 9, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 9 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.352900 15458 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:20.353595 15623 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:20.355010 15664 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:20.359012 15573 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:20.394661  9936 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 13, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 13 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.396539  9936 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.398128  9936 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 7 to 8, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 8 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.353758 15613 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:20.363801 15539 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:20.413333 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55526.2us
I20260709 13:18:20.414619 15153 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:20.412364  9936 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 11 to 12, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:20.415118 15153 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:20.417330 15153 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.418993 15153 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:20.362886 15644 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:20.379988 15389 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:20.422844 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:20.417837  9936 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 12, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:18:20.431823 15690 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:20.434432 15682 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:20.435688 15698 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:20.353947 15540 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:20.389591 15678 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:20.422580 15689 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:20.372625 15246 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:20.446027  9936 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 11, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 11 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } }
I20260709 13:18:20.393299 15621 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.422080 15458 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:20.472453 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.477376 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.445453 15599 consensus_meta.cc:287] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.004s
I20260709 13:18:20.486343  9936 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 12, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 12 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.427307 15389 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:18:20.494786 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 80311.4us
W20260709 13:18:20.492164 15691 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:18:20.488739 15540 consensus_queue.cc:1243] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:20.436407 15644 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.391227 15642 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:20.555327 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 246523us
W20260709 13:18:20.585767 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 194344us
I20260709 13:18:20.504940 15217 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:20.553922 15497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.002s	sys 0.010s
W20260709 13:18:20.613034 10107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.052s
I20260709 13:18:20.613709 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:20.614814 10107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.053s
I20260709 13:18:20.584656 15664 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:20.606843 15497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.002s	sys 0.011s
I20260709 13:18:20.605679 15492 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.635417 15695 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:20.643867 15458 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.644814 15217 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:20.645242 15664 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:20.665165 15686 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:18:20.647119 15644 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:20.648371 15700 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:18:20.666467 15664 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:20.651918 15711 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:20.578488 15513 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:18:20.648144 15679 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:20.625497 15673 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:20.623695 15640 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:20.648247 15692 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:20.683445 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 234568us
I20260709 13:18:20.695251 10184 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:18:20.682392 15543 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.001s
I20260709 13:18:20.625353 15532 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:18:20.655001 15680 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.737196 10039 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:20.689479 15673 consensus_queue.cc:1243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:18:20.705255 15702 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:18:20.632972 15389 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.662407 15492 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.731619 10115 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:20.678005 15217 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:20.739470 15616 consensus_meta.cc:287] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
I20260709 13:18:20.774685 10037 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:20.774941 10180 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:18:20.785135 10180 pending_rounds.cc:85] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 9
I20260709 13:18:20.785342 10180 pending_rounds.cc:107] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:18:20.785609 10039 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:20.785559 10180 raft_consensus.cc:2889] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.773818 15730 raft_consensus.cc:993] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
W20260709 13:18:20.831981 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47165us
I20260709 13:18:20.786808 15562 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.779160 15217 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:20.777539 15492 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:20.829902 15702 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:20.821028 15508 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:20.823180 15586 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.841204 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 86440us
I20260709 13:18:20.844892 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:20.845536 10710 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
W20260709 13:18:20.836429 15717 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:20.829501 15389 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:20.848757 15708 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:18:20.828594 15706 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:20.872073 10710 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:20.875190 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:20.875687 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:20.869850 15539 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:20.878005 10712 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:18:20.878383 15217 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:20.878861 15217 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.879232 15217 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:20.880553 15715 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:18:20.881899 15729 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:20.882232 15734 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.884089 15734 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:20.884788 15718 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:20.883639 15721 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:18:20.884083 15719 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:18:20.894552 15734 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:20.909003 15706 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.909612 15706 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.911957 15675 raft_consensus.cc:1081] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:20.913494 15675 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:20.849277 15586 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.852331 15508 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.918916 15508 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:20.855829 15693 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:18:20.842020 15562 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.915395 15680 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:20.931524 15496 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.776s	user 0.008s	sys 0.004s
W20260709 13:18:20.933425 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49257.4us
W20260709 13:18:20.937446 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 92320us
I20260709 13:18:20.939047 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:20.942328 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:20.919150 15536 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.001s
I20260709 13:18:20.950954 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:20.951901 15716 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:18:20.951601 10110 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:20.936446 15153 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.962121 10038 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:20.938869 15706 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:20.967532 10081 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:20.969841 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:20.968775 15153 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.982164 15153 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:20.983680 15562 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:20.987654 15667 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:20.956981 15536 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:20.989220 15677 raft_consensus.cc:993] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:18:20.989741 15677 raft_consensus.cc:1081] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:18:20.990271 15536 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:20.967585 15664 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:20.991333 15664 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:20.993547 15664 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:20.994544 15638 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:20.995127 15638 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:21.000272 15621 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.001s
I20260709 13:18:20.953374 15496 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:20.986763 15532 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:21.001286 15496 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:21.001760 15532 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:20.983234 15573 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:20.986053 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 94458.1us
I20260709 13:18:21.012709 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.013998 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.015625 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.016531 10039 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:18:21.017103 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:21.018965 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.027864 10032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39426
I20260709 13:18:21.028537 10032 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.028892 10032 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:20.995173 15602 raft_consensus.cc:993] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:20.994469 15586 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:21.002807 15573 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.035339 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:21.002729 15532 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:21.011561 15598 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.003s
I20260709 13:18:21.037345 10711 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:21.001799 15496 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.034451 15217 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.044224 15598 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.050025 15714 raft_consensus.cc:1081] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:21.050783 15217 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.050971 15742 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:21.051425 15742 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.052750 10716 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:21.052770 15496 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.053824 10038 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:21.056381 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 2063) took 1156 ms. Trace:
I20260709 13:18:21.056727 10182 rpcz_store.cc:276] 0709 13:18:19.900227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.059247 (+159020us) service_pool.cc:224] Handling call
0709 13:18:20.060486 (+  1239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.088405 (+ 27919us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:20.209147 (+120742us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.325234 (+116087us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.325723 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.325859 (+   136us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:21.055549 (+729690us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800435f40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c72ee03c7 00007f3c6f4f29a7 00007f3c6f5020bf 00007f3c6f502038
0709 13:18:21.055772 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.055978 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.056053 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.056175 (+   122us) raft_consensus.cc:1685] finished
0709 13:18:21.056189 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.056312 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31529,"prepare.queue_time_us":47024,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":2388,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12891,"spinlock_wait_cycles":33598720,"thread_start_us":190543,"threads_started":2,"wal-append.queue_time_us":242839}
I20260709 13:18:21.059046 15638 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.047550 10032 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.062613 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:21.065094 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:20.988233 15667 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.067706 10711 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:21.068398 10032 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.068231 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:21.076241 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:21.077642 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:21.078246 10707 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:21.078783 15671 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:21.079279 15671 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:21.080212 15671 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.081564 15671 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.084247 15744 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:21.063812 15742 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.096319 10031 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.103856 10711 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:21.105515 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:21.118844 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:21.119550 10181 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.119972 10181 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:21.121954  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:21.125769 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:21.126298 10182 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.128883 10188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:21.129496 10188 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.129818 10188 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.107630 15246 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:21.136823 10031 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:21.138545 10707 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:21.143573 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:21.144448 15458 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:21.145011 15458 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:21.144706 15246 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.145886 15458 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.146965 15246 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.147964 15677 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:21.148480 15677 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.150573 15677 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:21.152115 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.155088 15246 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.155694 15246 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.115043 15496 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:21.160809 15496 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:21.161413 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.162364 10039 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:21.162647 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.163282 10107 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:21.164184 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.164885 10113 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 11: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:21.165846 10106 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:21.166217 10106 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:21.167101 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.159952 15667 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.166929 10106 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.178043 10106 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.160502 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.178488 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:21.179399 10713 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:21.139504 10181 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.171270 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:21.159569 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.188905 10112 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:21.180557 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.191067 10032 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:21.182907 15748 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:18:21.192608 10110 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:21.195628 10182 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:21.196484 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:21.165972 15684 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:18:21.197628 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:21.197993 10112 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:21.198477 10112 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:21.142339 15569 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:21.223969 15569 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:21.223881 15153 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:21.225313 15170 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:21.225095 15569 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.194214 15246 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:21.161751 15496 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.202394 15638 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:21.205381 15711 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:18:21.212703 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.214010 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.214821 10188 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.215197 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.198323 10707 raft_consensus.cc:2368] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
I20260709 13:18:21.217089 15586 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.219628 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.221390 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:21.225718 15170 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:21.218214 15694 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:21.249109 10181 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:21.250241 15747 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.173s	user 0.000s	sys 0.003s
I20260709 13:18:21.254108 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:21.254042 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:21.256982 10107 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:21.257578 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.257543 10188 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.251641 10112 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.264892 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:21.272336 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.276746 10004 leader_election.cc:400] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
I20260709 13:18:21.277428 10004 leader_election.cc:403] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.231884 15711 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:21.270206 10108 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:21.280259 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.273103 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:21.289602 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:21.290264 10040 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.283206 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.291769 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.292455 10032 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:18:21.304627 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.298251 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:21.305456 10035 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.264973 15569 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.264845 15638 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:21.317824 15711 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.326715 15666 raft_consensus.cc:993] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:21.327369 15666 raft_consensus.cc:1081] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:21.330169 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3202) took 1459 ms. Trace:
I20260709 13:18:21.330595 10109 rpcz_store.cc:276] 0709 13:18:19.870680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.870785 (+   105us) service_pool.cc:224] Handling call
0709 13:18:19.882665 (+ 11880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.258964 (+376299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.329943 (+1070979us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000b2cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:21.330104 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849032448}
I20260709 13:18:21.278133 15492 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:21.304311 15543 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:18:21.251466 15586 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.253005 15694 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.309360 15473 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:21.312542 15642 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
W20260709 13:18:21.357371 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56369.9us
I20260709 13:18:21.317184 15638 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.379881 10108 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:21.388787 10040 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:21.338339 15492 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:21.356972 15616 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:21.376349 15638 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:21.405810 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 104576us
I20260709 13:18:21.334570 15170 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.422825 10034 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:21.485874 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.381364 15473 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:21.556775 15752 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:18:21.560071 15217 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:21.560783 15217 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.563146 15217 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:21.410203 15662 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:21.497792 15492 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.405509 15027 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 13:18:21.415886 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:21.612990 10035 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:21.537873 15444 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.585067 15540 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:21.619091 15754 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:21.544528 15170 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.512674 15666 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:21.407941 15742 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.567976 15664 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:21.647053 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 231201us
I20260709 13:18:21.604600 15694 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:21.553201 15616 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.670436 14762 raft_consensus.cc:993] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
W20260709 13:18:21.670495 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 412033us
W20260709 13:18:21.625955 15724 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:18:21.676359 15664 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.586841 15662 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:21.710019 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.630059 15753 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:21.608861 15532 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.729893 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:21.734251 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:21.736958 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2490) took 1759 ms. Trace:
I20260709 13:18:21.737399 10037 rpcz_store.cc:276] 0709 13:18:19.977849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.978440 (+   591us) service_pool.cc:224] Handling call
0709 13:18:19.979614 (+  1174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.784428 (+804814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.736668 (+952240us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400165654. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:21.736890 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826500352}
I20260709 13:18:21.644573 15444 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.708257 15720 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:21.733325 15706 raft_consensus.cc:1081] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
W20260709 13:18:21.757766 15757 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:21.758669 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.759627 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 3000) took 1649 ms. Trace:
I20260709 13:18:21.760056 15742 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:21.772565 10032 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.648389 15540 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.735994 15694 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:21.790030 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:21.743825 15586 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:21.736778 15532 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.736999 15753 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.753495 15664 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:21.932180 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:21.990733 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
W20260709 13:18:21.905584 15762 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:18:21.901963 15017 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.758108 15616 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.751338 15720 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:21.682010 15666 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:21.977167 15667 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.947160 15730 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.037969 15730 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.040146 15730 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.044791 15473 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:21.997224 15017 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.048158 15017 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.050027 15666 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.050973 15667 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.053143 15667 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:21.954201 15567 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:21.950264 15389 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:21.970845 10036 rpcz_store.cc:276] 0709 13:18:20.110269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.110675 (+   406us) service_pool.cc:224] Handling call
0709 13:18:20.111010 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.128779 (+ 17769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.128810 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.769222 (+640412us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b180035c500. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a
0709 13:18:21.208360 (+439138us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b2c00000658. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:18:21.208965 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:18:21.404695 (+195730us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:21.404735 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.404811 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.759363 (+354552us) raft_consensus.cc:1685] finished
0709 13:18:21.759400 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.759560 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17359,"raft.queue_time_us":24865,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9956,"spinlock_wait_cycles":46491264,"thread_start_us":195330,"threads_started":1,"wal-append.queue_time_us":439090}
W20260709 13:18:21.978353 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 244163us
I20260709 13:18:22.061311 15720 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:21.969326 15569 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:18:22.061941 15720 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:21.964465 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 292687us
I20260709 13:18:22.025942 15532 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.026885 15444 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.028470 15753 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.033423 15662 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:22.035854 15540 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:21.986631 15694 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.064347 15694 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:22.067313 15720 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.061957 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:22.074414 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2515) took 2438 ms. Trace:
I20260709 13:18:22.074872 10180 rpcz_store.cc:276] 0709 13:18:19.635529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.636039 (+   510us) service_pool.cc:224] Handling call
0709 13:18:19.654195 (+ 18156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.822102 (+1167907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.074110 (+1252008us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002da0d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:22.074300 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576679168}
W20260709 13:18:22.076193 15638 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.003s
I20260709 13:18:22.076990 15638 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.077409 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.078089 10039 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:22.078538 15567 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.079304 15567 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:22.079804 15567 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.080564 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.081687 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.081990 15567 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.083031 15389 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:22.083542 15389 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.085615 15389 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.086110 15389 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.086537 15389 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.089214 15569 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.089797 15569 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.093283 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.095019 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 937) took 1083 ms. Trace:
I20260709 13:18:22.078706 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.094225 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 941) took 1078 ms. Trace:
I20260709 13:18:22.096342 10031 rpcz_store.cc:276] 0709 13:18:21.016064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.016880 (+   816us) service_pool.cc:224] Handling call
0709 13:18:22.094062 (+1077182us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54001572d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:22.094168 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180565248}
I20260709 13:18:22.095448 10038 rpcz_store.cc:276] 0709 13:18:21.011911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.018705 (+  6794us) service_pool.cc:224] Handling call
0709 13:18:22.094843 (+1076138us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b5400277ed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:22.094960 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77932928}
I20260709 13:18:22.102665 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.098263 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.105091 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.096236 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:22.108354 10004 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 2.135s (SENT) [suppressed 19 similar messages]
I20260709 13:18:22.110255 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.114725 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:22.094132 15569 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:22.106927 15773 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.071s	user 0.004s	sys 0.000s
W20260709 13:18:22.106694 15760 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.358s	user 0.002s	sys 0.003s
I20260709 13:18:22.115790 15616 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.113022 15767 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.121s	user 0.000s	sys 0.004s
I20260709 13:18:22.109934 15017 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.119463 15769 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:22.133570 15769 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.067947 15720 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.137398 15720 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:22.107143 15567 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.128396 15638 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.130548 15616 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.116353 15666 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:22.125710 15774 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:22.139133  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:22.140062 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.110116 15667 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:22.152302 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 56146us
I20260709 13:18:22.165578 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:22.155910 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.156828 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:22.156734 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.167372 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:22.168020 10714 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:22.168375 10714 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:22.168200 10712 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:22.161443 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:22.162652 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:22.163002 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:22.169937 10712 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:22.172948 10155 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:22.173265 10155 leader_election.cc:403] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.176352 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.177263 10107 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:22.172582 10712 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.179373 10712 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.180151 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:22.178615 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.183929 10186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:22.184614 10186 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:22.184993 10186 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:22.185738 10707 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:22.186715 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:22.145931 15769 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.187731 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:22.189548 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.190708 10714 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.193949 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.151618 15017 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.171888 15712 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:22.164201 15567 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.198232 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.218290 10712 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:22.206944 15769 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:22.224040 15769 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.224426 15769 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.173235 15667 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.185196 15775 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:22.226372 15775 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:22.227082 15667 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.231434 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.232328 10038 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:22.233824 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.234570 10034 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:22.191716 15720 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.249513 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.190141 15770 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:22.252970 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:22.205473 15170 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:18:22.192975 15777 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.260617 10188 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:22.215543 15764 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.205791 15569 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:22.200080 15586 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:22.257380 10184 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:22.198771 15776 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:22.242771 15492 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.005s
I20260709 13:18:22.282316 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.289137 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.290493 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.243618 15667 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:22.224471 15694 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.293416 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 1040) took 1419 ms. Trace:
I20260709 13:18:22.258639 15389 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:22.288340 15737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.025s	sys 0.058s
I20260709 13:18:22.321120 10716 rpcz_store.cc:276] 0709 13:18:20.873792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.873964 (+   172us) service_pool.cc:224] Handling call
0709 13:18:20.886013 (+ 12049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.053199 (+167186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.293100 (+1239901us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400686fd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:22.293340 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382907264}
I20260709 13:18:22.171886 15774 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.277786 15770 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:22.339254 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:22.340962 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.341830 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 397665us
I20260709 13:18:22.227345 15775 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.344228 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:22.348112 10107 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.348325 10188 raft_consensus.cc:2368] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12.
W20260709 13:18:22.336370 15737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.025s	sys 0.059s
I20260709 13:18:22.262059 15720 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.352890 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.350643 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:22.354952 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:22.357751 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 249412us
I20260709 13:18:22.358314 10184 raft_consensus.cc:2368] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
I20260709 13:18:22.228649 15712 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:22.365141 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.366279 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:22.366537 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:22.294869 15569 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.367247 10707 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:22.370777 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.374235 10107 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:22.377943 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:22.503710 10184 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.334729 15667 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.377876 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.320607 15586 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.380327 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.320478 15492 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.356426 15246 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:22.355851 15602 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:18:22.364176 15444 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:22.364514 15730 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:22.480592 15720 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.385032 10181 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:22.375039 15638 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
W20260709 13:18:22.460366 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.399076 15770 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.408838 15694 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.419099 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.627466 10182 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:22.412556 10183 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:22.400173 15567 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.410107 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.379638 15360 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:22.408589 15569 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.438498 15712 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:22.653472 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:22.411862 15017 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.400142 15616 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.485615 15532 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.486027 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2149) took 2613 ms (client timeout 2135 ms). Trace:
I20260709 13:18:22.622611 15791 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:22.486807 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 58330.2us
W20260709 13:18:22.486061 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 109174us
W20260709 13:18:22.479261 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99969.7us
I20260709 13:18:22.695088 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:22.479719 10189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0be325f96e974db28d904978cd65157d"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:18:22.699210 10189 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:22.699687 10189 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:22.391633 10186 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.507620 10033 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
W20260709 13:18:22.545784 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 358101us
W20260709 13:18:22.562587 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59653.3us
I20260709 13:18:22.459649 15777 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14.
I20260709 13:18:22.553622 15153 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:22.382723 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.651223 15444 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:22.550586 15533 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.630822 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:18:22.724843 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 94119.3us
I20260709 13:18:22.654718 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.728154 10183 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:22.572160 15793 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:22.663630 10712 raft_consensus.cc:2368] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:18:22.450111 15769 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.385829 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.706714 10707 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:18:22.689177 10115 rpcz_store.cc:269] 0709 13:18:19.872818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.872929 (+   111us) service_pool.cc:224] Handling call
0709 13:18:22.485804 (+2612875us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002b8254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:22.485920 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963315072}
I20260709 13:18:22.712077 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.712877 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.713207 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:22.662297 15794 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:22.714704 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.714977 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.716724 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.742343 10182 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:22.742846 10035 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:22.661223 15360 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.616840 15246 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.758072 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.758873 10037 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:22.631623 10187 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:22.760891 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.761708 10187 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:22.747015 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.763448 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:22.748817 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.690794 15792 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:22.726251 15496 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:22.754343 10180 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:22.722698 15729 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.749763 10186 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:22.765591 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.718362 15532 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.777024 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.793632 10187 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:22.794682 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.743928 15793 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.779856 10185 raft_consensus.cc:2368] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:22.780928 15492 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.751880 15642 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:22.745440 15602 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.812101 15602 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.814402 15602 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:22.746251 15533 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.815594 10033 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:22.746093 15743 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:22.783495 15783 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:22.816763 15783 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.818533 15562 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.819414 15774 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:22.820093 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.821055 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.821955 15540 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:22.822456 15540 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.824913 15622 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.825572 15622 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.784570 15667 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:22.829200 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.829969 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.830735 10115 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:22.786705 15360 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.802904 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:22.733619 15153 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.792695 15792 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.793741 15496 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.805824 10189 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:22.828543 15540 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:22.817332 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 266313us
I20260709 13:18:22.988667 10187 raft_consensus.cc:2410] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:18:22.906153 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.991191 10115 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:22.989388 10110 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:22.999483 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.000396 10115 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
W20260709 13:18:22.964083 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 94508us
I20260709 13:18:23.005079 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.805428 15586 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.064464 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.065284 10115 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.066916 14762 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:23.067512 14762 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.070658 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:22.997133 15757 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:18:22.989787 10186 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:22.840597 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.970563 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.095152 10114 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.077478 10182 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
W20260709 13:18:22.963994 15775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.031s	sys 0.077s
I20260709 13:18:23.108484 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.108906 15567 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:23.109822 15567 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.110477 15711 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.111985 15567 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.113412 15153 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:23.116027 15775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.032s	sys 0.079s
I20260709 13:18:23.084717 10189 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:23.112051 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:22.987758 15496 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.004295 15774 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:23.165581 15792 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.165329 15774 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:22.783121 15444 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.170383 15246 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:22.995509 15743 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:23.171757 15743 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:23.172858 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 192212us
W20260709 13:18:23.174880 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 186077us
W20260709 13:18:22.905777 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 211657us
I20260709 13:18:23.109536 10107 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:22.907111 15667 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:23.178501 15667 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.179787 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.181077 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.181730 10111 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:23.183221 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:22.733281 15791 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.140463 10108 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:18:23.071245 15572 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.180891 15667 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:22.805130 15729 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.163161 15793 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.164623 15532 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.176932 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.218487 10032 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:23.119808 14762 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.188329 10114 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:23.190143 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.222429 10181 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:23.223731 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.224647 10114 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:23.224872 10181 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:23.227921 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.193986 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.167506 15774 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.187352 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.239528 10038 raft_consensus.cc:2410] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:18:22.803766 15712 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.327s
I20260709 13:18:22.766624 15720 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:23.207973 15729 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:23.243671 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49795.1us
W20260709 13:18:23.244024 10184 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 13:18:23.244364 10184 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
W20260709 13:18:23.193759 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.252485 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.221498 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:23.139429 15622 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.246384 15803 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:23.247438  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:23.248744 15720 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.249223 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:23.242885 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:23.250437 15712 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:23.256055 14762 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.265722 14762 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.266095 14762 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.265924 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.216568 10111 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.264256 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.264837 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.238758 15793 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.275518 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.212991 15572 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.265154 15783 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.291455 10115 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:23.287189 15791 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:23.261325 15540 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.267820 15680 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:23.292115 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.328720 15680 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.329324  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:23.315634 15599 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:23.333238 15599 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:23.333631 15599 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.334690 10114 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:23.311049 15803 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.309406 14762 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.336136 15803 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:23.336585 15803 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.337862 14762 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:23.265583 15712 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:23.341733 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:23.342360 10708 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:23.314869 10111 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:23.325889 15540 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.327445 15720 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.290856 15793 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.342639 10708 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:23.345798 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:23.346743 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.347162 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.349712 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.351123 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.352402 10708 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.355846 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.356475 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.357352 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.278630 15678 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:18:23.366319 10708 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.340520 15712 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.271814 15622 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:23.367322 15706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.047s	sys 0.042s
I20260709 13:18:23.361544 15598 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.375270 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.377604 10111 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:23.378696 15622 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.382117 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.382970 10038 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:23.391635 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.377355 15706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.047s	sys 0.043s
I20260709 13:18:23.404066 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.404752 15680 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:23.390362 15562 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:18:23.406383 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.410705 10038 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:23.412304 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.399329 15712 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.406533 15774 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.450795 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.468001 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.440905 15562 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.446094 15680 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:23.476329 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.483073 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.481606 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:23.460826 15027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.066s	sys 0.131s
I20260709 13:18:23.485558 10111 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
W20260709 13:18:23.442415 15458 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.016s	sys 0.024s
I20260709 13:18:23.482875 15678 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.486815 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.487545 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.485749 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.487497 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.495584 10114 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.496739 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.503219 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.504274 10107 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:23.496479 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:23.488391 15027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.067s	sys 0.131s
I20260709 13:18:23.507624 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.471091 15622 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.513669 10110 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.509078 10716 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.461917 15496 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.485214 15680 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:23.467378 15774 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.494822 15729 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.487617 15540 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.495098 15720 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:23.487381 15492 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:23.516788 15771 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.548223 10079 leader_election.cc:400] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:18:23.548646 10079 leader_election.cc:403] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:23.514770 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.505829 15638 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:23.552265 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.506042 15712 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.525115 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.553345 10712 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:23.522810 15680 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.529063 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:23.496881 15458 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.016s	sys 0.025s
I20260709 13:18:23.540771 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.565335 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.566679 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.512516 10114 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:23.539644 15792 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.550352 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.571888 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.548573 15771 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.549474 10110 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:18:23.547914 15775 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:23.526535 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.557469 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1253) took 1008 ms. Trace:
I20260709 13:18:23.506321 15678 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.539927 15720 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.555567 15729 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:23.573427 15613 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.585078 15613 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:23.585275 15496 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.586012 15613 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.584173 15720 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.586691 15613 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.592481 10713 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 14: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:23.584163 15775 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.586112 15678 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.596405 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.597157 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.597739 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.599107 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:23.600409 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.572248 10107 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:23.548481 15572 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.605939 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:23.556027 15153 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:23.609035 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 2541) took 1343 ms. Trace:
I20260709 13:18:23.625792 10180 rpcz_store.cc:276] 0709 13:18:22.266085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.266330 (+   245us) service_pool.cc:224] Handling call
0709 13:18:23.608860 (+1342530us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002d96d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:23.608971 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012912896}
I20260709 13:18:23.610416 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1133) took 1249 ms. Trace:
I20260709 13:18:23.548317 15793 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:23.611907 15771 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.627485 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 2542) took 1345 ms. Trace:
I20260709 13:18:23.627904 10188 rpcz_store.cc:276] 0709 13:18:22.281768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.281970 (+   202us) service_pool.cc:224] Handling call
0709 13:18:23.627257 (+1345287us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5400096354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:23.627422 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102059904}
I20260709 13:18:23.612357 15722 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:23.559578 15638 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:23.555989 15712 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:23.613704 10189 rpcz_store.cc:276] 0709 13:18:22.549420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.118541 (+569121us) service_pool.cc:224] Handling call
0709 13:18:23.118848 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.188153 (+ 69305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.188189 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.188235 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:23.188269 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.557188 (+368919us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54001883d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:23.557243 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.557403 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158813440}
I20260709 13:18:23.564059 15540 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:18:23.572629 15779 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:23.584208 15729 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:23.615087 15710 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.614835 15792 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.605037 15720 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.568997 10708 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 10.
I20260709 13:18:23.598862 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:23.545667 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.652010 10112 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.654218 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2550) took 1244 ms. Trace:
I20260709 13:18:23.617635 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.606313 10714 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.656792 10036 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:23.620779 10032 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:23.622991 15788 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.957s	user 0.000s	sys 0.009s
W20260709 13:18:23.624122 15806 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:23.612260 15567 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:23.630261 10109 rpcz_store.cc:276] 0709 13:18:22.361902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.392744 (+ 30842us) service_pool.cc:224] Handling call
0709 13:18:22.393010 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.804470 (+411460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.804517 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.804559 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:22.804592 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.610185 (+805593us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000b36d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:23.610234 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.610354 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945796992}
I20260709 13:18:23.572918 15694 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:23.641988 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:23.689719 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47831.3us
I20260709 13:18:23.625849 15533 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.581918 15774 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.625890 15153 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:23.643417 15616 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:23.644317 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 401506us
I20260709 13:18:23.673609 15217 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:23.657712 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.679208 15498 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.670825 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 125229us
W20260709 13:18:23.724500 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.626907 15613 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.654680 10186 rpcz_store.cc:276] 0709 13:18:22.410045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.802269 (+392224us) service_pool.cc:224] Handling call
0709 13:18:22.802632 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.094422 (+291790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.653906 (+559484us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001004d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:23.654138 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429948800}
W20260709 13:18:23.687129 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 408916us
I20260709 13:18:23.640522 15712 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:23.642984 10185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 2543) took 1353 ms (client timeout 1706 ms). Trace:
I20260709 13:18:23.641215 15722 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:23.698091 10714 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:23.611596 15599 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.710204 10032 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:23.644264 15492 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:23.646757 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46422.8us
I20260709 13:18:23.679605 15780 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 13:18:23.762899 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 266322us
I20260709 13:18:23.663597 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.763725 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.764554 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.766749 10180 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.767964 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.771260 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.771989 10183 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:23.680200 15730 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:23.774530 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 112575us
I20260709 13:18:23.775894 15532 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:23.776350 15532 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.776716 15532 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.776501 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.788595 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.789631 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2186) took 1692 ms. Trace:
I20260709 13:18:23.730537 10112 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:18:23.732422 10185 rpcz_store.cc:269] 0709 13:18:22.289946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.290176 (+   230us) service_pool.cc:224] Handling call
0709 13:18:23.633286 (+1343110us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54002d82d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:23.642911 (+  9625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070768896}
W20260709 13:18:23.735873 10714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1044) took 1579 ms (client timeout 2088 ms). Trace:
W20260709 13:18:23.792546 10714 rpcz_store.cc:269] 0709 13:18:22.156066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.156202 (+   136us) service_pool.cc:224] Handling call
0709 13:18:23.605810 (+1449608us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b58009614d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4440aa 00007f3c6f4c6447 00007f3c6f4defe7 00007f3c6f4e07de 00007f3c6f4ec27c 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c
0709 13:18:23.735790 (+129980us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3220016000}
I20260709 13:18:23.759194 10682 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:18:23.793365 10112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2178) took 2597 ms (client timeout 1721 ms). Trace:
W20260709 13:18:23.795162 10112 rpcz_store.cc:269] 0709 13:18:21.196107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.196247 (+   140us) service_pool.cc:224] Handling call
0709 13:18:23.651336 (+2455089us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b580090a4d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4440aa 00007f3c6f4c6447 00007f3c6f4defe7 00007f3c6f4e07de 00007f3c6f4ec27c 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c
0709 13:18:23.793250 (+141914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976416512}
W20260709 13:18:23.797940 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 107524us
I20260709 13:18:23.790094 10113 rpcz_store.cc:276] 0709 13:18:22.097170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.097309 (+   139us) service_pool.cc:224] Handling call
0709 13:18:22.100032 (+  2723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.100260 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.100285 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.100737 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.340026 (+239289us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:22.340061 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.340127 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.614080 (+1273953us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:23.756523 (+142443us) raft_consensus.cc:1685] finished
0709 13:18:23.756549 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.789549 (+ 33000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17995520,"thread_start_us":238995,"threads_started":1,"wal-append.queue_time_us":523237}
W20260709 13:18:23.799486 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 249192us
I20260709 13:18:23.805269 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.755326 15722 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.811800 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:23.813786 15616 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:23.818615 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85991us
I20260709 13:18:23.820794 15533 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:23.794219 15673 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.823429 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.760463 15496 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.824132 10189 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:23.825757 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:23.828157 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.829638 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.824973 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.826139 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:23.849037 10112 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:18:23.849436 10112 pending_rounds.cc:85] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 7
I20260709 13:18:23.849933 10112 pending_rounds.cc:107] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:18:23.850193 10112 raft_consensus.cc:2889] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:23.851157 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.833282 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:23.852020 10189 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:23.853609 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.853834 10037 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.854858 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.855325 10033 raft_consensus.cc:2368] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:23.852289 10113 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.859798 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:23.860507 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.734596 15217 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.862972 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.746598 15803 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.865447 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.866624 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:23.879047 10714 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:23.868969 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.735325 15498 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.860500 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:23.821381 15533 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:23.870862 10039 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:23.882339 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:23.821411 15540 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:23.876035 10037 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
W20260709 13:18:23.970041 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 170728us
I20260709 13:18:23.909192 10113 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
W20260709 13:18:23.976429 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 60913.8us
I20260709 13:18:23.847368 15532 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:23.877419 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 118311us
I20260709 13:18:23.905407 15496 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.870643 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:23.983762 15496 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.984886 15496 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.887993 15540 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.990712 15217 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.789011 15638 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.992018 15217 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:23.830289 15246 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:23.995280 15246 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.868813 15567 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.997452 15567 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.998759 15246 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.879837 10038 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:23.871389 15153 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:23.936038 15756 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 2.312s	user 0.008s	sys 0.024s
I20260709 13:18:24.001641 15498 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:23.896538 15572 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.003074 15572 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:23.887382 15734 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:23.848822 15673 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.905018 15680 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.004889 15734 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:24.006729 15734 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.895951 15694 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.008327 15694 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.910629 15820 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:23.759519 15729 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.876662 15774 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:23.848865 15616 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:23.900303 15829 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:24.013900 15616 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:23.901023 10708 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:23.848897 15613 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:23.907788 15809 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:23.939551 15769 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.009019 15694 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.795325 15492 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.047355 15492 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.003665 15572 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.050486 10115 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.928903 15803 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:23.927507 15720 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:23.982668 15532 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.060595 15616 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.067293 15572 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:23.939381 15771 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:24.015506 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 44054.6us
I20260709 13:18:23.986933 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.076305 10189 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:23.991427 15540 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.025614 15774 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:24.026497 15567 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.078475 10184 raft_consensus.cc:2368] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21.
I20260709 13:18:24.079176 15774 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.042749 15730 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.043227 15599 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.043618 15829 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:24.044462 10037 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:24.022075 15680 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:24.068400 10182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 2557) took 1576 ms (client timeout 2078 ms). Trace:
I20260709 13:18:24.080926 15730 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:24.082240 10182 rpcz_store.cc:269] 0709 13:18:22.491786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.743195 (+251409us) service_pool.cc:224] Handling call
0709 13:18:24.068001 (+1324806us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b5400100254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:24.068186 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719961856}
I20260709 13:18:24.083453 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.083847 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.084906 15642 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.085453 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.085898 10003 leader_election.cc:400] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
I20260709 13:18:24.077574 15771 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.085781 15730 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.089847 15572 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.093581 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2526) took 1918 ms. Trace:
I20260709 13:18:24.093851 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.095407 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.095599 15775 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.096338 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.094264 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.097621 10033 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:24.097965 10033 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:24.099064 10033 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.099627 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.100648 10033 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:24.103132 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.103917 10036 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:24.104902 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.106603 15712 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.037241 15562 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.107772 15562 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.109546 15792 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.071656 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.112375 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.114209 10034 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:24.112284 15730 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:18:24.115886 15562 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:23.930419 15533 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.030449 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:24.077585 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.106942 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.121244 10189 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:24.122648 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.087726 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:24.124866 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 94861.5us
I20260709 13:18:24.125185 15217 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:24.123463 10189 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:24.125797 15217 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.115552 10034 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:24.126940 15829 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.127156 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.127665 15217 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:24.128906 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.129809 10189 raft_consensus.cc:2368] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:24.069510 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.130865 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.096777 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.130798 10710 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:24.101264 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.101976 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.125953 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:24.129984 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.091460 15673 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.144196 10033 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:24.158669 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.160957 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1260) took 1066 ms. Trace:
I20260709 13:18:24.162503 10180 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:24.163674 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.165526 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.166520 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.167491 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.169749 10182 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.170606 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.171352 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:24.175395 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.127111 15572 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:24.191983 10040 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.206756 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.184085 15775 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.210062 15667 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.210631 15667 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.210978 15667 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.219893 15673 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.207361 10040 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
W20260709 13:18:24.224435 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 98671.7us
I20260709 13:18:24.225466 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.226091 15829 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.227029 15562 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.228103 15246 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.223259 15217 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.227880 15562 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.187798 15680 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.229616 10180 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:24.228004 15712 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.184743 15496 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.232851 15246 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:24.220542 15673 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:24.228577 15775 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.250192 10033 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:24.239663 15680 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.131196 10031 rpcz_store.cc:276] 0709 13:18:22.174601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.182010 (+  7409us) service_pool.cc:224] Handling call
0709 13:18:22.182350 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.182565 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:22.502889 (+320324us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.092557 (+1589668us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b1800429a60. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:18:24.092962 (+   405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.093043 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:24.093162 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.093238 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.093414 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":550037,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4903,"raft.queue_time_us":14169,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":5239552,"thread_start_us":556360,"threads_started":2,"wal-append.queue_time_us":594765}
I20260709 13:18:24.259083 15562 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.250947 15246 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.261492 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 2556) took 1761 ms. Trace:
I20260709 13:18:24.254267 15680 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:24.264972 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 159135us
I20260709 13:18:24.265949 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:24.267889 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.269384 15217 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.250775 15775 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.250609 15673 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.279146 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 855) took 1057 ms. Trace:
I20260709 13:18:24.279691 10716 rpcz_store.cc:276] 0709 13:18:23.221766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.223043 (+  1277us) service_pool.cc:224] Handling call
0709 13:18:23.227430 (+  4387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.514416 (+286986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.278582 (+764166us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54004d0154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:24.278930 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647245568}
I20260709 13:18:24.289467 10189 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
W20260709 13:18:24.292424 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 157390us
I20260709 13:18:24.293524 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.295233 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.258687 15722 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.296187 15829 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.296648 15829 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:24.297075  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:24.297482 10188 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:24.297103 15829 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.298758 15722 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.300146 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.300657 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.301626 15540 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.302425 15540 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:24.305584 15783 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.306128 15783 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.306623 15783 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.306941 15572 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:24.307572 15572 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.308037 15572 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:24.309890 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.312687 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.313150 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.314677 15638 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:24.261924 10187 rpcz_store.cc:276] 0709 13:18:22.411717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.070438 (+658721us) service_pool.cc:224] Handling call
0709 13:18:23.070792 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.076994 (+  6202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.077025 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.593062 (+516037us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b1800021fa0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a
0709 13:18:23.593989 (+   927us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b2c000bbb28. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:18:23.594549 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.773502 (+178953us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:23.896115 (+122613us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.896603 (+   488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.897204 (+   601us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.040031 (+142827us) raft_consensus.cc:1685] finished
0709 13:18:24.041468 (+  1437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.173117 (+131649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5777,"prepare.queue_time_us":60881,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":6923,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":38402,"spinlock_wait_cycles":35353344,"thread_start_us":300032,"threads_started":2,"wal-append.queue_time_us":292927}
I20260709 13:18:24.315308 15638 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:24.277127 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.316586 15638 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:24.298636 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47914.1us
I20260709 13:18:24.324265 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.326670 10003 leader_election.cc:400] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12.
I20260709 13:18:24.327378 10003 leader_election.cc:403] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.327996 15532 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.328472 15458 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12.
I20260709 13:18:24.328537 15532 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:24.329198 15532 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.329605 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.317116 10180 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:24.332726 10003 leader_election.cc:400] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:24.290797 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.316476 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:24.340271 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 67590.3us
I20260709 13:18:24.340701 10189 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:24.341020 10182 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:24.346618 15496 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.161448 10181 rpcz_store.cc:276] 0709 13:18:23.094387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.226594 (+132207us) service_pool.cc:224] Handling call
0709 13:18:23.226864 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.227073 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:23.550012 (+322939us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.067212 (+517200us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b18003061c0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:18:24.159296 (+ 92084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.160277 (+   981us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:24.160419 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.160506 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.160720 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":531067,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3953,"raft.queue_time_us":66906,"spinlock_wait_cycles":51840256,"thread_start_us":517695,"threads_started":2,"wal-append.queue_time_us":356367}
W20260709 13:18:24.348428 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47908.4us
I20260709 13:18:24.357347 15839 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:24.369431 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 56969.1us
I20260709 13:18:24.379572 15722 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.401804 10716 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:24.402896 10155 leader_election.cc:400] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
W20260709 13:18:24.406632 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78571us
I20260709 13:18:24.401144 15775 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.409626 10181 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:24.411422 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.326686 15680 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.414563 10187 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:24.417150 10180 raft_consensus.cc:1217] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[10.6-15.8]   Dedup: 10.6->[13.7-15.8]
I20260709 13:18:24.424607 10180 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: [10.6-15.8]
I20260709 13:18:24.445905 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.405021 15829 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.452585 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.452692 15722 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:24.454365 15673 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.455101 15153 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:24.454860 15532 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:24.468134 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.473750 15830 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.496s	user 0.004s	sys 0.000s
I20260709 13:18:24.474341 15839 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.474371 15722 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.475339 15839 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.490983 15839 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.491349 15839 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.486232 15783 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.492849 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.494278 15783 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.500941 15532 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.505288 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.506085 10040 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:24.507091 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.502811 15540 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.503206 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.503599 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.510784 15775 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.510852 15673 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.511551 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.513131 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.513428 10189 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.510840 15722 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.516649 15680 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.517297 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3247) took 1029 ms. Trace:
I20260709 13:18:24.517694 10115 rpcz_store.cc:276] 0709 13:18:23.487474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.487587 (+   113us) service_pool.cc:224] Handling call
0709 13:18:23.487884 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.051075 (+563191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.517041 (+465966us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540010ead4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:24.517234 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206911872}
I20260709 13:18:24.513854 10183 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:24.520812 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.522024 10189 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:24.523078 15360 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:24.523907 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 74042.5us
I20260709 13:18:24.516680 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.525348 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.525666 10181 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:24.526428 10189 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:24.528365 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.529227 10185 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:24.530493 10185 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:24.522194 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.533358 15729 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.482514 15153 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:24.535976 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 120345us
W20260709 13:18:24.536935 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 140883us
I20260709 13:18:24.536070 15153 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.543493 15360 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:24.544385 15360 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:24.545657 15360 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.547566 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 857) took 1321 ms. Trace:
I20260709 13:18:24.547995 10711 rpcz_store.cc:276] 0709 13:18:23.226231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.226373 (+   142us) service_pool.cc:224] Handling call
0709 13:18:23.341961 (+115588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.342379 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.342407 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.342936 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.695210 (+352274us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:23.695257 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.695332 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.989519 (+294187us) raft_consensus.cc:1685] finished
0709 13:18:23.989570 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.547148 (+557578us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54006ad6d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:24.547395 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5218,"spinlock_wait_cycles":236824320,"thread_start_us":348171,"threads_started":1,"wal-append.queue_time_us":576396}
I20260709 13:18:24.553247 15667 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.452170 15694 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:24.569003 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 165314us
I20260709 13:18:24.571234 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.514580 15572 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:24.574395 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49130.4us
I20260709 13:18:24.575793 10039 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:24.555698 15667 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.588371 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.590226 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:18:24.594890 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 152570us
I20260709 13:18:24.595796 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.601464 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:24.614167 15844 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.091s	user 0.004s	sys 0.004s
I20260709 13:18:24.614306 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:24.615865 15828 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.006s
I20260709 13:18:24.616986 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.614197 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.620008 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.608239 15680 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:24.616446 15667 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:24.633025 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59650.5us
I20260709 13:18:24.636322 10113 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:24.636709 15572 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.637444 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:24.636626 15847 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:18:24.618258 15599 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:18:24.640617 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:24.629359 15153 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.629998 15667 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:24.655964 15667 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:24.656770 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.657414 10107 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:24.658282 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.626067 15246 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.664402 15246 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.646214 15711 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:24.646569 15839 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.665941 15711 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.667418 15839 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.667856 15829 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.668290 15711 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:24.647534 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 61686.4us
I20260709 13:18:24.648193 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.648530 10003 leader_election.cc:400] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:24.649049 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.652833 15850 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.655011 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.660385 15722 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:24.660681 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.661664 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.656090 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.662199 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.670753 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.655900 15628 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:24.676360 10035 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:24.676851 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.676986 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.677659 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.679526 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:24.695119 10034 raft_consensus.cc:2368] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:24.695724 15638 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.695976 10040 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.696569 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.700186 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:24.700507 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.684237 10031 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:18:24.700855 10108 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:24.701071 10031 pending_rounds.cc:85] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 11
I20260709 13:18:24.683221 15153 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:24.707540 15628 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.708840 15153 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:24.709218 15153 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:24.670586 10114 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.710058 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:24.689975 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.686760 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.696720 10037 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:24.641028 15680 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.681015 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.686321 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.693297 10106 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:24.706810 15217 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:24.690784 15848 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.213s	user 0.000s	sys 0.004s
I20260709 13:18:24.710683 15628 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.712244 10107 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.701323 10031 pending_rounds.cc:107] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:18:24.747529 10031 raft_consensus.cc:2889] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.712884 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.713212 15722 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:24.750331 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:24.686192 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.726938 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.727726 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:24.728508 10716 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:24.729008 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.725915 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.722754 15850 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.732726 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.733667 15667 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.766292 15850 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.767117 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.734362 15217 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.735688 10182 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:24.768610 15850 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.769291 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.770080 10182 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:24.771287 15680 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.771991 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:24.772724 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86068.1us
I20260709 13:18:24.773372 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.775089 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.775920 10106 raft_consensus.cc:2368] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:24.776450 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.777554 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.778016 10189 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.778693 15704 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:24.780429 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.736538 10184 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:18:24.732614 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 51842.9us
I20260709 13:18:24.710144 15153 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.736450 15673 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.743157 10111 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:24.743790 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.728606 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.755812 10114 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:24.756879 15736 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.757304 15775 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.757542 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:24.758558 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.758570 15598 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:24.761067 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.762113 15720 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.763669 15694 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:24.764138 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:24.765156 15722 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.767904 10188 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:24.767921 15667 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.781427 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:24.774675 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:24.782647 10711 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:24.782047 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.792659 10107 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:24.794198 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.806339 10109 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:24.809995 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:24.818943 10710 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.813035 10182 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
W20260709 13:18:24.810619 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52152.8us
I20260709 13:18:24.821593 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.812096 10715 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.801024 10081 leader_election.cc:400] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:24.824932 10081 leader_election.cc:403] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.824321 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.793046 10108 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:24.804630 15153 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.804944  9935 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.811168 15736 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:24.837514 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 55564.4us
I20260709 13:18:24.829151 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.797780 15586 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:18:24.829898 15804 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.831103 15234 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.810949 15704 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:24.811599 15720 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.833083 15694 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.795331 15680 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:18:24.849303 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:24.862308 10189 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:24.846573 15729 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:24.831538 15217 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.838594 15711 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.871956 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:24.872923 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 78912.4us
I20260709 13:18:24.850437 15540 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:18:24.861119 15360 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:24.884467 10031 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:24.886557 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:24.887271 10036 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:24.860355 15638 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:24.890841 10038 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.891813 10109 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:24.894282 15622 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:24.894881 15622 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.897395 15622 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.898123 15678 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:24.898449 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.898754 15678 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.899699 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:24.889245 15234 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:24.908106 15217 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:24.882691 15729 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:24.913384 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:24.901142 15498 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.919615 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.920451 10109 raft_consensus.cc:2376] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13. Re-sending same reply.
I20260709 13:18:24.874953 15572 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:24.923250 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:24.928530 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.892004 15673 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:24.940739 10189 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:24.900975 15678 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:24.920462 15498 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:24.945662 15586 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:24.957012 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:24.967259 10109 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.902899 15360 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:24.970165  9935 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:24.972601  9935 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 13, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 13 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.959959 15498 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:24.976351 15586 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.976722 15498 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.976575  9935 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 5 to 12, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:24.978870 15586 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.984726 15729 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:24.986060 15694 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:24.987385 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:24.988248 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:24.988722 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 79081.1us
I20260709 13:18:24.987516 15360 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:24.990226 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:24.973074 15711 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:24.954872 15775 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:24.979001  9935 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 15, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 15 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:24.984575 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 74800.4us
I20260709 13:18:25.002301 10715 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:24.955004 15628 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:18:25.020406 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:25.021379 10707 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:25.013851 10108 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:25.026367 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.027315 10106 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:25.028795 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:25.041109 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.999590 15680 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:25.052057 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.065127 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:24.972142 15667 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:18:24.971426 15673 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.013046 15622 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:25.086517 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.088666 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.089725 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.090548 10111 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:18:25.091598 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 123236us
I20260709 13:18:25.105592 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:25.103649 10682 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.106940 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:25.109438 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:25.078965 15775 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:25.084455 15850 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.079550 15667 consensus_queue.cc:1243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:18:25.133466 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 253302us
I20260709 13:18:25.111063 15720 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:25.106245 15622 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.107568 15680 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.168385 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.133744 15736 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.151809 15775 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:25.201539 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 211411us
W20260709 13:18:25.206254 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 99418.5us
I20260709 13:18:25.245846 10710 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:25.246896 15711 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:25.247951 15532 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:25.244361 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 257009us
I20260709 13:18:25.253374 15743 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.254086 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.254726 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:25.255703 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.255975 10110 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:25.277700 15850 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:25.285127 15850 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.299244 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:25.311115 10111 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:25.315670 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:25.317864 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 60289us
I20260709 13:18:25.277169 15694 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:25.332018 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.321858 15678 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.321216 15673 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.339923 10110 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:25.351766 14662 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:25.357529 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 116565us
W20260709 13:18:25.358991 15853 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:18:25.360719 15856 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:25.329666 15694 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:25.360363 15875 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:25.373772 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.377841 15839 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.378336 15839 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:25.384130 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.370142 14662 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.387830 10153 leader_election.cc:400] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:25.388242 10153 leader_election.cc:403] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:25.360497 15860 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:25.371001 15694 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.398056 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:25.379283 15839 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.412374 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.407033 15860 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:25.420116 15839 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.420543 15860 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.420171 10184 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:25.424466 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:25.421868 14662 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:25.410373 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 156645us
I20260709 13:18:25.462051 15868 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:25.462678 15868 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:25.463882 15867 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:25.464483 15775 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.465874  9935 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.467904  9935 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:25.479339 10184 raft_consensus.cc:1217] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[10.6-16.9]   Dedup: 10.6->[13.7-16.9]
I20260709 13:18:25.479907 10184 pending_rounds.cc:85] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 6
I20260709 13:18:25.484627 10184 pending_rounds.cc:107] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:18:25.484922 10184 raft_consensus.cc:2889] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:25.484910 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 86848.1us
I20260709 13:18:25.486747 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:25.518577 15885 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.519397 15885 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:25.519891 15871 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:18:25.520620 15870 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:18:25.521828 15885 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:25.476338 15860 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.463651 15868 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.556847 10710 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:25.557129 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70454.1us
I20260709 13:18:25.560892 10111 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:25.562880 10111 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:18:25.554140 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97810.8us
I20260709 13:18:25.475783 15680 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.564989 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.558858 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:25.580340 10109 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.012s
I20260709 13:18:25.583918 10109 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:25.584769 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.588593 15680 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.589232 15680 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:25.589983 15855 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.666s	user 0.002s	sys 0.002s
I20260709 13:18:25.591436 15680 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.595844 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:25.558475 15153 consensus_meta.cc:287] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.006s
I20260709 13:18:25.599779 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:25.601284 15246 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:25.601740 15246 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:25.602735 15246 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:25.604717 15890 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:18:25.607033 10186 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:25.601821 15775 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:25.609546 15622 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:25.611948 15858 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:18:25.618381 15598 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.619060 15598 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.621116 15598 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.622609 15598 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.623649 10716 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.624825 15667 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:25.625504 15667 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.625712 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.627007 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:25.626956 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.632030 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:25.642876 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.643318 15775 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:25.643551 10108 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:18:25.642038 10715 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 10.
I20260709 13:18:25.645143 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:25.628646 15894 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.643710 15027 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:25.645876 10180 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:25.650808 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:25.630923 15874 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:18:25.662757 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 276717us
I20260709 13:18:25.631373 15720 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.627971 15628 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:25.627668 15667 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.628031 15888 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:25.665180 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:25.631928 15866 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.647976 15246 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.670260 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:25.671754 15628 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:25.675351 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.677870 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50990.2us
I20260709 13:18:25.678689 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.648837 15027 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:25.647182 15890 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.685020 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.688130 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.670342 15864 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:25.693874 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.694983 14662 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:25.697290 14662 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.697732 14662 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:25.667977 15839 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:18:25.680239 15775 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.702502 15628 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.683315 15694 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:25.709363 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.710420 15027 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.676294 15622 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:25.711951 15896 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.709421 15694 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:25.696729 15864 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:25.731110 15864 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.731948 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:25.733438 15628 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.738111 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.692780 15829 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.712008 15027 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:25.743052 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55836.8us
I20260709 13:18:25.744884 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.718961 15622 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.730906 15889 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:25.751385 10189 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:25.756738 15887 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.747102 15839 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:18:25.767037 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 182356us
I20260709 13:18:25.694530 15888 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.751411 15622 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:25.748711 15890 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:25.790635 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.791709 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46937.7us
I20260709 13:18:25.790853 15897 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:25.799538 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.796078 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.791596 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:25.768968 15839 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:25.811364 14662 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.810214 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:25.817140 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.812539 15894 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.791489 15868 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:18:25.824826 14662 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.825803 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:25.831975 15887 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:25.838208 15532 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:25.838696 15532 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:25.839943 15586 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:25.840348 15586 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:25.841184 15586 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.842440 15586 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.842638 15888 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:25.808220 15889 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:25.819290 15890 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.844460 15890 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:25.844843 15890 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.819034 15722 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.851716 15783 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.839540 15532 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.844233 15873 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:25.856434 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:25.863615 10111 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:25.865829 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.868054 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.870023 10108 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:25.871862 10711 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:18:25.872812 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.875613 10109 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:25.875506 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.880054 15864 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.882685 10109 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.890407 15896 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:25.891036 15896 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:25.891389 15897 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:25.892832 10180 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.895388 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:25.893356 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.903622 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:25.904888 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:25.905722 15678 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:25.873626 15909 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:18:25.908264 15678 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.908901 15667 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:25.897060 15864 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.910548 15890 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.913000 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.897013 15893 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:18:25.916040 15869 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:25.916646 15153 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:25.917271 15153 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.906005 15839 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.918622 15839 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.920194 15628 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:25.920619 15628 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:25.921211 15890 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:25.921492 15628 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.922611 15850 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.892035 15897 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.852397 15783 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.923095 15153 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:25.927125 15783 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:25.928196 10112 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:25.929266 15897 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:25.909258 15667 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:25.891976 15896 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:25.940528 15667 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.941928 15667 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:25.937616 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.938079 10679 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.898099 15532 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:25.910665 15736 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:18:25.873934 15775 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:25.945472 10078 leader_election.cc:336] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.105s (SENT)
I20260709 13:18:25.955857 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:25.961941 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:25.970137 15864 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.970671 15864 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:25.976140 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:25.961486 15782 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:25.976053 15893 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:25.977298 10038 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:25.977675 10031 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:25.978003 15887 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.978746 10040 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:25.980907 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:25.982365 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:25.983841 10031 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:25.984261 15881 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.984758 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:25.985433 10106 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:25.988709 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:25.954856 15869 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:25.967937 15775 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:26.003386 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:26.003903 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:26.008925 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.011412 10711 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:26.008113 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:25.994534 15217 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:26.024765 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.018090 10034 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:26.025890 10180 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:26.023288 15864 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.023595 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.027109 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.029241 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.033631 10182 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.024111 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:25.988684 15894 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:18:26.035640 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 90220.9us
I20260709 13:18:26.042385 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:26.046315 10186 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:26.040480 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.024509 15217 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.057364 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:26.058415 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.068388 10112 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:26.071805 15027 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:25.819803  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:26.073361  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 16 to 19, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 19 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:26.074962  9935 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 14, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 14 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:26.076751 10036 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:26.077406 10078 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 2.109s (SENT)
I20260709 13:18:26.077868 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.076287  9935 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 13, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:26.080551  9935 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 15 to 17, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:26.068190 15217 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:26.086618 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48613.9us
I20260709 13:18:26.082728 15881 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.094920 10182 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:26.101007 10036 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:26.100605 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.091543 15881 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.107177 15912 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:26.107715 15912 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:26.108115 15912 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.083899 15678 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.113927 15678 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:26.114559 15678 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.115688 15246 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:26.101305 15860 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.099013 15622 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.117549 15895 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:26.118005 15895 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:26.118472 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.119288 10109 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:26.118902 15895 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.120622 15895 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:26.121622 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.124074 15598 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.125376 15881 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.116261 15899 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:26.128571 15899 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:26.129463 15899 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.130807 15899 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:26.185369 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.153728 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:26.159243 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.118791 15622 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:26.206178 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:26.131124 15864 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:26.212558 10715 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 11: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:26.232122 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:26.247608 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:26.256538 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.215031 15864 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:26.246006 15920 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:26.246088 15246 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:26.203910 15678 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:18:26.250077 15875 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.267733 15881 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:26.309725 15918 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:26.135325 15775 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:26.327919 15921 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:18:26.330197 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 73618us
W20260709 13:18:26.332324 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.303277 15869 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:26.285445 15246 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.338531 15720 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.352806 10107 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:26.354293 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:26.356141 15919 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:18:26.360430 15913 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:26.361156 15913 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.363502 15913 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:26.364888 14662 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:26.365339 14662 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:26.366233 14662 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.367635 14662 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:26.370998 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 271515us
I20260709 13:18:26.290530 15875 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.373636 15875 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.373821 15699 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:26.376611 15694 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.322098 15864 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.377976 15864 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:26.380666 15722 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.381319 15722 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.382237 15869 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.384927 15869 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:26.388943  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:26.389127 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.390245 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:26.390889 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.376462 15628 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:26.333588 15911 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:18:26.402347 15916 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.317s	user 0.000s	sys 0.003s
I20260709 13:18:26.425148 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.426401 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:26.429668 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.405741 15360 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.406088 15875 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:26.411866 15913 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:26.452728 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.455598 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.457350 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.457993 10112 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:26.402066 15889 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:26.431098 15729 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:26.465435 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.466439 10108 raft_consensus.cc:2410] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:26.442025 15360 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.470036 10109 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:26.477568 10110 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:26.477878 10112 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:18:26.471487 15360 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:26.489370 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.480659 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:26.511638 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 242105us
I20260709 13:18:26.512137 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:26.512971 10715 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:26.465936 15729 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:26.464623 15875 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:26.517369 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.510517 15246 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:26.532675 10188 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:26.515612 15783 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:26.512319 15498 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:18:26.537706 15875 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:26.539654 15925 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:18:26.543100 15667 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 13:18:26.536801 15783 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:26.534443 15879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.024s	sys 0.043s
I20260709 13:18:26.553674 15694 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.560119 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.588846 10109 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:26.518057 15722 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:26.582904 10107 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:26.547336 15217 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:26.589315 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 108756us
I20260709 13:18:26.593062 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:26.600924 10711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ff24b1804914099b167420853598f48"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:26.601675 10711 raft_consensus.cc:606] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.590080 15783 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:26.594363 15879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.024s	sys 0.044s
I20260709 13:18:26.590813 15729 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.614086 15729 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:26.621677 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.629045 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.586658 15912 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.634720 15217 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.635031 10187 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:26.635255 15912 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:26.635890 15912 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.619053 15736 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:26.637588 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:26.631297 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.631764 10034 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:26.636389 15912 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.637920 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.640228 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.640340 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.641909 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.643500 15498 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.644116 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:26.646606 15930 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:18:26.648468 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.649546 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:26.650008 15924 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.367s	user 0.000s	sys 0.002s
I20260709 13:18:26.650068 10182 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.637234 15866 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:26.652006 15866 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.654039 15866 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:26.636408 15736 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.656116 15736 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.666553 10188 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:26.641052 10003 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:26.668850 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.661327 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.679512 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.684247 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.688289 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:26.693694 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:26.696815 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55839.5us
I20260709 13:18:26.699208 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.703423 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.702013 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.704859 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.705510 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.703603 10716 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:26.703457 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.706147 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.706159 10189 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:26.710327 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.741063 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.742406 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.707361 15586 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:26.750034 10189 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:26.696086 15866 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.756676  9935 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 12 to 17, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.758806  9935 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.760528  9935 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.761092 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:26.757552  9936 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 287) took 38589 ms (client timeout 15000 ms). Trace:
I20260709 13:18:26.702744 15894 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:26.762652  9935 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.764650 10189 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:26.763880 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.765653  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.768388 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.769893 10036 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:26.770680 15903 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:26.771205 15903 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:26.771725 15913 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:26.772185 15913 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:26.772980 15913 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.776376 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:26.708735 15775 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:18:26.776997 10040 raft_consensus.cc:606] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.769363 15894 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:26.778177 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.779269 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.780113 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.780684 10183 raft_consensus.cc:2376] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16. Re-sending same reply.
I20260709 13:18:26.780354 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.781508 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.781975 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.782547 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.782827 15736 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.780699 15783 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.778803 15894 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.784063 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.784686 10187 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:26.773361 15903 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:26.780891 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.786031 10180 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:26.788879 15783 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.789283 15912 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:26.790165 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.791827 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:26.792006 15936 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 13:18:26.794528 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:26.804484 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.810801 10180 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:18:26.812409 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.813125 10185 raft_consensus.cc:2376] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16. Re-sending same reply.
I20260709 13:18:26.814671 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.817224 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:26.817587 15736 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.814631 15598 raft_consensus.cc:993] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:26.812714 15860 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.833818 15944 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:26.834386 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:26.908999 10182 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.909197 15860 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.910694 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:26.911232 10040 raft_consensus.cc:606] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.911582 10040 raft_consensus.cc:614] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:26.912081 15860 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.914287 10710 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:26.916486 10182 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:26.917255 10040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:26.917747 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:26.917878 10040 raft_consensus.cc:606] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.918402 10040 raft_consensus.cc:614] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:26.918633 15736 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:26.919215 15736 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:26.920476 15736 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.817055 15730 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:18:26.867347 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.932849 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.935078 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.935704 10109 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:26.936343 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:26.868603 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.844480 15598 raft_consensus.cc:1081] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:26.843720 10108 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.881728 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.847092 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.888023 15722 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:26.892704 15873 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:26.892750 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:26.893690 15720 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:26.905674 15938 raft_consensus.cc:993] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:26.954674 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.907924 15913 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:26.840186 15943 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 13:18:26.925519 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.935729 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:26.941083 10035 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:26.948081 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:26.952154 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70507.6us
I20260709 13:18:26.953521 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.958837 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:26.930433 15246 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.972836 15246 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:26.965039 15599 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.973973 15599 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:26.975098 15246 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.955065 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:26.963443 10107 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:26.976644 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:26.976766 15599 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:26.978775 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:26.948640 15893 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:26.980300 15897 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.968321 10710 raft_consensus.cc:606] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:26.968987 10113 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:26.984105  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:26.987097  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:26.762257  9936 rpcz_store.cc:269] 0709 13:17:48.168266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.168505 (+   239us) service_pool.cc:224] Handling call
0709 13:18:26.757342 (+38588837us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:20.975975 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:20.976582 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:20.976616 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:20.976637 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:20.978286 (+  1649us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:20.978351 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:20.978379 (+    28us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:18:21.034945 (+ 56566us) tablet.cc:701] Row locks acquired
0709 13:18:21.034968 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:21.037180 (+  2212us) write_op.cc:270] Start()
0709 13:18:21.040660 (+  3480us) write_op.cc:276] Timestamp: P: 1783603101037106 usec, L: 0
0709 13:18:21.042244 (+  1584us) op_driver.cc:348] REPLICATION: starting
0709 13:18:21.052034 (+  9790us) log.cc:844] Serialized 9117 byte log entry
0709 13:18:22.092547 (+1040513us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6c3de0ac 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b
0709 13:18:23.160187 (+1067640us) op_driver.cc:464] REPLICATION: finished
0709 13:18:23.555928 (+395741us) write_op.cc:301] APPLY: starting
0709 13:18:23.569394 (+ 13466us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:23.934329 (+364935us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:23.934360 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:23.941152 (+  6792us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b18003ada40. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:24.386908 (+445756us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:24.446429 (+ 59521us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=0,mrs_lookups=0
0709 13:18:24.446489 (+    60us) write_op.cc:312] APPLY: finished
0709 13:18:24.447147 (+   658us) log.cc:844] Serialized 204 byte log entry
0709 13:18:24.585997 (+138850us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.647052 (+ 61055us) write_op.cc:454] Released schema lock
0709 13:18:24.647129 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:24.647774 (+   645us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.647810 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63,"reported_tablets":50,"spinlock_wait_cycles":11520,"child_traces":[["op",{"apply.queue_time_us":391489,"apply.run_cpu_time_us":48234,"apply.run_wall_time_us":1095660,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":311711,"prepare.run_cpu_time_us":90638,"prepare.run_wall_time_us":1387385,"raft.queue_time_us":619309,"raft.run_cpu_time_us":29045,"raft.run_wall_time_us":385450,"replication_time_us":2075076,"spinlock_wait_cycles":120329216,"thread_start_us":2242995,"threads_started":5,"wal-append.queue_time_us":1480699,"wal-append.run_cpu_time_us":40211,"wal-append.run_wall_time_us":2456763}]]}
I20260709 13:18:26.988448 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:26.965373 15927 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:26.992901 10107 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.998981 10183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ff24b1804914099b167420853598f48"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:26.970204 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.001045 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.002166 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.002300 15860 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.003042 15860 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:26.964265 10111 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:26.999063 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:26.979615 10110 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:27.004374 10180 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:27.005509 15926 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.006886 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:26.999868 10183 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:27.008348 10183 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.012817 10108 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:27.003649 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:18:26.970196 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44766.9us
I20260709 13:18:27.016438 15938 raft_consensus.cc:1081] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:27.018507 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:27.019982 10180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a2fe5619be481399904909f88ce441"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:18:27.020570 10180 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:27.020929 10180 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.021929 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.023061 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.026683 10107 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:27.028642 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:27.030293 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.016331 15894 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:27.041102 15912 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.027822 15941 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.042433 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:27.034575 15694 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.049227 10180 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.018224 15775 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:18:27.029749 15926 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:27.068979 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:27.034950 15246 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:27.069882 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 101455us
I20260709 13:18:27.029891 15927 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.065624 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:27.080598 10180 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:27.083093 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:27.085875 10038 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:27.065851 15912 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:27.092149 15912 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.095531 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.097968 10113 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:27.067301 15897 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.055969 15894 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:27.070793 15722 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.107321 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.081548 15926 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:27.109086 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:27.096819 15586 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:27.119025 15027 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.104259 15903 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:27.103776 15873 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.139460 14662 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:27.139887 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.085867 15540 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:18:27.142318 14662 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:27.146782 14662 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.116765 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.149946 15775 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:27.150375 15775 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:27.110651 15927 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.156687 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:27.157333 10032 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:27.150761 15775 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.118194 15926 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.120645 15875 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:27.152907 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45664.1us
I20260709 13:18:27.146042 15866 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:27.162832 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46130.9us
I20260709 13:18:27.151079 15893 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:27.133953 15897 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:27.170378 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:27.171075 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 105524us
I20260709 13:18:27.151906 15873 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.182536 15694 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:18:27.194985 15873 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.195521 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:27.196131 10109 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.169525 15866 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:27.207958 10078 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.205003 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.209117 10186 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:27.164697 15894 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.210453 15894 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.210904 15860 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:27.212275 15949 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:27.212170 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:27.213563 15958 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.216238 15866 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.217389 15866 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.212492 15897 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:27.182844 15954 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.192399 15598 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.221765 15598 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:27.223541 15888 consensus_queue.cc:1175] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fd3903ba079e4f47aaf0aa4432382c23" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
I20260709 13:18:27.224300 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:27.234014 15586 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.237692 15927 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:27.240340 10109 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:27.243228 10110 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:27.250939 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.254454 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:27.253805 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45936.2us
I20260709 13:18:27.255489 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.255882 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.256224 10107 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:27.260322 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.192756 15893 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:27.263101 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:27.264544 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:27.265398 10034 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:27.265471 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.267581 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:27.272214 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:27.273379 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:27.260654 15897 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:27.274398 15897 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:27.274945 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.276356 10032 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:18:27.276705 10032 pending_rounds.cc:85] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 11
I20260709 13:18:27.276917 10032 pending_rounds.cc:107] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:18:27.277128 10032 raft_consensus.cc:2889] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.275338 15897 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.280081 15540 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.280987 14662 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.281303 15540 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:27.281713 15540 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:27.282085 15540 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.284745 15965 raft_consensus.cc:2764] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:27.260504 15909 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.290511 15909 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.290869 15909 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.296442 15893 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.262773 15927 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.311861 10180 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:27.314885 15913 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:27.315519 15694 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:27.319542 15775 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:27.318317 10107 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:27.323493 10711 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:18:27.327600 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 174489us
I20260709 13:18:27.328626 10188 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:27.274487 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.319703 15540 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:27.352726 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78320.1us
I20260709 13:18:27.353439 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:27.355612 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.356278 10109 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:27.357753 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.358976 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.357342 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.363819 15888 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.364545 15775 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:27.369614 15598 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.362322 15955 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:27.371012 15699 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.373436 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.373813 15699 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.366664 15860 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:27.368891 15572 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:18:27.374092 10180 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:27.378980 15926 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.362588 10183 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.383695 10180 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:27.374342 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.390488 10182 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:27.367403 15881 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:27.395071 10183 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:27.374536 15699 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.421310 10033 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:27.421762 10033 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:27.389810 15899 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:27.426746 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.429710 10182 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:27.429710 10112 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:27.431882 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:27.437192 10032 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:27.419065 15881 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:27.425997 15889 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.427156 15954 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.432446 15899 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.452469 15899 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.395911 15572 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:18:27.426350 15875 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:18:27.458226 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:27.460428 14662 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:18:27.436378 15912 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.474565 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:27.471683 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:27.458468 15926 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.463392 15572 consensus_queue.cc:1243] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer f145536c6dbe456fb8565950244bc2a5 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:18:27.491605 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.493011 10186 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
W20260709 13:18:27.496812 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 152415us
I20260709 13:18:27.478634 15598 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:27.456297 15889 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.500598 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:27.480574 15927 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.455176 15954 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.538004 15887 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:27.538439 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:27.538609 15887 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.543772 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:27.559461 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:27.549787 10185 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:27.548158 15540 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.516901 15598 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:27.533660 15959 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:27.588059 15598 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.589421 15598 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.593168 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:27.595060 10115 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:27.601504 10114 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:27.602977 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:27.549389 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.532702 15926 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:27.609694 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45543.5us
W20260709 13:18:27.625499 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 89673.5us
I20260709 13:18:27.623137 10180 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:27.633718 10115 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:27.619956 15958 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:27.624529 15903 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:27.652313 15903 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:27.653287 15903 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.654551 15903 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.659725 15958 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:27.660941 15958 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:27.662730 15954 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.600852 15966 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:27.663867 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.664578 10188 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:27.642554 15894 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.666877 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.666899 15894 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.668534 15966 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:27.674978 10114 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:27.612618 15909 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.638015 15887 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:27.681389 10033 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.690985 10033 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.547610 15881 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.709074 10033 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:27.714378 15899 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.678016 15966 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.718070 15966 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.692893 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:27.720912 10037 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
W20260709 13:18:27.699204 15975 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:18:27.699923 15887 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.700330 15941 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:27.703401 15736 raft_consensus.cc:993] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:27.704279 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:27.728655 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.750258 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.751047 10185 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:27.764074 14662 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:27.739542 15984 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.744560 15945 raft_consensus.cc:1081] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:27.751492 15954 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.737434 15887 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:27.796408 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:27.797577 10038 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.799365 10035 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:27.786624 15954 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.808683 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:53672
I20260709 13:18:27.809442 10113 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:27.809826 10113 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:27.821303 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.785283 15984 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.804801 15954 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.827833 15899 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.833732 15984 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.837051 15887 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:27.848480 15972 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:18:27.850287 15699 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.854671 15875 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.887523 15875 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.889678 15875 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.825448 10113 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.856484 15954 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.864856 15894 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.865428 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:27.867095 15722 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:27.873334 10711 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:27.873996 15912 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:27.879971 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.880676 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.882400 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:27.903832 10188 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.882889 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:27.886224 10038 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:27.856441 15909 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.892961 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:27.908767 10185 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.906323 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.907217 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:27.911091 10187 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:27.919697 10106 raft_consensus.cc:2368] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:27.918212 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:27.921100 15963 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:27.924655 15987 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:27.924794 15963 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:27.926577 15963 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.903179 15498 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:27.927994 15498 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.928396 15498 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.902915 15722 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:27.930585 15722 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:27.932121 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:27.932808 10111 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.918954 15926 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.937870 15926 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.944226 10188 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:27.947496 10111 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:27.948779 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:27.950507 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:27.951452 14662 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:27.952044 14662 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:27.954303 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.956475 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.956761 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.957369 10115 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:27.957775 10109 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:27.940408 15887 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.940209 15599 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.963940 14662 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.964890 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.963213 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:27.967386 10109 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.967327 10112 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:27.971549 15599 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:27.977526 15599 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.978612 10710 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:27.979939 15889 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.925673 15894 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:27.982918 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:27.983156 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:27.984822 10038 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:27.965854 15887 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.980923 15730 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.987269 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:27.990765 10109 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:27.973871 15729 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.959975 15873 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:27.988677 15699 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:27.992426 15887 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.011715 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.015722 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:28.003674 15599 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:28.021775 10185 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:28.024709 10035 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:28.025481 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.029238 10033 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:28.000839 15730 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.032099 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:28.039664 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:28.041517 10112 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:28.044697 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.045364 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:28.047650 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:28.051887 10039 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.004693 15729 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.034168 15599 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.027658 15926 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:28.055043 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.054013 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:28.059566 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:28.055897 15984 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:28.064561 15889 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:28.069576 15889 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.058784 15599 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.069937 15889 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.083566 10039 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:28.068706 15894 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.087060 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:28.074556 15927 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:28.076619 15984 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:28.099073 10109 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:28.096750 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.119918 10187 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:18:28.087498 15894 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.121178 10187 pending_rounds.cc:85] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 7
I20260709 13:18:28.122255 10187 pending_rounds.cc:107] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:18:28.122462 10187 raft_consensus.cc:2889] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:28.091547 15875 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:28.118726 15993 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:18:28.127972 15775 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:18:28.120010 15572 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:18:28.126467 15875 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.134745 15875 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.121434 15912 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.160866 15912 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:28.161321 15912 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.161816 15958 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:28.162395 15958 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.120615 15985 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:18:28.169894 15729 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.170648 15984 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.173008 15958 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:28.177690 10115 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:28.150956 15889 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.152442 15730 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.123936 15894 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.139377 15893 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:18:28.153211 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.153460 15966 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.183794 10108 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:28.156544 15498 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.158355 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:28.159596 15994 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:28.181697 10112 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:18:28.186283 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.188457 10185 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:28.188845 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:28.196565 10185 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:28.197938 10078 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:28.184139 15966 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.209692 15966 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:28.210376 15730 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:28.210832 15730 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.211187 15730 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.212414 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:28.190649 15246 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:28.216285 15246 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:28.217365 15246 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.209463 15987 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:28.218649 15987 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:28.190841 15598 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:18:28.219551 15987 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.220834 15598 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:28.221213 15598 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:28.220932 15987 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.222180 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:28.223517 15572 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.224123 15572 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.226022 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:28.217267 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47403.1us
I20260709 13:18:28.226859 10040 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:28.226965 15940 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.227380 15940 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:28.227758 15940 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.231263 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.210340 15966 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:28.232204 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.232990 10186 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:28.232734 15966 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.234272 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.234879 10037 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:28.237670 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.231178 10035 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:28.239496 10181 raft_consensus.cc:2393] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:28.255577 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.256539 10185 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:28.281179 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.287312 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.226347 15572 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.161195 15599 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.223588 15498 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.302546 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.276103 15958 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:28.285848 15775 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:28.291174 15873 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.316522 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:28.284772 15909 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.309201 15694 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.335393 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.336336 10115 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:28.222074 15598 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.319840 15958 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:28.306456 15875 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.377753 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:28.319034 15873 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.328043 15909 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.336117 15694 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:28.384933 15984 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:28.318833 15775 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:28.397542 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 116478us
W20260709 13:18:28.399370 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 91604.7us
I20260709 13:18:28.392712 15873 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.395476 15909 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.411834 15694 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.341527 15887 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.413403 15722 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.416649 15598 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.476507 10038 raft_consensus.cc:2368] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:28.421288 16007 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:18:28.503299 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.504544 10108 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:28.446839 15722 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.512915  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:28.502630 15999 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:18:28.521697 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.527595 10113 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:28.499307 15889 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.502610 16001 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:28.541754 10108 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:28.503348 15966 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:28.510206 15599 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.479725 15958 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.569609 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.561753 15722 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:28.570381 10035 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:28.549413 15966 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.579036 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.584311 10186 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.580826 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:28.565398 15875 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.568514 16018 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.573377 16008 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:18:28.589699 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.547397 16001 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.571616 16017 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:28.596891 10040 raft_consensus.cc:2368] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
W20260709 13:18:28.598176 16009 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:18:28.600348 16012 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:18:28.601090 16016 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:18:28.589540 16005 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:18:28.566102 15912 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.618825 15899 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.638475 15899 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.640667 15899 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:28.641784 15775 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:28.644893 15954 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.601104 16001 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:28.651909 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.625073 15887 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.652554 10188 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:18:28.652697 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 139218us
I20260709 13:18:28.652559 10185 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:28.648156 16004 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 13:18:28.621367 16018 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.660404 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:28.663164 10185 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:28.671664 10186 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:28.674932 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.624253 16017 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.678025 16001 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:28.678845 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.679289 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:28.679627 10036 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:28.680018 10710 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:28.678551 16001 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:28.687294 16001 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.694458 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.695101 10189 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.700973 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.701687 10183 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.702450 10189 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:28.703161 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.705740 10189 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:28.710512 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.711404 10188 raft_consensus.cc:2410] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:28.726040 15966 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:28.729945 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 53107.5us
I20260709 13:18:28.734328 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.731626 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:28.737433 10037 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:28.737910 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:28.739375 10110 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.689242 15894 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:28.738744 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 52436.5us
I20260709 13:18:28.692324 15730 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.757989 10716 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:28.762686 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:28.764286 15804 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:28.776510 16018 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:28.776633 16014 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:28.760833 15955 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:18:28.777415 16014 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.780120 16014 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.781190 15730 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.783710 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.784508 10188 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:28.785471 10183 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:28.786782 10187 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:18:28.787463 15940 consensus_meta.cc:287] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
I20260709 13:18:28.787976 15940 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.742009 16015 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.789016 10035 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.790759 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:28.801753 15938 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:28.805490 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.806844 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:28.793665 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:28.808596 10183 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:28.808917 10107 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.819005 10115 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:28.820490 10108 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:28.821992 10108 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:28.832010 10039 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:28.844874 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93204.1us
I20260709 13:18:28.785874 16017 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.844578 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.807554 16015 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.852753 10155 leader_election.cc:400] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:18:28.853225 10155 leader_election.cc:403] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:28.851773 10107 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:28.853832 16028 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 11. Current term is 12.
I20260709 13:18:28.818712 15938 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:28.856050 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.856777 10033 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:28.854959 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:28.858691 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:28.857962 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:28.862949 14662 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:28.863454 14662 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:28.864251 14662 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.865191 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.865765 10183 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.873718 10183 raft_consensus.cc:2410] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:28.880573 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:28.883052 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:28.884598 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.885413 10182 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:28.883831 10715 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:28.886901 10037 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:28.883148 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:28.889266 10187 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.854959 16015 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.849253 16027 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:28.902168 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:28.911176 10033 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:28.858120 15913 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:28.904665 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:28.844278 15984 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:28.912040 15913 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.912542 15913 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.910180 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:28.875397 15775 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.882387 15983 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:28.875591 16017 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:28.856962 15893 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:18:28.910509 15999 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:28.926151 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:28.937703 15913 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.945742 16025 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:28.880775 15694 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:28.957268 10153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.009s	sys 0.003s
W20260709 13:18:28.957712 10153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.009s	sys 0.004s
I20260709 13:18:28.928462 15926 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:28.925661 16017 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:28.921305 16014 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:18:28.973434 10187 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:28.975988 10153 leader_election.cc:400] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:28.976351 10153 leader_election.cc:403] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:28.977952 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:28.980206 10111 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:28.932284 15983 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:28.980118 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:28.990950 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:29.021939 15983 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:28.993904 16029 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:28.970865 16017 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.958446 15875 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:29.024283 15875 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:29.024672 15875 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.946969 16006 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.026444 16006 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.995419 15894 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:28.965775 15873 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.005s
I20260709 13:18:29.028766 15873 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.030951 15873 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:29.031873 10040 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:28.996536 15926 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:29.033460 15926 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:28.926528 15775 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.037582 15775 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:28.952765 16025 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:29.038309 16025 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:29.039469 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:29.041440 15694 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:28.999107 10115 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:18:28.996196 15909 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 13:18:29.052333 15909 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.054466 15909 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:28.945416 15899 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:29.047621 10079 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:29.055828 10035 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:29.056452 15899 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:28.920444 16027 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.057353 15875 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.058560 15913 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:29.002888 15940 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:29.061738 15941 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:29.063086 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 3084) took 1048 ms. Trace:
I20260709 13:18:29.063500 16006 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:29.047554 10110 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:29.031895 15912 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:29.022687 10111 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:29.058439 10114 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:29.063474 10038 rpcz_store.cc:276] 0709 13:18:28.015066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.015464 (+   398us) service_pool.cc:224] Handling call
0709 13:18:29.062871 (+1047407us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54003bd8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:29.062999 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057825664}
W20260709 13:18:29.077605 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85466.8us
I20260709 13:18:29.023816 16015 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.085223 10106 raft_consensus.cc:2368] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:29.086339 16015 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:29.094341 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 179593us
I20260709 13:18:29.099025 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:29.099819 10710 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.102638 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:29.103461 10112 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.105963 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:29.116711 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:29.128132 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:29.129029 10038 raft_consensus.cc:2368] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:29.133190 15875 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:29.144062 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:29.144682 10039 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.145924 10155 leader_election.cc:400] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:29.146255 10155 leader_election.cc:403] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.148322 15897 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:29.132404 10112 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:29.143198 16020 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:29.160455 10710 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
W20260709 13:18:29.156718 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 252591us
I20260709 13:18:29.164887 10039 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:29.176124 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:29.177058 10182 raft_consensus.cc:2368] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19.
I20260709 13:18:29.173069 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:29.179867 10155 leader_election.cc:400] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:29.184373 10182 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:29.185024 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:29.185653 10183 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.193895 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:29.198249 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:29.218243 10181 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.215372 10183 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:29.224462 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:29.193490 15963 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:18:29.273105 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 79443.9us
W20260709 13:18:29.336313 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 111942us
I20260709 13:18:29.337275 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:29.193372 15694 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
W20260709 13:18:29.389546 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 115741us
I20260709 13:18:29.392864 10155 leader_election.cc:400] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:29.393261 10155 leader_election.cc:403] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:18:29.389498 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52317.8us
I20260709 13:18:29.394124 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:29.395179 10710 raft_consensus.cc:2368] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
W20260709 13:18:29.321537 16045 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:29.399015 15964 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:29.421252 10003 leader_election.cc:400] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19.
I20260709 13:18:29.421700 10003 leader_election.cc:403] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.425827 10004 leader_election.cc:400] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:29.426268 10004 leader_election.cc:403] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.427708 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:29.428478 10039 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:29.429888 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:29.399693 16042 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.432686 15775 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:29.435110 15889 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.449355 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:29.434583 15572 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19.
I20260709 13:18:29.440544 15864 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:29.454646 15986 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:29.467967 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:29.451637 15775 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:29.441728 16025 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.469172 15782 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:29.485425 16018 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:29.510852 15775 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:29.500106 15897 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:29.500675 16017 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.488965 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:29.422791 15964 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.496237 10039 raft_consensus.cc:1275] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:29.496408 10181 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:29.492369 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:29.505875 10031 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:29.469095 15864 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:29.508565 16022 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:29.510068 16049 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:29.510663 15782 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.520759 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:29.524374 10112 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.512317 15897 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.500137 15986 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:29.544662 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:29.528824 10107 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
W20260709 13:18:29.535983 16050 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:18:29.519385 16029 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:29.565546 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:29.583817 10113 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.545933 15897 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.511677 16018 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.587204 10112 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:29.553140 16042 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:29.564340 16034 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:29.567338 16017 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:29.558038 15782 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:29.584718 15964 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:29.584117 15889 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18.
I20260709 13:18:29.619797 10113 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:29.689416 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:29.622607 16022 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:29.622854 16063 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:29.698565 10188 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:29.696113 10710 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:18:29.702705 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.566567 15864 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.589907 15986 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.616488 16042 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.695636 16062 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:18:29.717593 16022 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.721977 16018 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:29.624387 16034 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:29.722628 15958 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:29.733583 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:29.736120 15938 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.741031 10032 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:29.747670 15938 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:29.711555 16063 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:29.750384 16063 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:29.752926 15775 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.759454 16025 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:29.780938 15973 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:29.779776 16018 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:29.777145 15897 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.996076 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:29.998286 16064 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:18:29.998898 15897 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:29.972784 15973 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:29.974615 16018 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.059644 16042 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:30.054842 16072 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:18:30.142938 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3334) took 1150 ms. Trace:
I20260709 13:18:30.143471 10107 rpcz_store.cc:276] 0709 13:18:28.979047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.979219 (+   172us) service_pool.cc:224] Handling call
0709 13:18:30.129057 (+1149838us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000497d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:30.129204 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123676544}
I20260709 13:18:30.134836 16034 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.203348 15897 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.204562 16060 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.205145 16060 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.206630 16069 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.207199 16069 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.204144 15897 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.209646 16069 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.210209 16069 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.207438 16060 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.210767 16069 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.213691 16069 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.202044 15973 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.227674 15897 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.189296 16018 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:30.364921 10004 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 1.562s (SENT) [suppressed 20 similar messages]
W20260709 13:18:30.395210 15938 consensus_meta.cc:287] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.006s
I20260709 13:18:30.403154 15775 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.403999 15775 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.406539 15775 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.425185 15775 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.425861 15775 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.446004 15775 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:30.449842 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 84968.7us
I20260709 13:18:30.452697 16077 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.453420 16077 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.457369 16077 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.458258 16077 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.458819 16077 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.464509 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2641) took 1808 ms. Trace:
I20260709 13:18:30.465222 10185 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:30.464965 10040 rpcz_store.cc:276] 0709 13:18:28.656050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.656637 (+   587us) service_pool.cc:224] Handling call
0709 13:18:28.659734 (+  3097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.032349 (+372615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.464244 (+1431895us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540031bad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:30.464439 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855144320}
W20260709 13:18:30.469323 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.471728 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.472482 10180 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:18:30.472679 10185 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:30.472918 10180 pending_rounds.cc:85] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 8
I20260709 13:18:30.473851 10180 pending_rounds.cc:107] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:18:30.474151 10180 raft_consensus.cc:2889] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.475092 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.476075 10185 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:30.468456 16077 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.473238 15775 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.482174 15775 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.472683 16029 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.477272 15897 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.484202 16029 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.486645 15897 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.489238 15897 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.489305 16029 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:30.493229 10035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55698 (request call id 1032) took 1912 ms (client timeout 2157 ms). Trace:
W20260709 13:18:30.493691 10035 rpcz_store.cc:269] 0709 13:18:28.580381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.580539 (+   158us) service_pool.cc:224] Handling call
0709 13:18:30.493019 (+1912480us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001572d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:30.493142 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467791616}
I20260709 13:18:30.495618 15729 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.496582 15938 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.497149 15938 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.496214 15729 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.500078 15729 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.505373 15775 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.510982 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.511334 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.511598 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.512063 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.512702 10031 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:30.512894 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.513392 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.511977 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
W20260709 13:18:30.516144 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 1.00964e+06us
I20260709 13:18:30.517617 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:30.519889 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 1.01181e+06us
I20260709 13:18:30.521216 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:30.521829 10039 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.527009 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.527767 10031 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:30.530386 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:30.530664 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.530946 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:30.531186 10185 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:18:30.532112 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.536144 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.536916 10036 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:30.532019 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.538561 10716 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:30.544142 10039 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:30.549583 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.556378 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.572743 16026 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.573408 16026 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.576131 15963 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.576749 15963 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.533828 15964 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.545743 15775 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:30.587929 10106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2304) took 1783 ms (client timeout 1562 ms). Trace:
I20260709 13:18:30.545957 15864 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.590626 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:30.591614 10106 rpcz_store.cc:269] 0709 13:18:28.804786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.805145 (+   359us) service_pool.cc:224] Handling call
0709 13:18:30.578775 (+1773630us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400420c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:30.587804 (+  9029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636356992}
I20260709 13:18:30.546319 16017 consensus_queue.cc:1048] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:30.593302 16027 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.595453 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.546631 15899 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:18:30.599145 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:30.562307 16002 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.561904 16006 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.599953 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.606518 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.575680 16026 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.555320 15955 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:18:30.610256 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 86350.3us
I20260709 13:18:30.602090 15881 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.586195 15926 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.596761 16063 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.619877 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.621402 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.626874 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.628793 10031 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:30.609609 16027 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:30.607194 15966 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.637699 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.612542 15964 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:30.640321 10715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1090) took 1657 ms (client timeout 1518 ms). Trace:
I20260709 13:18:30.637460 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:30.643985 10031 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:18:30.617763 16070 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:30.643066 10715 rpcz_store.cc:269] 0709 13:18:28.977394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.977542 (+   148us) service_pool.cc:224] Handling call
0709 13:18:30.634675 (+1657133us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400640354. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:30.634835 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590603776}
I20260709 13:18:30.596493 15775 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.646622 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:30.649783 10040 raft_consensus.cc:2368] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:18:30.600703 15864 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.634377 15984 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.611317 16002 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.640988 16027 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.616658 16006 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.649013 16084 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.638752 15926 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.647020 15964 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.651467 16070 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.658885 15899 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.666535 10081 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:18:30.667198 16011 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:30.667484 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.680313 16011 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.681381 16029 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.682083 16029 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.683005 16011 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.683662 10081 leader_election.cc:403] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.659816 15897 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.667882 16017 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.654201 15954 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:30.635949 15881 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.658398 16027 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.671983 16015 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:30.674093  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2f672b54d4754c5aa62b5b919597a14e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:30.719274  9923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 45232.7us
I20260709 13:18:30.645223 16063 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.653601 16007 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.686607 10078 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:18:30.648123 15966 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.674752 16086 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.672945 15938 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:30.710229 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43866.7us
I20260709 13:18:30.713722 16066 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.715847 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 83764.4us
I20260709 13:18:30.719172 16011 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.716717 15782 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.704203 15899 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.719785 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.673417 16084 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.748728 15955 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.704557 15973 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.707408 16069 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:30.740633 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 120039us
I20260709 13:18:30.706802 16060 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.766108 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:30.766661 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:30.708926 16089 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:30.726496 16015 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.755007 10081 leader_election.cc:400] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:18:30.772189 10081 leader_election.cc:403] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.745680 15963 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.676164 16085 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.722054 16091 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:30.719955 15954 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.709666 15897 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.767011 10107 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:30.767513 10106 raft_consensus.cc:2368] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:30.656968 15984 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.753821 16097 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:30.756888 16029 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.723256 16017 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.772523 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.756172 16086 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.770147 15973 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.772965 16069 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.773133 16060 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.784416 16091 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.774868 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:30.725428 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:30.760579 15913 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.884053 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.884354 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:30.885401 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 94024.4us
I20260709 13:18:30.744966 16007 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.783213 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.784824 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:30.922158 10107 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:30.758301 16066 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.771714 15775 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.771912 15964 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.851013 16070 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.847273 16015 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.850147 15959 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:30.760979 16011 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.848651 16084 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.848968 15899 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:30.945226 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 219869us
I20260709 13:18:30.941468 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.774256 16089 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.850436 15973 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:30.850646 16074 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.848s	user 0.036s	sys 0.064s
I20260709 13:18:30.956598 10107 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:30.855589 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.852656 16006 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.851652 16069 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.849479 15897 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.761018 15782 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:30.845899 16100 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:30.854076 15954 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.852959 16063 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:30.888501 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.923791 10106 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:30.928673 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 173774us
I20260709 13:18:30.946758 15775 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:30.931977 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 160943us
I20260709 13:18:30.974783 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.975328 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.975839 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.975940 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.940809 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.845888 16029 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.846175 15864 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.980512 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:30.950099 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 186380us
I20260709 13:18:30.883687 15927 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:30.855197 16060 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.932277 15913 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:30.977386 10708 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:30.979079 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.981187 10034 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
W20260709 13:18:30.998729 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.984716 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.987674 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.990306 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.969686 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.989636 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.002476 10189 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:31.003829 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.991535 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.986382 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.004791 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:30.964099 16070 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.004756 10188 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:30.972558 15926 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.012333 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.967072 10710 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 1097) took 1210 ms. Trace:
I20260709 13:18:31.004930 10186 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:31.006138 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.004896 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.006731 10106 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:30.956892 16091 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.006431 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.007400 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.991245 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.965610 16017 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.008579 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.009742 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:30.783923 16085 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.003943 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.018157 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:31.036481 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.969085 15955 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:18:30.966030 16086 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.990960 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.058357 10182 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:31.037352 10111 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:30.965404 15966 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.038990 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.038877 10184 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:31.067108 10106 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:31.039402 10180 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
W20260709 13:18:31.039865 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57717.3us
I20260709 13:18:31.036129 10710 rpcz_store.cc:276] 0709 13:18:29.756235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.756389 (+   154us) service_pool.cc:224] Handling call
0709 13:18:29.756732 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.757166 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.757198 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.759156 (+  1958us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.846818 (+ 87662us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:29.846861 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.846936 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.800528 (+953592us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:30.966739 (+166211us) raft_consensus.cc:1685] finished
0709 13:18:30.966771 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.967009 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1728,"spinlock_wait_cycles":14060288,"thread_start_us":74251,"threads_started":1,"wal-append.queue_time_us":241456}
I20260709 13:18:31.041514 10188 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:30.983513 15984 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:30.956928 16103 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:30.964155 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:30.966188 15782 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:30.961266 16092 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14.
I20260709 13:18:31.041236 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:30.970247 16007 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.010725 10114 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:31.048333 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.049292 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:30.949855 15959 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.071136 10113 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:31.071585 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:30.984632 16029 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.099584 10107 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:31.094458 10713 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:31.044135 16006 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.161435 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 120282us
I20260709 13:18:31.133756 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:31.145186 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 96935.1us
I20260709 13:18:31.148722 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.166363 10040 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:31.170243 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.171061 10106 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
W20260709 13:18:31.171945 10032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2658) took 1684 ms (client timeout 1525 ms). Trace:
W20260709 13:18:31.172367 10032 rpcz_store.cc:269] 0709 13:18:29.487582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.492063 (+  4481us) service_pool.cc:224] Handling call
0709 13:18:31.171703 (+1679640us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002774d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:31.171867 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244193152}
I20260709 13:18:31.176879 16089 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.177714 15699 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.178284 15699 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.180370 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.181010 10115 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:31.183060 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.069818 16017 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.184319 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.184427 10180 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:31.186179 10182 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:31.188575 10183 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:30.966547 16100 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.024034 16070 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.209187 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.196870 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.194600 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.197606 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.198760 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.199491 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.211966 10112 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:31.008177 15927 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.214006 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.223393 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.228192 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:31.228943 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.231698 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.232453 10115 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:31.235021 10114 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:31.236439 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.234705 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.231160 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.192631 15955 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.164819 16060 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.241312 10187 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:31.238606 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.212682 16007 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:31.243784 10107 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 11.
I20260709 13:18:31.209623 15913 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.258725 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.236052 15694 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:31.259316 10115 raft_consensus.cc:2376] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14. Re-sending same reply.
I20260709 13:18:31.184322 16017 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:31.270411 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 268257us
I20260709 13:18:31.271484 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.281318 10155 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.212973 16006 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.282512 16028 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:31.285176 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.291096 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.291787 10108 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:31.293251 10155 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.266523 15984 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.273758 16007 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:31.298081 10112 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:31.294479 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.287813 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.283351 15775 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.301803 16100 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.302369 15699 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.288605 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.244614 16027 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.315413 16027 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.306509 10114 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:31.315661 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.316490 10032 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:18:31.300168 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.289920 16066 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.308614 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.289291 16028 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.318061 10188 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:31.307090 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.298808 16011 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.258513 15955 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:31.327028 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 204488us
I20260709 13:18:31.320745 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.305619 16062 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.326970 16028 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.353574 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:31.357800 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:31.360076 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.362462 16103 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:31.362959 16103 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:31.363370 16103 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.368979 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.370910 16011 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.372991 16011 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.374763 16015 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.376233 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.385241 16011 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.387039 16015 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:31.391052 16015 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.391734 16015 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.389777 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.410214 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.413007 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.413592 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:31.414517 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93849.4us
I20260709 13:18:31.414410 10185 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:31.323441 15864 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.421556 16113 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.330s
I20260709 13:18:31.422206 16098 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.422609 16036 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:31.422984 16010 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.423341 16102 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.423698 16110 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:31.424057 16104 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:18:31.424350 16068 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.424703 16107 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:18:31.425307 16000 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:31.331662 16034 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.331876 16066 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.327427 15987 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:31.428287 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 99189.6us
I20260709 13:18:31.456617 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.459055 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.460064 10115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55796
I20260709 13:18:31.488410 10115 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Received request to transfer leadership
I20260709 13:18:31.425550 16108 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.321025 15984 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:31.462276 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 132977us
I20260709 13:18:31.460950 15982 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:31.492250 16112 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.492388 15982 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.493080 16024 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:31.493559 16024 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:31.493927 16024 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.494879 15982 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.458345 16010 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.496569 16006 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.496977 16010 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.497370 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:31.499645 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.500347 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.502080 10109 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:31.506412 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.507660 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.507894 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.461738 16110 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.467705 16029 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.518607 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:31.442035 15864 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.520239 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.522047 10114 raft_consensus.cc:2376] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18. Re-sending same reply.
I20260709 13:18:31.523075 10111 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:18:31.484638 16034 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.528512 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:31.490777 15959 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.484313 16066 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.531643 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:31.421124 16103 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.490582 16068 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:31.505897 16070 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.519397 16110 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:31.467940 16036 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.532141 10111 raft_consensus.cc:2376] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18. Re-sending same reply.
I20260709 13:18:31.484133 16000 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.505298 15987 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:31.574390 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64573.5us
I20260709 13:18:31.574645 10115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55796
I20260709 13:18:31.575244 10115 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Received request to transfer leadership
I20260709 13:18:31.552398 16068 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.515908 15945 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:18:31.536620 16066 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.561132 16028 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.555863 16126 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:31.458060 16007 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.565256 15984 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.566342 16085 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:31.568270 16120 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:18:31.592784 16036 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.600317 15955 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:31.602304 15864 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.610229 16103 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.567095 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:31.569008 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.569768 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.485116 15782 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:18:31.423005 16015 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:31.626940 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59929.1us
I20260709 13:18:31.627938 16085 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.627971 10109 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:31.467514 16102 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.628391 16085 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.628916 16085 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.630296 16102 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.633569 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.633822 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.634524 10036 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:31.635561 16024 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.637130 16002 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.628522 16110 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.638994 16110 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.639200 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.639846 10713 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:31.640220 16025 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:31.640592 16025 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:31.641367 16025 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.641757 16010 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.642349 16025 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.647917 16024 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.533552 16034 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.648602 16015 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:31.573539 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 158355us
I20260709 13:18:31.650949 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.459529 16098 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:31.651952 15938 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:31.652388 10183 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:18:31.652792 10183 pending_rounds.cc:85] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 9
I20260709 13:18:31.653029 10183 pending_rounds.cc:107] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:18:31.653236 10183 raft_consensus.cc:2889] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.511157 16108 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.579281 10111 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:31.576383 16132 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:31.588515 15987 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.647823 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.586429 16000 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.654636 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.664575 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:31.653335 16098 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:31.669977 16132 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.678627 16132 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.679452 16067 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.679917 16067 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:31.680256 16067 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.681243 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.682518 15987 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.684250 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.684842 10032 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:31.687547 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.689509 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.690454 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.692499 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.682859 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.698330 10184 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:31.652575 15888 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:18:31.704792 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.705549 16010 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.706504 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.651916 16042 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:18:31.699661 16081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.017s	sys 0.023s
W20260709 13:18:31.712467 16081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.018s	sys 0.023s
W20260709 13:18:31.710423 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 204580us
I20260709 13:18:31.713251 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:18:31.710866  9923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98202.4us
I20260709 13:18:31.718199 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.718786 16044 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.719420 16028 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.708469 16126 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:31.721841 16126 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.725387 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:31.728608 16140 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.729995 16067 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.733078 16067 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.733492 16108 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.736483 16066 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.736954 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:31.738662 16066 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.739416 15938 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:31.740818 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:31.747454 10032 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:31.748183 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.748479 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.748908 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.749150 15881 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.750615 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.750761 10040 raft_consensus.cc:2376] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18. Re-sending same reply.
I20260709 13:18:31.751626 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:31.752805 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.753368 10040 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:31.752631 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 362950us
I20260709 13:18:31.749295 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.754462 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.761077 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.761982 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.762279 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.764032 10680 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.765612 15699 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.760527 15963 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.768194 16078 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.768657 16078 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.769225 16078 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.768533 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.772013 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:31.779042 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:31.785920 16106 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.784533 10037 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:31.764055 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.790218 16011 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.778644 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:31.796875 10040 raft_consensus.cc:2468] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:31.773691 16141 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:31.785171 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3340) took 1011 ms. Trace:
I20260709 13:18:31.799273 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.799806 10113 rpcz_store.cc:276] 0709 13:18:30.774469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.774610 (+   141us) service_pool.cc:224] Handling call
0709 13:18:31.785003 (+1010393us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54000b5754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:31.785112 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495609088}
I20260709 13:18:31.803450 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.804415 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.807492 10107 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:31.808445 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.808781 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:31.784511 16143 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:31.812045 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.812211 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.812769 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.813475 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.816792 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.786753 15955 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.763144 16044 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.814626 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.727402 16034 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.799834 16097 raft_consensus.cc:993] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:18:31.819254 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:31.819231 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57316.9us
I20260709 13:18:31.820873 10037 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:31.822005 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.822407 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.823560 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:31.825063 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.826187 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.801983 16137 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.833464 16137 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.833875 16137 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.817445 16110 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.801787 16011 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.799470 15729 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:18:31.836889 16110 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:31.838600 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.830950 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:31.843532 10032 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:31.837738 15987 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:31.867404 15987 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:31.869110 16110 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:31.870010 15987 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.838124 15963 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.872123 15987 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.839880 15955 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.872548 16034 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.778975 16078 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.874295 15955 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.876153 16078 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:31.877622 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 51520.5us
I20260709 13:18:31.878736 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.815214 16141 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:31.879758 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48856.4us
W20260709 13:18:31.908806 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83832.5us
I20260709 13:18:31.909684 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.876582 16011 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.899775 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.893363 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:31.913643 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:31.917519 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 75258.1us
I20260709 13:18:31.920511 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.828130 16024 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:31.921670 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:31.924852 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:31.798394 16085 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:31.925809 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:31.926049 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 106898us
I20260709 13:18:31.928864 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:31.928408 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:31.929425 10188 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:31.918639 15964 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.879103 16007 raft_consensus.cc:1081] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:18:31.932089 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.908707 16002 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:31.934914 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.921465 15699 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.939148 10040 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:31.939422 10714 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:31.911926 16141 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:31.943444 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:31.944489 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:31.930027 16024 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.946761 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.945405 10081 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:31.932471 15964 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:31.939755 16103 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.948028 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.951987 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.971856 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.937139 16002 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:31.949543 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:31.949208 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:31.949141 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.935721 16112 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.932737 16097 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.997884 16071 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:31.999001 16082 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.185s
I20260709 13:18:31.999478 16071 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.001617 16071 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:31.974104 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:31.967626 15964 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.004232 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.009693 16082 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.010290 16082 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.013921 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:32.016054 16082 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:31.960176 16092 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:18:31.972597 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:31.977701 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:32.017378 10185 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:31.978991 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:31.941895 16006 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:32.018697 16006 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:31.998800 16097 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.019526 16097 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.967883 15955 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:32.020661 15955 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.021119 15955 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.019126 16006 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.998279 16011 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.956990 16086 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.952216 16024 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:31.945899 15963 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.948325 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:32.036460 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 62449.9us
I20260709 13:18:32.036823 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.038300 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 2673) took 1063 ms. Trace:
I20260709 13:18:32.040232 10033 rpcz_store.cc:276] 0709 13:18:30.974696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.975817 (+  1121us) service_pool.cc:224] Handling call
0709 13:18:31.001014 (+ 25197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.001200 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:18:31.221278 (+220078us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.289632 (+ 68354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.289688 (+    56us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:31.289746 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.292680 (+  2934us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.038137 (+745457us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b540031bfd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:32.038243 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22997,"prepare.queue_time_us":156701,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":9105,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3720,"spinlock_wait_cycles":4230016,"thread_start_us":245157,"threads_started":2,"wal-append.queue_time_us":92214}
I20260709 13:18:32.041762 16081 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.043277 16081 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.045581 16081 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.041791 15963 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:32.046710 15963 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.976464 16112 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:32.048653 16112 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.984858 16002 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:32.053586 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:32.053956 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.057139 10112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55796
I20260709 13:18:32.057765 10112 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Received request to transfer leadership
I20260709 13:18:32.038146 16007 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.060870 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.062289 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:32.041254 16092 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.064568 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:32.068333 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:32.035251 16015 raft_consensus.cc:2804] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:32.072383 10078 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.058353 15881 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:32.058442 16011 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:32.085538 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.075984 16108 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:32.089280 10033 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.062186 16021 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:32.089994 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.104101 16137 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.071993 16092 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.071888 16067 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:32.071376 16105 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
W20260709 13:18:32.127902 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 182552us
I20260709 13:18:32.084374 16086 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.085481 16015 raft_consensus.cc:697] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:32.138294 16015 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.099128 16108 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.134852 16147 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:18:32.135331 16085 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:32.135994 10038 raft_consensus.cc:2368] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:32.137059 16011 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.152176 16006 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.154592 16006 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.122145 15964 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.156984 16024 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.157667 15964 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:32.159123 16024 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.131853 16097 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.169854 16097 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.173960 10039 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:18:32.175987 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 114400us
I20260709 13:18:32.177096 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:32.146364 16108 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:32.180153 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 177221us
I20260709 13:18:32.181228 10037 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:32.184072 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.194089 16141 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.199515 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.200162 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.201632 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:32.201712 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:32.202776 10712 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:32.201630 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.203570 10107 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 12.
I20260709 13:18:32.208204 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:32.197027 16096 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.178996 16085 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:32.213897 15955 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.214282 16141 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:32.215634 16096 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.216272 16096 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.218385 16096 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:32.225239 16002 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.227422 16002 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:32.228082 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.230516 10110 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:18:32.227969 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.230839 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.227545 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.235846 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.236466 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.237164 10107 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:32.238423 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.246814 10107 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:32.181023 16078 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.253028 10114 raft_consensus.cc:2368] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:32.150368 16011 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.259939 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.260720 10114 raft_consensus.cc:2368] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:32.261399 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.260249 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:32.264518 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.264804 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.266847 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.267588 10115 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
W20260709 13:18:32.259801 10153 connection.cc:256] RPC call timeout handler was delayed by -1.1471224629997323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 13:18:32.223457 16112 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.254988 16096 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:32.297955 10108 raft_consensus.cc:2368] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:32.298875 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:32.299502 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:32.301277 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:32.328711 10188 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.328956 10111 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:32.310647 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:32.315109 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:32.316412 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:32.317857 10711 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:32.318472 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:32.319440 10712 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:32.320657 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.322338 16079 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:18:32.324729 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.334470 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:32.395956 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.356063 10107 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:32.413447 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:32.418429 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.419762 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.420893 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.421200 16112 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.421499 10107 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:32.422854 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.272097 15955 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.265090 16078 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.428750 10107 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:32.356048 16147 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:18:32.447971 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:32.428697 10039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39426
I20260709 13:18:32.445577 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.445497 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.442088 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.442776 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:32.450542 10039 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:32.451030 10039 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.451840 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.453595 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.453979 16110 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:32.454443 10711 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:32.455041 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.455179 15873 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.456182 10107 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:32.379669 16079 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:32.458796 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.377249 16085 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:32.461539 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.463413 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.463625 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.377511 16081 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.464148 10040 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.465639 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:32.467907 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.470976 10107 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:32.468165 16150 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.480379 10034 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:32.460400 16079 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:32.462725 15873 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:32.425601 16108 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.484113 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.473205 16141 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.483108 16137 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.444643 16067 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:18:32.473431 16085 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:32.485332 16151 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.503105 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.464767 16024 consensus_queue.cc:1059] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:32.471362 16081 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.509217 10040 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:32.508123 10039 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.528199 10115 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:18:32.528663 10115 pending_rounds.cc:85] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 10
I20260709 13:18:32.528895 10115 pending_rounds.cc:107] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:18:32.529119 10115 raft_consensus.cc:2889] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:32.498153 15963 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:32.542714 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 267808us
W20260709 13:18:32.540911 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 128489us
I20260709 13:18:32.556241 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:32.525302 16046 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:18:32.558887 10039 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:32.529857 16110 consensus_queue.cc:1059] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:18:32.523636 16151 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.563939 10115 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.570147 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:32.570878 10711 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.568392 10708 raft_consensus.cc:1240] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.554416 16011 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.555351 16067 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.580271 16156 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:18:32.580787 15927 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.582612 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2326) took 1083 ms. Trace:
I20260709 13:18:32.583773 16108 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:32.536948 16079 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.585582 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:32.590677 10711 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:32.632344 10708 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:32.628326 10109 rpcz_store.cc:276] 0709 13:18:31.499088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.503620 (+  4532us) service_pool.cc:224] Handling call
0709 13:18:31.503916 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.631421 (+127505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.582346 (+950925us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540026cad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:32.582525 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284812672}
W20260709 13:18:32.640075 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 189570us
I20260709 13:18:32.640180 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:32.641592 10109 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:32.642163 10109 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:32.558420 16085 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.629388 16067 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.643035 10109 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.657363 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.653437 16108 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.659776 16108 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.661336 16067 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.661959 16108 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.666548 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.667297 10111 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:32.677043 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:32.677871 10038 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
W20260709 13:18:32.704676 16164 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:32.707953 16163 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:32.681129 16108 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.710037 16108 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:32.712229 16160 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:18:32.715250 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:32.681353 16161 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:18:32.717573 16165 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:32.719699 10108 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:18:32.724383 10113 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:32.725505 10111 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:32.722942 16136 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:32.720386 15963 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.743057 16078 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.757237 16136 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:32.816143 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 175227us
I20260709 13:18:32.818354 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:32.819007 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:32.796849 16108 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:30.053588  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:32.826491 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:32.829005 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:32.834798  9935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 187) took 8861 ms. Trace:
I20260709 13:18:32.832868 16106 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.832216 15940 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.835204  9935 rpcz_store.cc:276] 0709 13:18:23.969489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.969985 (+   496us) service_pool.cc:224] Handling call
0709 13:18:32.830610 (+8860625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:27.202322 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:27.228373 (+ 26051us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:27.228442 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:18:27.228483 (+    41us) tablet.cc:662] Decoding operations
0709 13:18:27.260726 (+ 32243us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:27.275916 (+ 15190us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:27.275953 (+    37us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:27.277193 (+  1240us) tablet.cc:701] Row locks acquired
0709 13:18:27.277243 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:18:27.277421 (+   178us) write_op.cc:270] Start()
0709 13:18:27.277570 (+   149us) write_op.cc:276] Timestamp: P: 1783603107277348 usec, L: 0
0709 13:18:27.277595 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:27.278274 (+   679us) log.cc:844] Serialized 6345 byte log entry
0709 13:18:27.966034 (+687760us) op_driver.cc:464] REPLICATION: finished
0709 13:18:28.071779 (+105745us) write_op.cc:301] APPLY: starting
0709 13:18:28.071910 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:28.177089 (+105179us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:28.177215 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:28.688065 (+510850us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:28.689643 (+  1578us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:18:28.689696 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:28.694503 (+  4807us) log.cc:844] Serialized 148 byte log entry
0709 13:18:28.694675 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:28.694837 (+   162us) write_op.cc:454] Released schema lock
0709 13:18:28.694889 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:28.695322 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:28.695351 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1858295,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":99368,"apply.run_cpu_time_us":26030,"apply.run_wall_time_us":623555,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":322692,"prepare.run_cpu_time_us":18619,"prepare.run_wall_time_us":269569,"raft.queue_time_us":244285,"raft.run_cpu_time_us":27231,"raft.run_wall_time_us":132898,"replication_time_us":671691,"thread_start_us":505646,"threads_started":4,"wal-append.queue_time_us":269061,"wal-append.run_cpu_time_us":13440,"wal-append.run_wall_time_us":2212859}]]}
I20260709 13:18:32.835682 16078 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:32.837891 16017 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.850448 16078 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.855723 16078 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.866050 10106 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:32.880584 16169 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:32.884932 16181 raft_consensus.cc:2764] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:18:32.885903 16181 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:32.850878 15940 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:32.890133 16171 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.890691 16171 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:32.892288 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.894222 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.894655 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.895047 10114 raft_consensus.cc:2410] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:18:32.895272 10106 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:32.894217 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:32.896528 10107 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:18:32.898787 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 43516.4us
I20260709 13:18:32.902496 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:32.902948 10107 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:32.899581 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:32.904419 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 85225.7us
I20260709 13:18:32.839643 16136 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.907085 10155 leader_election.cc:400] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:32.907182 16138 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:32.912992 16138 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:32.913843 16138 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.915089 16138 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.917619 16112 raft_consensus.cc:3055] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:32.918084 16112 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:32.918319 16171 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:32.918958 16112 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:32.926888 16136 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:32.927546 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:32.929025 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:32.945681 10153 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:32.948814 10186 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.949481 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:32.950382 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.951936 10715 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:32.907455 10155 leader_election.cc:403] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.930603 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:32.932422 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:32.959607 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:32.960551 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55085.1us
I20260709 13:18:32.933182 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:32.907943 16178 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:32.912144 16151 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.912375 16113 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:32.939251 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:32.940258 10037 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:32.897353 15940 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:32.954423 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:32.990067 10031 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:32.989327 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.961020 10033 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:32.961402 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:32.967389 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:32.932529 16138 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:32.962759 10187 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:32.993448 10185 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:33.016892 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:32.955323 16131 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.957468 10153 leader_election.cc:400] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
W20260709 13:18:33.020815 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 63502.9us
I20260709 13:18:33.021270 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:33.021402 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54128.4us
I20260709 13:18:33.018142 15964 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:33.022539 16011 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:32.956203 16172 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.992025 15963 consensus_queue.cc:1059] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:33.028275 16067 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:32.961997 16176 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.031849 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.017369 16138 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:32.998461 10186 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:33.033599 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.023523 16092 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.989104 16108 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.046123 10185 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:33.015543 16135 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:32.991858 15498 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:18:33.019961 15927 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:32.993746 16178 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:32.963212 16078 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.061076 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.019461 16034 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:18:33.059535 16138 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.066090 16067 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:33.038404 15966 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:18:33.062325 16135 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.074131 10712 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:33.075429 15940 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:33.085029 16131 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:33.085556 10109 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.062129 16180 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:33.068286 16178 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:33.093554 10003 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:33.108426 10109 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:33.106294 16067 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:33.095187 16135 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:33.115175 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.115947 10185 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:33.117480 10184 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.117919 10187 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:33.101948 16131 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.103041 15964 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:33.123219 16186 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:18:33.110874 16110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.007s
I20260709 13:18:33.124049 15964 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.119452 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.125417 10187 raft_consensus.cc:2410] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:33.120494 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.122181 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.122967 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.131493 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.132081 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.132238 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:33.124513 16110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.004s	sys 0.007s
I20260709 13:18:33.142396 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.127276 16131 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.120641 16067 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:33.183931 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 132745us
W20260709 13:18:33.218377 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 76071.9us
I20260709 13:18:33.219556 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:33.223044 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 162047us
I20260709 13:18:33.168957 15966 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:18:33.228935 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.231273 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:33.231597 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.237577 10153 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.238626 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.238917 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:33.174454 16138 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.221772 16191 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.248311 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:33.248749 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.250263 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:33.250861 16195 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:33.253937 16195 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:33.254300 16195 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:33.254961 16081 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.255879 16197 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:33.256275 16175 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:33.256718 16175 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:33.257066 16175 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.256361 16197 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:33.260232 16197 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.250911 16089 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:33.262245 16078 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:33.242625 15955 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:33.249960 15498 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.259855 15927 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.252630 10188 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:33.233848 16189 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.268584 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.271047 16112 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.249277 16067 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.284121 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:33.285782 16183 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:18:33.288050 16195 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.290325 16178 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.286321 16197 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.287990 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.290195 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.296088 16197 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.298484 10180 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:33.303529 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.304292 10115 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.337252 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:33.337975 10034 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.242964 16172 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:33.342119 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 95187us
W20260709 13:18:33.312651 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.347868 10183 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:33.242780 16194 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:18:33.290333 16195 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.357934 15964 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.342252 16136 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.345146 15498 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:18:33.368973 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.342202 16002 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:18:33.297585 16175 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:33.390681 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 140492us
I20260709 13:18:33.345078 16138 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.387919 10184 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:33.387598 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.401441 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.401214 10034 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:33.338979 15984 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.361320 15940 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:33.390897 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 346182us
I20260709 13:18:33.404204 10115 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:33.403216 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.401738 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.404996 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.409256 16172 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:33.409703 16172 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:33.410072 16172 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.410533 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.411468 16193 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.411729 10153 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.412621 16193 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:33.413923 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.414688 16193 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:33.415066 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.407574 10680 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:33.420040 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.420967 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.396181 15782 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.450538 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.406275 16089 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:33.362323 16189 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:18:33.455490 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.456434 15963 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:33.456842 15963 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.456843 16190 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:33.453896 16197 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:33.458267 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.452301 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.399138 16067 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:18:33.389320 15964 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.465178 16067 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:33.465603 16067 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:33.418632 16132 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:33.466377 15964 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.454874 16198 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:33.458176 16178 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.449887 16193 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:33.468966 16131 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.422164 16096 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:33.460352 15498 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:18:33.471171 16131 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.417337 15940 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.466408 16067 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.391244 16136 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.463879 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.408527 15984 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.464303 16180 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:33.469271 16193 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:33.520252 15984 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.500376 16131 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:33.521373 16131 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:33.522281 16131 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.419195 16192 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:33.473937 15940 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.474646 16089 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:33.475476 16201 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:33.457440 16190 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.524791 16190 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:33.501791 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.524971 16089 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.509311 16096 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:33.528469 16096 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.457276 15963 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:33.518185 16203 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:18:33.463856 16197 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:33.530122 16197 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.523996 16192 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.531958 16192 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.541329 16136 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:33.542474 16207 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:33.542465 15955 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:33.543929  9986 auto_rebalancer.cc:893] Removing replace marker failed: Replica fd3903ba079e4f47aaf0aa4432382c23 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:33.543725 15955 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.544348 16132 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:18:33.544345  9986 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f1fa3c9e8a7a496eaa49ec78b5a92103 already in progress
W20260709 13:18:33.545265  9986 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f1fa3c9e8a7a496eaa49ec78b5a92103 already in progress
I20260709 13:18:33.545907 15955 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.547502 16175 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.548604 16178 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.520102 16193 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:33.551982 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.552838 10189 raft_consensus.cc:2410] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:18:33.554145 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52439us
I20260709 13:18:33.554890 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.555519 10115 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:18:33.556452 10188 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:33.556825 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 137982us
I20260709 13:18:33.527199 16172 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.559648 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:33.560191 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 102022us
I20260709 13:18:33.514359 16180 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:33.562461 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.563469 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.578749 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:33.582267 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.580582 15888 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:33.583877 16198 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.584304 15888 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:33.558353 16175 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.585947 10153 leader_election.cc:400] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:33.596393 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.598080 10153 leader_election.cc:400] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:33.599058 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:33.573153 16191 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.582533 16180 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:33.581044 16002 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.577160 16204 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:33.577669 15984 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:33.602720 16198 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:33.602626 15888 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:33.545293 16132 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.604671 16194 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.581774 16181 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:33.572986 15782 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:33.594775 16196 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:18:33.632928 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54274us
I20260709 13:18:33.622758 16175 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:33.607221 15963 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.650662 10181 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:33.651330 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.648100 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.630488 15888 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.625445 16204 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:33.654246 10033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:33.661900 10033 raft_consensus.cc:606] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.662329 10033 raft_consensus.cc:614] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.651957 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.658574 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.622622 16002 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:33.671701 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 72726.5us
I20260709 13:18:33.643944 16175 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:33.675344 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.679461 10110 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.677492 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.639020 16197 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.684464 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.686193 16190 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.688805 16190 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.669840 16204 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.695472 16112 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:33.696838 10185 raft_consensus.cc:3055] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:33.697202 10185 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:33.698581 10187 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:18:33.696619 16112 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:33.701205 10033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "366d253a473243de9090f7b03b1c955b"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:33.697904 10185 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.701797 10033 raft_consensus.cc:606] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.700824 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.680948 16175 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.708295 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:33.706837 10110 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:33.706525 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:33.708873 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:33.709475 10115 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:33.702662 16071 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.711519 16002 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.717036 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.717932 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 2208) took 1420 ms. Trace:
I20260709 13:18:33.718245 10182 rpcz_store.cc:276] 0709 13:18:32.297620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.299929 (+  2309us) service_pool.cc:224] Handling call
0709 13:18:33.716893 (+1416964us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b5800144c98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:18:33.717864 (+   971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20353280}
W20260709 13:18:33.706569 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.713706 10153 leader_election.cc:400] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:33.724292 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.725327 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:33.726176 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:33.724134 10106 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:33.728674 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.729229 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:33.729606 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.730136 10115 raft_consensus.cc:2368] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:33.730466 10110 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:33.680537 16136 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:33.691401 16192 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.735826 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:33.712689 16135 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:18:33.740850 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:33.737135 10106 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:33.737345 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.738867 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.745587 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.747267 10106 raft_consensus.cc:1240] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:33.747903 10114 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:33.749680 10182 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:33.751678 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:33.752938 10114 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:18:33.716110 16098 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.734860 16189 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.760394 16189 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.762728 16189 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.757404 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:33.735154 16188 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.763899 10153 leader_election.cc:400] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:33.735985 16002 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:33.751636 16191 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.787356 10033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:33.788125 10033 raft_consensus.cc:606] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.753528 16135 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.796895 10710 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
W20260709 13:18:33.798976 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44113.4us
I20260709 13:18:33.766405 15888 consensus_queue.cc:1059] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:33.781263 16113 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.773418 16097 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:33.827207 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2349) took 1410 ms. Trace:
I20260709 13:18:33.776913 16002 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.829816 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.777802 16215 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:33.782924 16098 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:18:33.832052 10107 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:33.831385 10111 rpcz_store.cc:276] 0709 13:18:32.417011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.680445 (+263434us) service_pool.cc:224] Handling call
0709 13:18:32.725139 (+ 44694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.726014 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.802642 (+1076628us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54001bf150. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:33.827131 (+ 24489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102060928}
I20260709 13:18:33.834703 10708 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:33.837069 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:33.775988 16188 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.802081 16198 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:18:33.842448 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.856696 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.859021 16135 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.859828 16223 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:33.860528 16223 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.863051 16223 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.863976 16194 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:33.865051 16002 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.865420 15955 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:33.866087 15955 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.874287 16193 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.875595 16079 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.879349 10180 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:33.880173 10037 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:33.832249 16113 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.871034 16180 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:33.883131 16212 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:33.881546 16197 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:33.923640 16180 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:33.844487 16071 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.835562 16110 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:33.888257 16192 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.925169 16110 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:33.925575 16110 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:33.926638 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:33.926466 16110 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.927232 10710 raft_consensus.cc:606] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.891431 15955 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.927703 16110 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:33.934629 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:33.935204 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.936435 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.937104 16113 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.893596 16175 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:33.904101 15984 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.937565 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.938016 15984 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:33.906365 10712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42392 (request call id 1107) took 1481 ms. Trace:
I20260709 13:18:33.906909 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:33.907305 10038 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:18:33.940496 10712 rpcz_store.cc:276] 0709 13:18:32.425128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.932376 (+507248us) service_pool.cc:224] Handling call
0709 13:18:32.932655 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.092053 (+159398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.906077 (+814024us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54004d0154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:33.906292 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324929792}
W20260709 13:18:33.941439 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.887212 16188 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.927568 10710 raft_consensus.cc:614] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.940084 10037 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:33.942903 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.944783 10710 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:33.945354 10710 raft_consensus.cc:606] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.932204 16172 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:33.942817 15984 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:33.907907 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:33.945700 10710 raft_consensus.cc:614] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.882316 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.947626  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:18:33.947865 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 65642us
I20260709 13:18:33.948665 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:33.949525  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:33.949697 16190 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:33.940227 16193 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:33.950093 16190 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:33.950584 16193 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.950974 16190 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:33.901465 16204 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.024338 16036 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.956708 16151 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:33.968454 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 559202us
I20260709 13:18:34.038372 16151 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:34.018826 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:33.988237 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:34.025146 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.023759 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.022493 16176 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:33.978376 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:34.043258 10108 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:34.043072 16176 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.044028 10184 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:34.038443 16036 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.045353 16176 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.997020 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.975859 16112 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:18:34.046864 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:34.047485 16112 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:33.947924 10185 raft_consensus.cc:3060] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.973970 15963 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:34.037665 16108 consensus_queue.cc:1175] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f672b54d4754c5aa62b5b919597a14e" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:18:34.018302 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:33.990873 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:33.951506 16172 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:33.982148 16067 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.985239 16178 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:33.972738 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.018690 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:34.074681 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.015758 10114 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:18:33.988893 10181 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:33.960292 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:34.075522 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.047987 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:34.018333 10106 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:34.027856 10180 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:33.999177 15927 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:34.058781 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.041270 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.027359 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:33.938668 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:33.980226 10187 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:34.060966 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:33.969084 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.061595 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:33.996686 16131 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:33.978363 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:34.063510 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72736.5us
I20260709 13:18:34.085213 10180 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:34.065642 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.011233 16195 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:18:34.109531 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 136887us
I20260709 13:18:34.111042 10183 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:34.082520 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:33.988111 15699 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:34.045845 16036 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:33.954579 16150 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:34.022013 10040 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:34.064507 16188 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.080384 10181 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:34.047909 16112 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:33.961192 16082 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:34.037516 16190 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:33.959172 15498 raft_consensus.cc:3055] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.110719 15955 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:34.109707 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49470.9us
I20260709 13:18:34.140853 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:34.112687 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.117733 10108 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:33.986621 16137 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:34.110055 16195 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:34.145102 10113 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:34.146530 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:34.144064 16097 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:34.039391 16151 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.147703 16197 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:34.148448 16151 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:34.148766 16197 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.149114 16197 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:34.111106 10679 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.150955 15945 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:34.119845 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.151687 16081 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:34.152228 16034 consensus_queue.cc:1175] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 12 index: 9 } }
I20260709 13:18:34.152866 16081 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.138017 16082 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.154983 16082 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:34.125171 16150 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:34.120428 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.156234 15955 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.157747 16195 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.130475 16205 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:34.162386 16195 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.120754 10114 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:34.130286 16071 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
W20260709 13:18:34.124356 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 57232.4us
I20260709 13:18:34.165323 16071 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:34.165675 16071 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:34.165951 16002 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:34.166478 16071 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.014057 16210 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.167507 16210 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.074105 16178 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:34.167691 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:34.083846 15927 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:34.111964 10188 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:34.144645 16137 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.172379 16071 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.118681 16172 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:34.143643 10715 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:34.136327 16224 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:34.120271 16196 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:34.146680 16215 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.138238 15498 raft_consensus.cc:740] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.127399 16017 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:18:34.111395 15963 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.118010 16136 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:34.118244 15699 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:33.984622 16024 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:34.125664 10185 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:34.182358 15498 consensus_queue.cc:260] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.182713 15963 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.176034 16196 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:34.185528 16210 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.188977 16172 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.198319 15498 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.177615 16205 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:34.194190 16077 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.205073 16077 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.193362 16024 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.193359 15927 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.211259 15927 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.172773 16137 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.199221 15699 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:34.195004 16168 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:18:34.216465 15699 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.216429 16077 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:34.200248 15963 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:34.218544 16137 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.196483 16136 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.220631 16136 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.200752 16210 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.197685 16196 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.224429 16077 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.225051 16077 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.229113 16077 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:34.205869 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54666.9us
I20260709 13:18:34.207360 16175 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:34.207594 16204 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:34.215497 16024 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:34.232770 16235 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:34.231598 16196 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.242893 16196 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:34.112274 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.192180 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 2226) took 1058 ms. Trace:
I20260709 13:18:34.271993 10185 rpcz_store.cc:276] 0709 13:18:33.133248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.133409 (+   161us) service_pool.cc:224] Handling call
0709 13:18:33.133741 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.696737 (+562996us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b540008e920. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45fdc0 00007f3c6f4ea1c0 00007f3c6f4eb231 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c
0709 13:18:33.947330 (+250593us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b540008e920. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45da1d 00007f3c6f4441a4 00007f3c6f4c6447 00007f3c6f4defe7 00007f3c6f4e07de 00007f3c6f4eab49 00007f3c6f4eb416 00007f3c6f4e7d8f 00007f3c6f4e783e 00007f3c744ac419
0709 13:18:34.191880 (+244550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.192117 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101877248}
I20260709 13:18:34.280797 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:34.282573 10708 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
W20260709 13:18:34.273408 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 161074us
I20260709 13:18:34.287818 15963 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.289112 15963 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:34.302768 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 217486us
I20260709 13:18:34.305612 16046 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:34.313417 16067 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:34.314769 16137 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:34.327759 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.328445 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.330377 10111 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 9.
I20260709 13:18:34.235917 16077 consensus_queue.cc:1059] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 13:18:34.335496 15498 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.337431 15498 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.343116 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.344204 10033 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 8.
I20260709 13:18:34.344400 15498 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:34.345319 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:34.348639 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:34.350579 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.294761 15963 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:34.356714 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.347607 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.358433 16112 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.368916 16112 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:34.372619 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 45213.8us
I20260709 13:18:34.374099 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.376268 16034 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:34.376892 16034 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.373831 16178 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.378383 16178 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:34.377421 16034 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.365909 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:34.360297 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.395835 16172 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:18:34.361191 16067 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.361474 15498 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:34.401099 16119 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:34.401685 16119 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:34.402021 15498 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:34.402514 15498 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.376986 16197 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.404753 16197 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.405557 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.364944 16150 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.395701 16108 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:34.413005 16108 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.413434 16108 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.416110 10715 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:34.416615 16172 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:34.417107 16172 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:34.418515 16172 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.390688 15963 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.424479 16067 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.425427 10112 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:34.403625 15498 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.422724 15963 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.429562 16078 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:34.431716 15963 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:34.432905 10034 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:34.438576  9934 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:34.440282 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:34.444643 16119 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:34.444651 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 84512.5us
I20260709 13:18:34.449086 16150 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.416464 16151 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:34.453007 16172 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:34.458082 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.458871 10111 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:34.463913 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.457064 16151 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:34.468272 10715 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:34.472993 10034 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:18:34.480643 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.486625 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.477783 15498 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:34.492197 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.493088 10040 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:34.498332 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.491596 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.496353 16097 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.501567 16240 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:34.510581 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.510963 16088 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:34.512379 16088 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:34.510761 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.502308 16097 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.505811 16067 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.514222 16097 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.507385 10037 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:34.514288 15966 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:34.517410  9934 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 11, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 11 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:34.512720 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.508285 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.519512 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:34.524649 10040 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:34.512794 16088 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.527261 10110 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:18:34.527671 10110 pending_rounds.cc:85] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 12
I20260709 13:18:34.504050 16240 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.492611 16151 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.530172 10110 pending_rounds.cc:107] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:18:34.523335 16067 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.534626 10110 raft_consensus.cc:2889] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:34.536054 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.540812 16119 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.541498 16141 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:34.541703 10188 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:34.542032 16141 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:34.542804 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 57450.6us
I20260709 13:18:34.543721 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:34.542732 16141 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.544747 16082 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:34.545172 16082 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.545564 16082 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.551932 15927 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:34.559998 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.540659 16151 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.555560 10113 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:34.524330  9934 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 13, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 13 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.567231 16077 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:34.572136 16088 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.573931 16088 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:34.574393 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.575965 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.578711  9934 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:34.580317  9934 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 10, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 10 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:34.581203 16196 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.581483 16137 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:34.583932 16136 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:34.585500 16136 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:34.586652 16046 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:34.587081 16046 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.587888 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:34.588037 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 75452.3us
I20260709 13:18:34.588747 16044 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:34.589257 16044 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:34.590431 16044 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:34.591868 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.592880 16137 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:34.593194  9934 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 11 to 15, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 15 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:34.596632 10188 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:34.588234 16046 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.598702 16046 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.589054 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.604771 16044 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.605255 16137 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:18:34.608176 16243 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:18:34.607992 16137 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.609887 10109 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:34.609159 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:34.612061 16137 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:34.613831 10182 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:34.616720  9934 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:34.632261 16240 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:34.617707 16241 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.619830 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:34.621074 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:34.635773 16241 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.621201 16167 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:34.622566 10183 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:34.638751 16241 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:34.577744 16097 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.624359 10109 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:34.623296 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:34.624955 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.624812 10112 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:34.641170 10182 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:34.625197 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.645172 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.647785 10708 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:34.648483 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.650005 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.650930 16110 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:34.651185 16044 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:34.651832 16110 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:34.653993 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 65107.2us
I20260709 13:18:34.657091 10035 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:34.657383 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:34.658252 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:34.651697 16097 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:34.660368 16191 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:34.661924 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.662542 10032 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:34.665661 15963 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:34.660429 10034 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:34.666757 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:34.666090 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:34.667449 10039 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:34.667939 15927 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:34.670257 15927 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:34.674646 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:34.675246 10708 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.675896 16108 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.678668 16108 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:34.681156 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:34.681833 10710 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.684783 10708 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:34.685391 16088 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:34.686363 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.687698 16136 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:34.629848 16034 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.702896 16167 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:34.705181 16034 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:34.706984 16067 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:34.708024 16067 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:34.696436 10037 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:34.697207 10039 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:34.697953 10710 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
I20260709 13:18:34.712126 10182 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:34.651468 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.720363 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:34.744606 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.745231 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:34.745973 10037 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.756592 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.758252 10079 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.753901 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.762671 10109 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:34.768447 16191 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:34.770120 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:34.770303 16205 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:34.770928 16205 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:34.751395 16172 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:34.772092 16205 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.775233 16190 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:34.775885 16190 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:34.777016 16077 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:34.783823 10114 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:34.651676 16044 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:34.749529 16088 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:18:34.800022 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 148657us
I20260709 13:18:34.764407 16108 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.783286 15927 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:34.812882 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:34.815303 10106 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.792222 16044 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.827219 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:34.820844 16197 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:34.842693 16197 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.845184 16197 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:34.817149 16137 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:34.849864 16082 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.797798 16141 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.776988 16190 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:34.896888 10037 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:18:34.905076 10715 raft_consensus.cc:2393] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:34.860558 16108 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:34.924250 16044 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:34.926920 16245 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.056s	user 0.000s	sys 0.006s
W20260709 13:18:34.927386 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 75114.7us
I20260709 13:18:34.938930 10106 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:18:34.950795 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:34.941505 16110 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.978349 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:34.987231 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.997720 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.000238 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 178114us
I20260709 13:18:35.005043 15699 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:35.005663 15699 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:35.006714 15699 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.010043 15927 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.010596 15927 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:35.014919  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:35.078078 16108 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.090145 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:35.105219 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 121640us
I20260709 13:18:35.077860 16178 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:18:35.083345 16044 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.157825 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.162042 16241 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:35.164741 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 85952us
I20260709 13:18:35.166896 10040 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:35.158196 16205 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.162506 16257 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:35.161962 16098 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:35.160933 16082 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.183117 16205 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.172403 10037 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
W20260709 13:18:35.203245 16251 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:35.175064 16178 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:18:35.169092 16241 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.204908 16178 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:35.205330 16178 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:35.206426 16241 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.213020 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:35.213696 10711 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:35.213223 10710 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23. Ops: []
W20260709 13:18:35.224974 16248 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.255s	user 0.003s	sys 0.000s
I20260709 13:18:35.206350 16178 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.281422 10711 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:35.283910 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:35.284601 10715 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:35.282588 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:35.282650 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 108565us
I20260709 13:18:35.287873 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.289217 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:35.304167 16071 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.304790 16071 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.305154 10111 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:35.299996 16044 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:35.223523 15927 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.311568 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:35.312175 10106 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:35.300437 16136 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.311801 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.312896 15927 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.306571 16044 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:35.319360 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:35.321177 16205 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.324790 16178 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.335309 10106 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:35.336838 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.310672 16197 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:35.341326 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:35.313485 16110 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:35.336095 16071 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.348721 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.353801 15498 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:35.354506 15498 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.353948 16071 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:35.356199 16071 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:35.356666 15498 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.357103 16071 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:35.357721 16271 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:35.358196 16271 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:35.358557 16271 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.340975 16197 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:35.359987 16197 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.363901 16110 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.366067 16110 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.342568 16172 consensus_queue.cc:1059] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:18:35.366698 16044 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.342841 16240 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:35.367633 16172 raft_consensus.cc:3055] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:35.382340 16240 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.382718 16172 raft_consensus.cc:740] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:35.382875 16240 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.383680 16172 consensus_queue.cc:260] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.384953 16172 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:35.390076 16141 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.382385 16088 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:35.393306 16088 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.395325 10109 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:35.397409 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:35.401103 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:35.402406 10184 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.401798 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.403709 10188 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:35.405738 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:35.407482 16046 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:35.407882 16046 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:35.408228 16046 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.409047 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:35.409754 10185 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:35.457371 10109 raft_consensus.cc:1240] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:35.459362 10111 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
W20260709 13:18:35.462819 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 287422us
I20260709 13:18:35.469523 16274 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:35.471521 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.472424 10115 raft_consensus.cc:2393] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 22: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:35.472049 16274 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.474735 16274 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.475231 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:35.475449 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.484611 10111 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:35.492039 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 157769us
I20260709 13:18:35.493013 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.486804 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:35.499820 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:35.500496 10038 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:35.492161 15927 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.514041 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.514719 10031 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:35.512012 16082 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:35.496403 16088 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:35.518798 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 177568us
I20260709 13:18:35.523921 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.503159 16150 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.527926 16082 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:35.533753 15927 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.534663 16082 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.528759 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.549330 16188 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:18:35.551153 16235 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:35.552168 16241 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:35.551882 16150 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.552927 16262 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:35.553365 16262 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.553697 16262 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.551899 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.554231 16150 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:35.557655 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70945.4us
I20260709 13:18:35.563158 10038 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:35.572752 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.573689 10038 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:35.568531 16190 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:35.584169 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.576881 16136 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.602453 10188 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 13: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:35.627435 16282 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:35.569598 16046 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.650404 16239 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.636289 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.558894 16235 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:35.656919 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 176833us
I20260709 13:18:35.630468 16119 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.650537 16281 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:35.670286 16264 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:35.671034 16264 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.672394 16097 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:35.673002 16097 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.673301 16264 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.673873 16264 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.674387 16264 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.675078 16097 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.653110 16241 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:35.678798 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:35.678128 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 190711us
I20260709 13:18:35.626003 16197 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.662031 15963 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.698067 15963 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.699397 16197 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.700031 16197 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.700508 16197 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.684851 16046 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.687899 16178 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:35.702476 16197 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.688736 16240 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.703101 15963 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.704212 16240 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.701681 10040 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:35.705312 10187 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:35.689647 10182 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:35.693104 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.676322 16119 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.679666 16239 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.710772 10181 raft_consensus.cc:2410] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:18:35.711001 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:35.711248 16119 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.695329 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.696276 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:35.709959 10114 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:35.712628 10711 raft_consensus.cc:2368] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:35.713263 16241 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.715070 10184 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:35.715929 10185 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:35.716076 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.716657 10109 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:18:35.697296 16097 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.653780 16190 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.702225 16178 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.668542 16282 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.708020 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.724128 10106 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:35.708725 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.706017 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:35.720919 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.706822 10180 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:35.683349 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.728331 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.667721 16281 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:35.728688 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:35.726766 10109 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:35.728165 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.730239 16191 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:35.731189 10115 raft_consensus.cc:2368] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:35.733449 10189 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:35.732143 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:35.734236 10182 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.729094 16119 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:18:35.735128 10186 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:35.733352 16191 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.735968 16178 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.736431 16190 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.736562 16191 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.737108 16141 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:35.737521 16141 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:35.737874 16141 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:35.738135 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85501.5us
I20260709 13:18:35.739171 16282 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.737126 15927 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.712247 16239 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:35.741896 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:35.743091 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.743611 10187 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 13.
I20260709 13:18:35.744709 16281 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.745484 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.746253 10186 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:35.745923 16281 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.747037 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.743499 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.748389 10183 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:35.749243 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:35.749725 10183 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:35.753082 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:35.704494 16235 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.753872 10115 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:35.753978 10153 leader_election.cc:400] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:35.754454 10153 leader_election.cc:403] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.756623 16264 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.756779 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:35.757807 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.758498 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.760330 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.731778 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:35.761305 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:35.762084 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:35.763082 10153 leader_election.cc:400] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:35.763363 10153 leader_election.cc:403] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.744539 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.758577 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:35.747637 10186 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:35.758112 16235 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:35.774688 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.694871 16271 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.775543 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.776191 16034 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:35.774623 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:35.776206 10033 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:35.777470 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.777117 10715 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:35.775101 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:35.778842 10038 raft_consensus.cc:2368] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:35.779454 10039 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:35.778178 10031 raft_consensus.cc:2368] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:35.777621 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:35.776611 16034 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.781893 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:35.783910 10187 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:35.777263 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.761981 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:35.803802 10188 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:18:35.807921 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.808337 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:35.779971 16205 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:35.809253 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:35.811470 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.812181 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:35.812834 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.790017 16197 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:35.776995 16271 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.799605 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.793088 16264 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:35.796164 16034 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:35.850701 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 73294us
I20260709 13:18:35.842840 10183 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
W20260709 13:18:35.837340 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 157997us
I20260709 13:18:35.800223 16235 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:35.856925 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.807458 15927 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:35.769788 16097 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.781864 16262 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.818758 16108 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.828399 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.823611 16241 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:35.822476 16197 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.884315 10106 raft_consensus.cc:2393] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 13: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:35.818583 16278 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:35.828037 16205 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:35.877110 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.877475 10115 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.878209 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:35.827584 16264 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.859277 16293 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.857069 16188 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.889667 10184 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:35.859695 15966 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:35.827114 16141 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.893087 10111 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:35.895474 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.862392 15927 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.895078 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.899271 10036 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:35.896728 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.884295 16241 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.902052 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.917394 10185 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 13:18:35.917762 10185 pending_rounds.cc:85] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 16
I20260709 13:18:35.918200 10185 pending_rounds.cc:107] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 13:18:35.917599 10188 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:18:35.918628 10185 raft_consensus.cc:2889] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.890434 16197 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.916450 16272 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:35.924404 10186 raft_consensus.cc:2393] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:35.927130 10035 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:35.898411 16264 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.917052 15927 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:35.923965 16172 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:35.923180 16241 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.947304 10711 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:35.922840 10183 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:35.949277 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.950047 15498 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:35.950280 16131 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:35.950611 15498 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:35.951550 15498 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.953080 16097 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:35.951574 16262 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.957825 10715 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:35.977610 16191 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.977492 10182 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:35.979533 16239 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:18:35.979863 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:35.980295 16172 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.980726 16281 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:35.935385 16287 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:35.981319 16281 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:35.982308 16281 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.981433 16287 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.984923 16287 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:35.986068 10034 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:35.987316 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:35.987668 10181 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:35.897423 16278 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:35.921200 15966 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.901495 16188 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.935855 16263 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:18:35.937824 16235 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:35.939710 10108 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:36.041661 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:35.901693 16293 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.960244 16205 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.051249 10038 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 12.
I20260709 13:18:35.883515 16150 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:35.925205 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:35.980794 16172 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:35.997483 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.055325 10153 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:35.988031 10109 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
W20260709 13:18:36.031131 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150277us
I20260709 13:18:36.055549 10031 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.994405 15927 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.059477 10033 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:36.056982 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:36.063143 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 138002us
I20260709 13:18:36.027362 16278 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:36.054059 10115 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:36.069295 10155 leader_election.cc:400] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:18:36.072736 10155 leader_election.cc:400] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:36.073076 10155 leader_election.cc:403] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.079618 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:36.081939 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:36.059173 16067 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.082880 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.099431 10040 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:36.036652 16034 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.069074 16271 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:36.107059 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.106101 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.108136 10109 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:36.109040 10182 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 14: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:18:36.101611 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59780.7us
I20260709 13:18:36.072014 16262 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.115108 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.122067 10040 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.095309 16279 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:36.095230 15963 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:36.096619 16197 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.127846 16191 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.128472 16108 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:36.129920 15498 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:36.103336 16240 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:36.149423 16240 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:36.081939 16141 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.105460 16071 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:36.107877 16190 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:36.104475 16293 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.114395 16271 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:36.126760 16262 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:36.164762 15963 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.130028 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:36.198830 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68875us
W20260709 13:18:36.200932 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69867.4us
I20260709 13:18:36.199609 10004 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.206212 10115 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
W20260709 13:18:36.197554 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 140642us
I20260709 13:18:36.193639 16271 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:36.209261 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.104744 16067 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.212785 16303 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.213856 10715 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:36.214816 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.215543 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.227886 10714 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:36.216848 10708 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:36.190173 16190 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:36.263516 16190 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.209079 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:36.266856 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 57906.5us
I20260709 13:18:36.267544 10111 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:36.267787 16291 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:36.268402 16291 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:36.231370 16188 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.235460 10040 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:36.236434 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.280833 10715 raft_consensus.cc:2393] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:36.237640 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.281718 10714 raft_consensus.cc:2410] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:36.238638 16302 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:36.240854 16197 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:36.250001 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.254488 16262 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:36.256326 15927 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.257095 16309 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:36.259068 15963 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:36.259960 15966 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:36.261370 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 272036us
I20260709 13:18:36.261932 16287 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:36.301952 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.302525 16287 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.304035 16262 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:36.304662 16262 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.305042 16287 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.230916 16172 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:36.306833 16262 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.307650 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.273317 10031 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:36.209362 16293 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:36.308462 16293 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:36.308881 16293 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.277886 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:36.312258 16298 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:18:36.210562 16046 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:36.282425 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.312945 16046 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.313362 16046 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:36.313449 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:36.314175 16108 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:36.314682 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.316098 16310 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:36.316474 16310 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:36.294222 16309 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:36.316854 16310 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:36.317632 16309 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.319034 16309 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.282873 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:36.283159 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.308270 10106 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:36.283304 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 65179.2us
I20260709 13:18:36.261515 16034 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.302668 10112 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:36.285363 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.325834 10187 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.288601 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.327989 10108 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.289691 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:36.330461 10038 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:36.334288 10182 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:36.334527 16172 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:36.335158 16172 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.289348 16044 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:18:36.269356 16291 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.350342 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.351223 10111 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:36.323793 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.329640 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:36.370872 10034 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:36.319941 16191 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:36.186563 16241 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.321393 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:36.377977 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 56682.5us
I20260709 13:18:36.279358 16264 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.336684 10106 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:36.320434 10039 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:36.314603 16108 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.393371 16108 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:36.394091 16172 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:36.394737 16311 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:36.395257 16311 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:36.347883 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.395665 16311 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.396085 10181 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:36.344702 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:36.398707 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54074.2us
I20260709 13:18:36.399712 15927 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:36.374773 10187 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
W20260709 13:18:36.375257 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 120872us
I20260709 13:18:36.400511 16071 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:36.401024 16071 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.401361 16071 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.402788 16314 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:36.375530 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51851us
I20260709 13:18:36.403549 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.408349 10712 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:36.410192 16264 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:36.411027 10189 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 22: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:36.412829 16241 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:36.384737 15963 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:36.413779 15963 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.414116 15963 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.379971 15966 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:36.416344 15966 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:36.417362 15966 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.385586 16191 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:36.420763 16191 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.404488 10679 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:36.405633 16313 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.375409 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.404170 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.423951 10180 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
W20260709 13:18:36.425380 16308 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:18:36.423862 16313 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.423188 16071 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.428464 16313 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:36.390146 16119 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.429256 16119 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.430105 16190 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.429642 16071 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:36.436928 16067 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.279139 16303 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.444746 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.447129 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:36.447894 10032 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:36.450011 10034 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:36.452277 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:36.453567 10108 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:36.457808 16305 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:18:36.442656 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.470017 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.470717 10186 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:36.470067 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.423421 16077 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:36.485801 16077 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:36.486107 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:36.486755 16131 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:36.488199 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:36.488368 16188 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:36.488803 16188 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:36.490579 10710 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:36.488207 16131 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.490327 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.494175 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.494335 10034 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.492170 16172 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:36.500481 16262 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:36.500921 16303 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.501093 16262 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.502197 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.502818 10187 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:36.503438 16262 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.428040 16046 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.504392 10679 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:36.488536 16271 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.506583 16271 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:36.492363 16305 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:36.508127 16305 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.508533 16305 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.508777 16190 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:36.510355 16310 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.511806 16044 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:36.512296 16044 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.512677 16044 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:36.505048 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150138us
I20260709 13:18:36.493876 16205 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.516153 16205 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:36.516505 16205 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.517120 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:36.511997 10180 raft_consensus.cc:2368] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:18:36.508026 16119 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.533874 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.535341 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.536162 10186 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:36.539023 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.539100 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.539644 10186 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.539840 10181 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.540621 10033 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:36.519519 16131 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.542982 10003 leader_election.cc:400] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:18:36.543393 16302 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:36.486898 16077 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:36.543833 16302 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.543977 16131 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.544239 16302 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.530390 16263 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:18:36.545997 16188 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.543327 10003 leader_election.cc:403] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.540926 10679 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:36.527544 16262 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:36.552285 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 56162us
I20260709 13:18:36.555881 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.525384 15927 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:18:36.566854 10112 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:18:36.565217 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.567974 10188 raft_consensus.cc:2368] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:36.561738 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.548938 16188 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.575165 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.576238 10112 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:36.577870 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.578596 10111 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:36.579784 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.580426 10187 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.580104 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.581449 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:36.581732 10183 raft_consensus.cc:2368] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:36.555155 16262 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:36.578212 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.563412 16137 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.589522 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.595083 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.599331 16310 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:36.602773 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 221289us
I20260709 13:18:36.615161 10189 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:36.619318 10181 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:36.620430 10034 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:36.580381 16303 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.623514 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.636648 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:36.626880 10111 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.641778 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.590260 16262 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.657327 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:36.668453 10035 raft_consensus.cc:2368] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:36.669317 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.624863 16287 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16.
I20260709 13:18:36.629051 16303 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.701444 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.705119 10111 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:36.706223 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:36.713826 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.714457 10111 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.718082 16293 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.720330 16293 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.643978 16137 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.722294 10038 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:36.723654 10187 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
I20260709 13:18:36.687352 16303 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.726725 10186 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:36.737488 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.738396 10183 raft_consensus.cc:2368] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 21. Current term is 22.
I20260709 13:18:36.720573 16311 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.740824 10034 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:36.742334 10186 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:36.747288 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 103796us
I20260709 13:18:36.747499 16312 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.748157 16312 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.750458 16312 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.755638 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:36.756486 10189 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 12: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:36.762051 10078 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:36.745079 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 179134us
I20260709 13:18:36.768062 10115 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:36.768448 10078 leader_election.cc:400] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:36.708035 16044 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.776928 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:36.777865 10183 raft_consensus.cc:2410] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:18:36.774984 10038 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:18:36.780027 10078 leader_election.cc:400] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:36.780413 10078 leader_election.cc:403] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.774998 10111 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:36.781599 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.764618 16312 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:36.798029 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:36.799786 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:36.805451 10003 leader_election.cc:400] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 21. Current term is 22.
I20260709 13:18:36.805796 10003 leader_election.cc:403] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.810652 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:36.813565 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:36.795523 16191 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:36.830127 15963 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:36.832530 16325 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:36.834679 16046 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:36.835342 16305 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:36.841069 16108 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.842469 16188 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:36.848421 16322 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:36.849785 16328 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 21. Current term is 22.
W20260709 13:18:36.855237 16321 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:18:36.856989 16330 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:36.858902 10111 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:36.860303 10185 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:36.862762 10712 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.811180 16282 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:36.872947 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62345.3us
W20260709 13:18:36.876106 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 249831us
W20260709 13:18:36.897303 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 90827.3us
I20260709 13:18:36.910256 10107 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:36.910560 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:36.878994 16097 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:36.871765 16312 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:36.912499 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:36.912204 10106 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:37.026501 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 112307us
I20260709 13:18:37.053092 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.053861 10185 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:37.074028 10185 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:37.075402 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:36.909004 16282 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:37.029390 16274 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:18:37.062862 16333 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:18:36.888932 16131 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.205236 16304 log.cc:927] Time spent T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:18:37.206015 16337 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.206599 16337 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.208693 16082 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:37.209246 16082 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:37.210084 16082 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.211424 16302 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 13:18:37.214562 15963 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:37.216567 16205 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
I20260709 13:18:36.906520 16188 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.231155 16188 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:37.231818 16188 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:37.232277 16188 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.233961 16298 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:37.120204 16282 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.218510 15927 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:37.239070 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2413) took 1034 ms. Trace:
I20260709 13:18:37.239547 10109 rpcz_store.cc:276] 0709 13:18:36.204338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.204518 (+   180us) service_pool.cc:224] Handling call
0709 13:18:36.204934 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.278159 (+ 73225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.278192 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.320657 (+ 42465us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.532822 (+212165us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:36.532868 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.532937 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.238813 (+705876us) raft_consensus.cc:1685] finished
0709 13:18:37.238841 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.239002 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15397,"raft.queue_time_us":52279,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3219,"thread_start_us":137285,"threads_started":1,"wal-append.queue_time_us":289611}
W20260709 13:18:37.243417 16278 consensus_meta.cc:287] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 1.148s	user 0.011s	sys 0.000s
I20260709 13:18:37.063259 16312 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.248534 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:37.215510 16274 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:37.257109 10712 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:37.220420 16305 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:37.304466 10708 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:18:37.279904 16331 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.390s	user 0.001s	sys 0.001s
I20260709 13:18:37.252189 15927 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:37.278203 16271 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:37.301965 16141 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.007s	sys 0.087s
W20260709 13:18:37.310330 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 397888us
I20260709 13:18:37.296904 16150 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:37.307421 15966 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:37.257973 16278 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.313936 16141 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.007s	sys 0.088s
I20260709 13:18:37.254305 16205 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.252224 16302 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.312297 15927 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.316720 16172 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:37.328902 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:37.329613 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:37.333927 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:37.334929 10189 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:37.317279 16271 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:37.336782 10037 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.343372 10110 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:37.335959 16342 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:18:37.348425 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:37.330418 16302 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.353142 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.355010 10182 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:37.355343 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.356048 10187 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:37.357781 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71281.8us
I20260709 13:18:37.358999 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:37.364396 10037 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
W20260709 13:18:37.374992  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet f5f53253de3345159399b6816804e1e6: Illegal state: Replica 9a67604b91f54791b1316fd327793337 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:18:37.377657 16353 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:18:37.378295 16262 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 13:18:37.378763 16262 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.379906 10114 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:37.328980 16172 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.383805 16172 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:37.331404 15966 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.323856 16150 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.391245 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:37.392375 10189 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
W20260709 13:18:37.395124 16303 consensus_meta.cc:287] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:18:37.396185 16271 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.401741 16287 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:37.402231 16287 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.402550 16287 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:37.404006 16278 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.355923 16274 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.412448 16312 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.422574 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.424086 10181 raft_consensus.cc:2368] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:18:37.426800 10003 leader_election.cc:400] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:18:37.431806 10003 leader_election.cc:403] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.432044 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:37.430966 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:37.427357 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.430162 10187 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:37.425432 10182 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:37.437047 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:37.439298 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:37.440513 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.441183 10181 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:37.441533 10038 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:37.461246 10035 raft_consensus.cc:2368] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:37.461647 10182 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:37.463187 10182 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:37.479987 10180 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:37.480615 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:37.482798 10110 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:37.483541 16293 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:37.484225 16293 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:37.485261 16293 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.489846 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:37.491089 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:37.493266  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet d1e1f2cc55034d12aba959a49530a6f8: Illegal state: Replica 9a67604b91f54791b1316fd327793337 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:37.495630 16364 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:37.498566 16364 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.508208 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:37.460882 16172 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.461345 16082 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:18:37.525197 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.515496 10181 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:37.487625 16355 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.493522 16328 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:37.493459 16351 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:37.369887 16282 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.511510 16359 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:37.548995 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 59248.7us
I20260709 13:18:37.502540 16274 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:37.461127 16303 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.552661 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:37.524554 15927 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:18:37.553575 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50226.2us
I20260709 13:18:37.555915 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:37.531725 16172 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.557273 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62562.9us
I20260709 13:18:37.547675 16328 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:37.560840 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:37.555480 16359 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:37.547439 16310 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:18:37.555723 16357 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:37.566709 10188 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:37.540280 16355 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.572741 16363 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:18:37.573205 16262 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:37.561252 16271 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:37.546679 16351 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:36.645540  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.579955  9931 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 19 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:37.581892 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:37.623055 10711 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:37.583256 16137 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.586036 16337 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.587220 16359 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.590581 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:37.591490 16355 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.562750 16364 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:37.718997 16240 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.592064 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:37.566054 16358 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:37.596760 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:37.597903 10113 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:37.598281 16365 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:37.598523 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:37.601022 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:37.601326 16295 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:18:37.605708 16282 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.606478 10187 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:37.606130 16287 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.607043 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.833506 10183 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:37.609318 16303 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:37.611501 16320 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.107s	user 0.006s	sys 0.000s
I20260709 13:18:37.613508 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:37.838274 10036 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.615964 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:37.616935 15966 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.618012 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:37.722987 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:37.869122 10110 raft_consensus.cc:2410] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:18:37.744769 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 123343us
W20260709 13:18:37.745333 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 126050us
I20260709 13:18:37.821727 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:37.824685 16311 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.825547 10109 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:37.830215 10181 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:37.830284 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:37.882894 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3444) took 1203 ms. Trace:
I20260709 13:18:37.831166 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:37.829710 10112 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:37.883267 10108 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:37.832639 10037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 2780) took 1545 ms (client timeout 1949 ms). Trace:
I20260709 13:18:37.835246 16330 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:37.836406 16328 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.883386 10106 rpcz_store.cc:276] 0709 13:18:36.668779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.669036 (+   257us) service_pool.cc:224] Handling call
0709 13:18:37.871964 (+1202928us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540026cfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:37.872083 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556384640}
I20260709 13:18:37.837344 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:37.870627 10186 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:18:37.889668 10037 rpcz_store.cc:269] 0709 13:18:36.282771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.282925 (+   154us) service_pool.cc:224] Handling call
0709 13:18:37.828221 (+1545296us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001577d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:37.828326 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336312576}
I20260709 13:18:37.890838 10079 leader_election.cc:400] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:37.895917 10079 leader_election.cc:403] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:18:37.889715 10115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2414) took 1634 ms (client timeout 1904 ms). Trace:
I20260709 13:18:37.828766 16137 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.899345 10115 rpcz_store.cc:269] 0709 13:18:36.231759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.249697 (+ 17938us) service_pool.cc:224] Handling call
0709 13:18:37.865859 (+1616162us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54000b5254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:37.866000 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101345024}
I20260709 13:18:37.917215 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:37.918711 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47123.1us
I20260709 13:18:37.881479 16364 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:37.831501 16240 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.890836 16067 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:37.921255 15963 raft_consensus.cc:3060] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.937918 16357 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:37.938295 16347 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:37.926553 10108 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:37.963578 10186 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:37.972368 10183 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:37.936944 16108 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.939010 16311 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:37.977617 16311 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.964715 16347 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.912652 16137 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.920481 16271 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:37.985956 10036 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:37.936594 16044 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:37.953296 16357 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:18:37.985041 16369 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:37.900640 16330 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:37.985531 16323 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.998s	user 0.007s	sys 0.027s
I20260709 13:18:37.958493 16278 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:37.979733 16311 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.018189 10003 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.019652 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:37.967041 16067 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:37.984920 16271 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:37.958827 16364 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.059388 10081 leader_election.cc:400] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:38.060933 10081 leader_election.cc:403] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.060109 10679 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.035883 16044 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:38.077260 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 56416.7us
I20260709 13:18:38.013881 16278 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.052865 16264 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:38.088785 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:38.062939 16293 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:38.096553 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 3215) took 1646 ms. Trace:
I20260709 13:18:38.080262 16044 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.084167 16078 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:38.099155 10031 rpcz_store.cc:276] 0709 13:18:36.444651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.444786 (+   135us) service_pool.cc:224] Handling call
0709 13:18:36.455218 (+ 10432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.455584 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.455613 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.456153 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.549533 (+ 93380us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:36.549580 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.549656 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.614843 (+1065187us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:38.085063 (+470220us) raft_consensus.cc:1685] finished
0709 13:18:38.085086 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.090862 (+  5776us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":14687104,"thread_start_us":92978,"threads_started":1,"wal-append.queue_time_us":249096}
I20260709 13:18:38.093194 16196 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.111320 16205 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.105477 16044 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.119858 16078 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:38.103483 16287 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.098640 16293 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.058339 16357 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:18:38.129246 16373 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:18:38.104048 16351 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.132201 16240 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:38.112528 10081 leader_election.cc:400] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:38.128377 16293 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.135627 10081 leader_election.cc:403] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.115955 16329 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.115871 16335 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 13:18:38.142396 16372 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:38.142567 16078 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.144057 16329 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.139479 10109 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 13.
I20260709 13:18:38.141093 10682 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.108304 16108 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:38.149371 16067 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.152108 16367 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 12. Current term is 13.
I20260709 13:18:38.152908 16312 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:38.153537 16312 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.156951 10188 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:18:38.157608 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45241.6us
I20260709 13:18:38.101505 16264 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.164996 15699 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:38.134286 16196 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.169075 16335 raft_consensus.cc:2804] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:38.167997 16364 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.178794 16188 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.196172 16350 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:38.215266 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 305692us
I20260709 13:18:38.190537 16330 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.216835 16131 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.215673 16364 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.227453 16364 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.191694 16335 raft_consensus.cc:697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:38.229650 16364 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:38.235353 16355 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:38.236663 16347 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.238509 16346 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.238752 16188 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.239676 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:38.240736 10040 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:38.243633 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:38.243855 10035 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:38.270256 10036 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 22: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:38.283511 10078 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:38.244035 16350 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:38.244618 15963 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:38.245210 16264 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:38.245968  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 2db964eeed76452cb3a8a969e5e2b32a: Illegal state: Replica f145536c6dbe456fb8565950244bc2a5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:38.246254 16196 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:38.248368 16384 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:38.229732 16278 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.296743 16368 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.249662 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.251624 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:38.229133 16335 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.252060 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.267910 16167 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:38.248013 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:38.289069 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.293030 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:38.321018 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 73302.4us
I20260709 13:18:38.299358 16150 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.288657 16188 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.304266 16383 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.300235 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.326257 10036 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:38.294771 15699 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.298588 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.296448 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.329814 10184 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.308777 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.330621 10182 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:38.330214 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.248728 16357 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.314304 10039 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:38.257607 16329 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.269145 16376 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.316077 10032 raft_consensus.cc:2368] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:38.316237 16282 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:38.312623 16264 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.317281 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.317569 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.290521 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:38.360898 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70459.9us
I20260709 13:18:38.264809 16271 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.294548 16191 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:38.333424 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.336074 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.335405 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.333101 16383 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.338706 16108 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:38.338910 10108 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:38.411451 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:38.339210 16329 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.340137 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:38.412832 10036 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:38.413080 10715 raft_consensus.cc:2368] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:38.336098 15699 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.342011 16188 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.351389 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.428620 10115 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:38.315368 16044 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:38.405464 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59741.6us
I20260709 13:18:38.436802 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:38.437489 10110 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.407162 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.407573 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:38.409998 10112 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:38.320261 16167 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:38.411109 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.441365 10181 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:38.290537 16346 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.431998 10184 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:38.433642 10111 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:38.442864 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:38.447477 10040 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:38.354885 16046 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.445983 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.450377 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.455610 10183 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:38.455979 10184 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 22: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:38.427412 16271 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.457890 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.411537 16150 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:38.461726 10186 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:38.428556 16172 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:38.325439 16368 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.466182 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:38.438570 15498 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.473666 10110 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:38.419646 15966 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.476868 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.493901 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.438287 16295 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.436338 16335 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.495699 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.496016 10183 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:38.477488 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.430615 16191 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:38.498696 10040 raft_consensus.cc:2410] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:18:38.498799 10715 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:38.499538 10106 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:38.488649 10184 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:38.492666 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.468765 16150 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:38.510646 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47537.5us
I20260709 13:18:38.519420 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.511575 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.515156 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.406406 16376 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.463160 16088 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.533231 10036 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:38.430387 16108 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.495088 16278 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.421844 16264 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.521580 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:18:38.548029 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.438827 16329 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.533964 10032 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:38.565062 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:38.568805 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47308.1us
I20260709 13:18:38.573994 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:38.576193 16389 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:18:38.548871 16150 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:38.580905 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 102151us
I20260709 13:18:38.524437 15963 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:38.521512 16336 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:38.467873 10711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133523a809584dd5b44a19acf589801d"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:38.587671 10711 raft_consensus.cc:606] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:38.587826 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:38.519637 15966 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.520491 16335 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.596025 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:38.598856 16310 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:38.598804 16077 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:38.599411 16310 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.599831 16310 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.603364 16376 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:38.604357 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.603314 16312 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.497785 15498 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.524819 16295 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.606001 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.607000 15498 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.589018 10711 raft_consensus.cc:614] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.609619 10716 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:38.610499 16310 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.613888 15966 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.614147 16172 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:38.614801 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63888.4us
I20260709 13:18:38.615254 10081 leader_election.cc:400] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:38.616180 10081 leader_election.cc:400] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:38.597397 16335 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.616792 16310 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.589015 16293 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.549386 16167 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.619195 16293 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.615500 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.573891 16330 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:38.620476 16330 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.620852 16330 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:38.619913 10031 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:38.623224 16108 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.594219 16263 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.619089 10109 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:38.619103 16167 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:38.630137 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.630515 16354 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:38.616477 10081 leader_election.cc:403] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.590667 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.631768 16354 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:38.631975 10184 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:38.632985 16367 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19.
I20260709 13:18:38.632699 16354 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.634451 16329 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.635380 16044 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.636175 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:38.637022 16367 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.633222 16191 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.638818 16367 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:38.640875 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.630230 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.646402 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.647575 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.556085 16088 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.624312 15699 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.636647 16346 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.651566 16368 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.652099 16264 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:38.655437 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:38.662410 16271 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.642858 16383 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.664335 10039 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:18:38.664708 10039 pending_rounds.cc:85] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 10
I20260709 13:18:38.664912 10039 pending_rounds.cc:107] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 14.11
W20260709 13:18:38.657114 16392 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:18:38.665046 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.665267 10039 raft_consensus.cc:2889] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.660506 16346 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:38.737021 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.738229 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.739389 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.665040 15498 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.740271 10185 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:38.742264 10186 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:38.732343 16346 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:38.764410 16394 log.cc:927] Time spent T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:18:38.722180 16278 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:38.794580 10113 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:38.785760 16347 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.800760 16347 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.803057 16347 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.769668 16381 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.805109 16381 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.807367 16381 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.819180 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.819841 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.820160 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.820626 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.821631 10181 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:38.830379 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.830719 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.770475 16282 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:38.770233 16367 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:38.778963 16346 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.820556 10155 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:38.841596 10155 leader_election.cc:403] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.783617 16328 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.856577 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:38.858035 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:38.858476 10188 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.793663 16150 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.863221 10155 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:38.867890 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.854525 16264 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15.
I20260709 13:18:38.842599 16388 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:18:38.870302 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.846787 16367 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.874874 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:38.869928 16380 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.865991 16172 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:38.888396 16172 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:38.888592 16295 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.889424 16172 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.890389 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.879473 16293 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.892418 16293 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.856055 16282 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.899950 16150 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.900825 16282 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.884141 16088 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.884809 16271 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.897815 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.893597 16264 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:38.902138 16264 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.902495 16264 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.898270 16293 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.909765 16355 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.910211 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:38.910279 16355 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.913190 16137 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.915191 16205 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:38.915771 16205 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.917510 16368 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:38.917892 16205 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.918053 16368 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.919317 16205 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:38.924135 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.924906 10115 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:38.925470 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.927059 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.927266 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:38.927901 10037 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.928256 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:38.928773 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.857854 16328 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.929629 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.944904 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.893855 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:38.931988 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.933243 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:38.933841 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
W20260709 13:18:38.937609 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.942504 10107 raft_consensus.cc:2393] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:38.943010 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.948769 10033 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
W20260709 13:18:38.956545 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62808.7us
I20260709 13:18:38.961145 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.962766 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.912673 16355 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:38.964183 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.976052 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.963429 10033 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:38.915442 15966 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.969954 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:38.981019 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:38.980480 10035 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:38.975383 16376 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:38.981227 10113 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:38.987175 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.984349 10034 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:38.988955 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.989588 10033 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:38.990453 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.991703 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.987560 10113 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:38.993156 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.993335 10040 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:38.980378 10037 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:38.983049 10078 leader_election.cc:400] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 16. Current term is 17.
I20260709 13:18:38.982362 10079 leader_election.cc:400] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:38.995640 10079 leader_election.cc:403] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:18:38.964641 16357 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.629s	user 0.005s	sys 0.005s
I20260709 13:18:38.996630 10078 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:38.993786 10107 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:38.990943 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:38.993299 10113 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:38.999675 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.000027 10113 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.001479 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.002748 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:39.003328 10033 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:38.960361 15498 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.008370 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.012434 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.008867 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.008615 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.010277 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:38.991134 16350 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:39.016274 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:39.014421 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:38.975082 16264 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:38.987324 16287 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.016556 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.016441 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.019913 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.021332 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:39.029275 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:39.029899 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:39.014289 10037 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:38.942854 16205 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.022789 10107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:38.986588 16376 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:38.958247 16388 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:39.031966 16285 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:39.032373 10708 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:39.033373 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:39.034927 10079 consensus_peers.cc:597] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a5cf83b6b34444eb97230c9c7106ca4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.035969 16364 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:39.036732 16172 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.040613 10037 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:38.991987 15966 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.018868 16263 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:39.044816 16351 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:39.046865 16367 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:38.986765 16046 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:39.056074 10107 raft_consensus.cc:606] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:39.085008 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 63734.9us
W20260709 13:18:39.089063 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69240.5us
I20260709 13:18:39.006398 16191 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.006266 16282 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
W20260709 13:18:39.091002 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 56250.6us
I20260709 13:18:39.129153 16264 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:39.110690 16263 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:39.131053 16263 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:39.006882 16196 raft_consensus.cc:2764] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:39.018636 16350 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.136128 16350 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.018428 16108 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.141142 15966 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.096117 16330 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.142313 16346 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.094357 16312 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:39.145820 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.147779 10033 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:39.148432 16346 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.085515 16310 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:39.149251 16310 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:39.149425 16205 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.061097 16287 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.111392 10115 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:39.097730 10188 raft_consensus.cc:2368] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:39.151086 16330 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.152954 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.153486 10189 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:39.155109 16317 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:39.155928 16287 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:39.125558 16410 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:18:39.095667 16376 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.019635 15498 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.108776 16172 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:39.161118 16411 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:18:39.163188 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.163973 10107 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:39.165051 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.022202 16368 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.167344 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.156092 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.120991 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:39.156389 16310 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:39.185920 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 61164.3us
I20260709 13:18:39.090816 16285 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:39.193645 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 72760.4us
I20260709 13:18:39.192687 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.206025 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:39.207886 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.193692 16285 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:39.212513 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.212641 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.214599 10113 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:18:39.216024 10113 pending_rounds.cc:85] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 11
I20260709 13:18:39.216343 10113 pending_rounds.cc:107] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:18:39.216624 10113 raft_consensus.cc:2889] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.216549 16263 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.202677 16108 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:39.219858 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.223455 10110 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:39.225340 16263 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:39.221365  9923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:39.245332 16285 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.247550 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.252508 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:39.260746 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:39.262362 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.264303 10109 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:18:39.265887 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.269925 16350 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.272543 16350 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.267203 16108 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:39.274281 16108 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.277861 10110 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:39.278514 16263 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:39.281164 16263 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:39.281527 16263 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:39.284651 10111 raft_consensus.cc:2393] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:39.287834 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:39.288633 10110 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.283851 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.296294 10108 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:39.304212 10110 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:39.308642 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:39.309878 16172 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:39.282351 16263 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:39.294389 16414 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.313566 16414 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.268894 16388 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:39.318789 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.296689 15498 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.313987 16263 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:39.323450 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.325928 16264 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:39.326583 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.326682 16264 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.328001 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.331732 16377 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:39.334084 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 114338us
W20260709 13:18:39.335688 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 51951.7us
I20260709 13:18:39.336954 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.342007 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.346803 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.356618 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.357900 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.359019 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.351495 15498 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.351681 16383 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:39.364982 16420 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:39.366307 16368 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:39.353961 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.373657 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.374094 10078 leader_election.cc:400] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:39.374404 10078 leader_election.cc:403] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:39.342056 16388 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:39.337093 16329 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:39.377445 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.385870 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.385809 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.380309 16385 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:39.392381 16385 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.384764 16383 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:18:39.392844 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.398092 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.399526 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.401700 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.371830 16293 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:39.374888 16364 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.421962 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.382829 16088 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.423955 10189 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:39.376391 16368 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:39.382406 16402 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18.
I20260709 13:18:39.376562 15498 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:39.393823 16357 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:18:39.436493 16419 log.cc:927] Time spent T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.224s	user 0.003s	sys 0.000s
I20260709 13:18:39.437373 10112 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:39.438081 10110 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:18:39.441502 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 71626.5us
I20260709 13:18:39.383021 16388 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:39.395687 16044 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:39.389683 16387 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:39.467177 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:39.426601 16330 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:39.445057 16385 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:39.453938 15498 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.506206 16380 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:39.453461 16357 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:39.514851 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.489207 16388 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:39.517244 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:39.523097 10035 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.517992 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:39.523950 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:39.508209 16385 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.519423 15498 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.502564 16046 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:39.600082 10716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:39.606208 10716 raft_consensus.cc:606] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.509680 16312 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:18:39.561491 16385 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:39.617579 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.521003 16271 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:18:39.560279 16380 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:39.524710 16172 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:18:39.615878 16328 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.662076 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:39.664601 16429 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:18:39.673107 16428 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:39.647429 16414 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.687861 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:39.680312 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 235814us
W20260709 13:18:39.696702 16425 log.cc:927] Time spent T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:18:39.680371 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 156515us
I20260709 13:18:39.704182 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:39.706985 16310 consensus_meta.cc:287] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.000s
I20260709 13:18:39.709859 10713 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:39.710244 16432 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.710880 16432 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:39.713310 16432 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
W20260709 13:18:39.711344 16376 consensus_meta.cc:287] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.000s
I20260709 13:18:39.661424 16329 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.714952 16376 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.642481 16357 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.716949 16357 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:39.723838 10184 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:39.725961 16376 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:39.657771 16431 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:39.729058 16431 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.729422 16431 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:39.729772 10107 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:39.732681 15498 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.733741 10036 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:39.734390 16271 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:39.735684 16436 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:39.736070 16436 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:39.736833 16436 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.737104 16380 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.742811 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.715341 10106 raft_consensus.cc:2410] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:18:39.744270 15498 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.730021 10035 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:39.756443 10180 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:39.757099 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.760526 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.765818 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:39.784324 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.777974 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.785025 10111 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:39.786389 15498 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:39.790221 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:39.792248 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:39.797137 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:39.797387 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:39.707507 16310 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.801450 10182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 2300) took 1486 ms. Trace:
I20260709 13:18:39.803062 10715 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:18:39.803471 10715 pending_rounds.cc:85] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 11
I20260709 13:18:39.803709 10715 pending_rounds.cc:107] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:18:39.803953 10715 raft_consensus.cc:2889] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.801894 10182 rpcz_store.cc:276] 0709 13:18:38.309598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.331224 (+ 21626us) service_pool.cc:224] Handling call
0709 13:18:38.331547 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.454759 (+123212us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:18:38.472466 (+ 17707us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.089378 (+616912us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800403de0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:18:39.089591 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.089701 (+   110us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:18:39.089749 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.795960 (+706211us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002adfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:39.796018 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.796145 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17550,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":18447,"raft.queue_time_us":5705,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":22108,"spinlock_wait_cycles":314044544,"thread_start_us":78191,"threads_started":1,"wal-append.queue_time_us":118302,"wal-append.run_cpu_time_us":3476,"wal-append.run_wall_time_us":1059611}
I20260709 13:18:39.801635 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:39.798681 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:39.816572 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:39.777488 16077 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:18:39.834975 16437 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.808245 16432 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:39.836675 16432 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.837018 16432 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:39.837939 16310 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.839798 16370 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:39.778393 16172 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:18:39.845155 16172 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:39.845535 16172 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:39.846350 16172 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.844674 16034 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:18:39.849577 16034 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:39.853180 16368 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:39.854571 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.856439 16433 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:39.858528 16388 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.859731 10034 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:39.861737 10079 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:39.863556 16433 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.864180 10115 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:39.891558 16172 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.911988 16285 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.914072 16235 raft_consensus.cc:993] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:39.914695 16235 raft_consensus.cc:1081] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:39.874562 16385 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:39.946130 15498 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.946753 15498 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.947237 10038 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23. Ops: []
W20260709 13:18:39.953384 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.937572 16046 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.941773 16328 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.941931 10185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:39.957989 15498 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.956483 16346 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.956647 16196 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.962244 16196 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:39.963217 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.964522 16196 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:39.965210 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.965957 16346 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.968724 16346 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:39.972214 16430 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.355s	user 0.000s	sys 0.003s
W20260709 13:18:39.974064 16434 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:18:39.979549 16077 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.980324 16077 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.984016 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:39.984726 10182 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:39.986610 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:39.987545 16285 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:39.989574 15498 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:39.958454 10185 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.990358 10185 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:39.996137 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:39.990860 15498 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:39.998528 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:39.989017 16077 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:39.990517 16285 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.989122 16046 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.093793 16046 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:40.095780 16447 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:40.096786 10182 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:40.086575 16285 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.990832 16328 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.104437 16385 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.105712 16328 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.997263 16388 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.109622 15498 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:39.955850 16431 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.112747 10185 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.141924 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.144847 10187 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:40.159884 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.160480 16264 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:40.161022 16264 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.163218 16264 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:40.183307 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:40.188114 10185 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:40.190270 15498 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:40.190846 15498 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:40.193332 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:40.201503 15498 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.184773 16235 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.219110 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1335) took 1022 ms. Trace:
I20260709 13:18:40.220000 10109 rpcz_store.cc:276] 0709 13:18:39.196526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.295029 (+ 98503us) service_pool.cc:224] Handling call
0709 13:18:39.521962 (+226933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.522176 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.522199 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.522243 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:39.522272 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.522325 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.218905 (+696580us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540010dbd0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:40.219045 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521142656}
I20260709 13:18:40.221226 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.220880 16402 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.205699 16446 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:40.243969 15966 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.244633 15966 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.205821 16368 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:40.227361 16402 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.259178 15966 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.262400 16402 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.209750 16432 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:40.203372 16433 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:40.253505 16368 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:40.283464 16364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.020s	sys 0.021s
I20260709 13:18:40.225061 16235 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:40.297362 16364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.021s	sys 0.021s
W20260709 13:18:40.300909 10106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2455) took 1266 ms (client timeout 1607 ms). Trace:
W20260709 13:18:40.301357 10106 rpcz_store.cc:269] 0709 13:18:39.034337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.308352 (+274015us) service_pool.cc:224] Handling call
0709 13:18:40.300678 (+992326us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002b9154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:40.300838 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933056384}
I20260709 13:18:40.302793 16196 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:40.305212 16263 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:40.305750 16263 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:40.306830 16263 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.307832 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.259727 16285 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.291675 16368 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:40.328688 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:40.334219 10106 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.336951 16235 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:40.339094 16285 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.339761 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:40.339952 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.303539 16196 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:40.330116 10189 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:40.331651 16380 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:40.343811 16380 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:40.344190 16380 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:40.345050 16380 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.346396 16380 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.347424 16263 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.348990 16432 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:40.349690 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:40.333782 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:40.351688 16436 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.354981 16131 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:40.351475 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:40.342919 16196 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.357435 16196 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:40.366905 16455 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.140s	user 0.004s	sys 0.000s
I20260709 13:18:40.367571 16131 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:40.367180 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.370131 10181 raft_consensus.cc:2368] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19.
W20260709 13:18:40.372669 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.373283 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.376087 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:40.377663 16431 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:40.377897 10112 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:18:40.396338 16457 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:18:40.398535 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.399838 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:40.400133 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:40.400444 10110 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.401032 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.402398 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.403122 10108 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:40.403450 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.406400 10003 leader_election.cc:400] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19.
I20260709 13:18:40.406821 10003 leader_election.cc:403] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:40.401125 10112 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:40.408638 16350 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:40.409096 16350 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:40.410012 16350 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.411458 16167 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.412063 16167 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.421023 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.422853 10106 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:40.423063 10183 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:40.423563 10110 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:18:40.424268 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:40.426663 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.434111 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.435186 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.436383 10189 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:40.424818 16167 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.447031 10153 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:40.454022 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:40.455780 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:40.458361 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:40.461333 10115 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:40.463132 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.411418 16350 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.468051 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:40.447510 16088 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:18:40.470173 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.471568 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:40.473133 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:40.477427 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:40.471095 16131 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:40.478061 10110 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.478137 16131 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.480407 16131 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:40.470404 16196 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:40.481123 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.481097 16196 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.482542 16287 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:40.484391 16196 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:40.486135 16357 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:40.487061 16357 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:40.487393 16357 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:40.488195 16357 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.489110 16357 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.489657 16432 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:40.492867 16437 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.493480 16437 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:40.498431 10110 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
W20260709 13:18:40.514266 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.543195 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45780.9us
W20260709 13:18:40.544086 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46310.6us
I20260709 13:18:40.544993 10004 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:40.507232 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:40.606853 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99756.4us
W20260709 13:18:40.607051 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62164.6us
I20260709 13:18:40.475430 16077 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:40.477483 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:40.623903 10110 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:40.497244 16172 raft_consensus.cc:2804] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:40.498924 16044 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:40.544049 16235 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:40.607503 16435 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:18:40.664968 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:40.650744 16383 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:40.673743 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.676522 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:40.617063 16303 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:40.624348 16131 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:40.659857 16387 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:18:40.669035 16044 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.736500 16388 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:40.768790 16388 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.770808 16470 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:40.775910 10188 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:40.738631 16131 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:40.779300 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82215.5us
I20260709 13:18:40.789266 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:40.715258 16303 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.781105 16437 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.821455 10187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1501) took 1080 ms. Trace:
I20260709 13:18:40.778261 16470 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:40.822474 10187 rpcz_store.cc:276] 0709 13:18:39.741394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.746413 (+  5019us) service_pool.cc:224] Handling call
0709 13:18:39.746726 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.145945 (+399219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.821149 (+675204us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54001883d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:40.821385 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915141504}
I20260709 13:18:40.827358 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.789831 16310 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:40.790081 16329 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.790565 16137 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:40.795805 16077 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:40.814260 16044 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.828948 16205 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.816924 16287 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:40.845129 10708 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:18:40.829306 16438 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.789363 16368 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.817219 16295 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:18:40.856103 16470 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.849184 16205 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.841611 16329 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:40.837105 16310 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:40.859123 15498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.030s
W20260709 13:18:40.922602 15498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.015s	sys 0.031s
W20260709 13:18:40.861443 16263 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.001s
I20260709 13:18:40.861624 16388 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:40.863258 10183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47762 (request call id 1505) took 1120 ms. Trace:
I20260709 13:18:40.843425 16137 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.842523 16046 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.869156 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 391736us
W20260709 13:18:40.869611 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 210447us
I20260709 13:18:40.870905 16357 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:40.871348 16172 raft_consensus.cc:697] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:40.871284 16431 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:40.871908 16383 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:40.866063 16088 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19.
I20260709 13:18:40.874764 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:40.872884 16150 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:40.882392 16432 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.885406 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.886201 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:40.885432 16467 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:18:40.911326 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.921234 10106 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:40.924250 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.978915 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:40.979573 10182 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:40.930588 10113 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:40.869069 16303 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:40.929634 10183 rpcz_store.cc:276] 0709 13:18:39.742438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.742542 (+   104us) service_pool.cc:224] Handling call
0709 13:18:40.862996 (+1120454us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54002d4bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:40.863128 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545190656}
I20260709 13:18:40.937252 16046 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.941524 10110 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:40.938922 16077 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:40.993284 10033 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:40.927188 16414 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:40.952343 10038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:40.999239 10038 raft_consensus.cc:606] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:40.954285 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:41.000160 10037 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:41.000841 16459 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.759s	user 0.000s	sys 0.003s
I20260709 13:18:41.001189 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:41.002511 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.005853 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:40.972904 16480 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:41.007056 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:40.983220 16432 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:40.958033 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:40.971185 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:41.017971  9934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 288) took 33266 ms (client timeout 15000 ms). Trace:
I20260709 13:18:41.020149  9931 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 18, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 18 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:41.021932 16466 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:18:41.022329  9931 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 5 to 19. New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.974594 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:40.939697 16471 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.875145 16438 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.024147 10034 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.975383 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.029912 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.032295 10037 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:41.033000 16471 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.035287 10038 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:41.032208 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:41.036718 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 153081us
I20260709 13:18:41.036849 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.039251 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.039984 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:40.951879 16436 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:18:41.003727 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:41.046305 10036 raft_consensus.cc:2410] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:40.985272 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:41.035951 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62734.3us
I20260709 13:18:41.042418 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.047089 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1340) took 1077 ms. Trace:
I20260709 13:18:40.984237 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.048120 10040 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:41.049443 15498 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.000690 16477 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.062368 10034 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:41.051287 10111 rpcz_store.cc:276] 0709 13:18:39.957235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.957425 (+   190us) service_pool.cc:224] Handling call
0709 13:18:39.960167 (+  2742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.960562 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.960591 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.961116 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.111403 (+150287us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:40.111444 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.111514 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.942944 (+831430us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:41.025272 (+ 82328us) raft_consensus.cc:1685] finished
0709 13:18:41.025295 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.034118 (+  8823us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":874,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":14400768,"thread_start_us":149836,"threads_started":1,"wal-append.queue_time_us":253494}
I20260709 13:18:40.993866 16287 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.031405 16432 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.049971 15498 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.041390 16046 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:41.049459 16430 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:41.090955 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.091818 10035 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:41.057289  9931 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 15, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 15 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.094512 16205 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:41.095117  9931 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 18, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 18 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:41.097048  9931 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.101434 10187 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:41.100816  9931 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 17, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:41.103157  9931 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 7 to 14, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 14 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:41.105247 15498 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.105465  9931 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 11 to 14, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 14 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.107093 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.108260  9931 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 19, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.111524 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:41.112726 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49097.2us
I20260709 13:18:41.113838 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.058645 16375 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:41.025511 16077 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.031832 16414 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.058354 16385 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:41.049710 16364 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 13:18:41.123229 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.124459 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:41.093700 16329 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:41.133889 10035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:41.134413 10708 raft_consensus.cc:3055] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:41.134909 10708 raft_consensus.cc:740] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:18:41.113689 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 232787us
I20260709 13:18:41.134539 10035 raft_consensus.cc:606] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.135802 10035 raft_consensus.cc:614] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:41.137822 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.141043 10113 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:41.135950 10708 consensus_queue.cc:260] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.142654 10708 raft_consensus.cc:3060] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.132511 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.042202 16383 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:41.150488 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:41.152993 10034 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:41.119980 16375 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:41.018424  9934 rpcz_store.cc:269] 0709 13:18:07.751118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.751617 (+   499us) service_pool.cc:224] Handling call
0709 13:18:41.017856 (+33266239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:35.036864 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:35.037510 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:35.037559 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:18:35.037593 (+    34us) tablet.cc:662] Decoding operations
0709 13:18:35.161517 (+123924us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:35.174661 (+ 13144us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:35.176610 (+  1949us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:18:35.200529 (+ 23919us) tablet.cc:701] Row locks acquired
0709 13:18:35.200579 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:18:35.200760 (+   181us) write_op.cc:270] Start()
0709 13:18:35.200915 (+   155us) write_op.cc:276] Timestamp: P: 1783603115200679 usec, L: 0
0709 13:18:35.200951 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:18:35.241546 (+ 40595us) log.cc:844] Serialized 2870 byte log entry
0709 13:18:35.730570 (+489024us) op_driver.cc:464] REPLICATION: finished
0709 13:18:35.824326 (+ 93756us) write_op.cc:301] APPLY: starting
0709 13:18:35.824439 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:35.930050 (+105611us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:35.930168 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:35.959934 (+ 29766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:35.978423 (+ 18489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:18:35.980286 (+  1863us) write_op.cc:312] APPLY: finished
0709 13:18:36.047063 (+ 66777us) log.cc:844] Serialized 73 byte log entry
0709 13:18:36.067285 (+ 20222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.079304 (+ 12019us) write_op.cc:454] Released schema lock
0709 13:18:36.102211 (+ 22907us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:36.175818 (+ 73607us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.186721 (+ 10903us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2161442,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":93297,"apply.run_cpu_time_us":13881,"apply.run_wall_time_us":310315,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":269047,"prepare.run_cpu_time_us":50068,"prepare.run_wall_time_us":445881,"raft.queue_time_us":169995,"raft.run_cpu_time_us":18843,"raft.run_wall_time_us":109374,"replication_time_us":520378,"thread_start_us":539289,"threads_started":4,"wal-append.queue_time_us":212181,"wal-append.run_cpu_time_us":22207,"wal-append.run_wall_time_us":1668903}]]}
I20260709 13:18:41.153452 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:41.081122 16477 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.085260 16287 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:41.159901 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 46152.5us
I20260709 13:18:41.166774 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:41.152865 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 195041us
I20260709 13:18:41.167688 16443 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:41.168526 16357 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:41.169095 16443 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:41.169571 16443 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:41.170194 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.170378 16443 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.128475 16483 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:41.172066 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.169134 16357 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:41.172885 16483 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:41.173328 16483 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.171635 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.173321 16357 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.172590 16443 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.128607 16336 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:41.186190 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:41.179458 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 202375us
I20260709 13:18:41.194062 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.154649 16368 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.152215 16329 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:41.086879 16172 consensus_queue.cc:237] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.125478  9931 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 18 to 19, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:41.203356 10034 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:41.204663 10708 raft_consensus.cc:2468] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:41.160586 16375 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:41.135052 16385 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.216809 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.221741 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.222047 16438 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.224184 16438 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.225512 16310 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:41.226845 16437 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:41.227293 16437 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:41.228155 16437 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.229408 16437 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:41.229746 16350 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.001s
I20260709 13:18:41.190868 16336 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.232683 16167 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:41.233091 16167 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:41.233392 16336 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.235011 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.234524 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.236688 16167 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.237282 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.237577 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.238152 16167 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:41.238692 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.231755 16477 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:41.235123 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.241091 10034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f53253de3345159399b6816804e1e6"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:41.241699 10034 raft_consensus.cc:606] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.242043 10034 raft_consensus.cc:614] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:41.241966 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.245960 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.233018 10039 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:41.250846 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:41.256001 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69895.7us
I20260709 13:18:41.258950 10081 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.265153 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.262807  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:41.269268 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.253927 16441 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.269035  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:41.275686 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 81716.7us
I20260709 13:18:41.276929 16137 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:41.285488 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 90108.3us
I20260709 13:18:41.288219 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:41.255350 16317 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:41.291489 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:41.273973 10081 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:41.299125 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 104713us
I20260709 13:18:41.273098 16329 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:41.304658 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.322657 16336 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:41.322777 10682 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.323400 16336 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:41.323865 16285 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.324764 16287 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.325295 16469 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:41.325700 16469 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.326040 16469 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.290764 16483 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.286679 16471 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:41.332726 16385 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.333182 16137 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:41.333791 16483 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:41.336437 16414 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.290591 16492 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:41.340317 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:41.362654 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62667.4us
I20260709 13:18:41.363356 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.362771 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.364020 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.369413 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:41.370863 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.371541 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.373999 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.374643 10106 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
W20260709 13:18:41.369381 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 175366us
I20260709 13:18:41.378077 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.338477 16329 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:41.361266 16499 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:41.365948 16483 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.392786 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64803.1us
I20260709 13:18:41.391616 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.371996 16328 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:41.394155 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.376331 16388 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:41.382463 16489 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.424045 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.382159 16492 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:41.392436 16271 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:41.386833 16329 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.439208 10185 raft_consensus.cc:1240] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:41.440376 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.405735 16499 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:41.446105 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 61399us
W20260709 13:18:41.460418 16498 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:41.429664 16336 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.467125 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:41.438303 16271 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.438524 16329 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.403018 16483 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:41.474365 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 94216.7us
I20260709 13:18:41.476357 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:41.477757 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 114218us
I20260709 13:18:41.479513 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.450357 16489 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:41.428848 16388 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.475567 16205 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.481452 16310 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:41.473807 16271 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.496258 16469 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.500893 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.427573 16486 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:18:41.517258 16469 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.518155 16486 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:41.518631 16486 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:41.520030 10035 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:41.522022 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:41.522341 16504 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:41.522675 10188 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.525158 16483 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.519495 16486 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.503679 16414 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.546689 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:41.535733 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
W20260709 13:18:41.540264 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 148744us
W20260709 13:18:41.543206 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 160552us
I20260709 13:18:41.561625 16516 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:41.565981 16131 raft_consensus.cc:993] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:41.566665 16131 raft_consensus.cc:1081] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:41.568121 16486 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.549952 16414 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.571238 16414 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.573053 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.573715 10114 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:41.540565 16492 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.543191 16235 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:41.575503 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.582768 16431 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:41.583269 16431 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:41.584275 16431 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.577571 16499 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.506047 16375 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.596145 16375 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.596668 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47762 (request call id 1523) took 1080 ms. Trace:
I20260709 13:18:41.597111 10185 rpcz_store.cc:276] 0709 13:18:40.516702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.516845 (+   143us) service_pool.cc:224] Handling call
0709 13:18:40.517141 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.439713 (+922572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.596419 (+156706us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b5400052154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:41.596604 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120102656}
I20260709 13:18:41.599644 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.599973 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.600827 10040 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:41.601218 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.602226 10032 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:41.578799 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:41.718958 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 148001us
W20260709 13:18:41.719121 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 141353us
I20260709 13:18:41.566831 16388 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:41.754220 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 105502us
I20260709 13:18:41.758400 16271 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.770393 10032 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:41.772535 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:41.773452 10185 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: [17.11-19.12]
I20260709 13:18:41.779238 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:41.780880 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.769006 16523 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:41.785596 16329 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:41.785655 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:41.790982 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:41.791574 10032 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.770661 10034 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:41.793380 10039 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:41.764348 16483 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.768311 16436 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:41.804780 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.768512 16516 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:41.814370 10113 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:41.815797 10114 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:41.816450 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.808202 16370 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.821913 16370 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:41.822216 16454 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:18:41.804811 16377 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:41.803097 16436 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.808022 16263 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:41.838375 10039 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.805903 16501 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:41.823810 16414 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:41.845585 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:41.846419 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.848852 10187 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.844565 16329 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.853483 16370 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.858963 10187 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:41.860953 10032 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:41.860064 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.808087 16205 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:41.839771 16436 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.836126 16377 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:41.863392 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.805982 16483 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.864156 10039 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:41.841073 16263 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:41.869539 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:41.872783 10039 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:41.862558 16414 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:41.876101 16414 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.865593 16501 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:41.879148 16501 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:41.880189 16501 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:41.881908 16271 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.882014 16364 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.882735 16364 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.883896 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:41.887372 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.892699 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:41.893540 16526 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:41.897760 10113 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:18:41.900578 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.900636 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.901441 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:41.903661 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:41.906491 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.901901 10709 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:41.906491 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.908365 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.911054 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.911613 10106 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:41.906651 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:41.914294 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.895887 16263 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.916792 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:41.917591 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:41.915249 16172 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:41.913599 16357 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.917783 16263 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.882545 16271 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.915095 16375 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:41.936463 16364 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.940850 16471 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:41.921866 16383 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:18:41.944780 10181 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:41.950395 16500 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:41.951067 16436 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.948421 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.946923 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.953936 10039 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:41.954846 10032 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:41.958911 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.961189 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:41.958649 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44928.4us
I20260709 13:18:41.960192 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:41.967017 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:41.969889 10032 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:41.972333 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:41.973742 16528 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:41.974769 16481 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:41.976116 16370 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:18:41.978091 16527 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:41.971113 16514 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:18:41.974581 16518 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:41.985564 16383 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:41.986178 16383 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.988410 16483 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:41.948344 16271 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.990902 16271 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.968163 16471 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:41.982545 16388 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:41.991643 16436 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:41.967720 16499 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:41.992965 16499 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:41.993688 10033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 1176) took 1035 ms. Trace:
I20260709 13:18:41.971552 16470 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:41.992383 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:41.995015 10112 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.995244 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:41.996151 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:41.958431 16375 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:42.000351 16470 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:42.001278 16375 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.001439 16470 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.006096 16431 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:41.914037 16377 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.009460 16380 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:41.998946 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:42.013643 10112 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.021054 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.023380 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.024555 16471 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.023674 16483 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:42.027129 10716 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:41.992324 16388 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:41.994037 10033 rpcz_store.cc:276] 0709 13:18:40.958183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.008920 (+ 50737us) service_pool.cc:224] Handling call
0709 13:18:41.009218 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.009411 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:41.160363 (+150952us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.980049 (+819686us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18002ba800. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a
0709 13:18:41.993349 (+ 13300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.993403 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:41.993446 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.993508 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.993630 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27031,"prepare.queue_time_us":238994,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":13760,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":8809344,"thread_start_us":251704,"threads_started":2,"wal-append.queue_time_us":222613}
I20260709 13:18:42.027221 10111 raft_consensus.cc:2410] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:42.028378 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:42.031966 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.038066 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.039011 16499 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:42.042119 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.035383 16469 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:42.044049 16383 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:42.029464 16521 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.046247 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.035199 16082 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.049760 16131 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:42.062038 10112 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:42.064165 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.064816 16077 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:42.066707 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.044978 16387 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:42.070293 16521 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:42.071308 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.044123 16469 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:42.076192 16469 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:42.078209 16387 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:42.071406 16521 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.080933 16521 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:42.087452 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.092370 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.093638 10185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:18:42.094220 10185 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:42.094551 10185 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:42.098323 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.105537 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.103988 16387 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:42.108042 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.108711 16414 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:42.112222 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:42.115470 10036 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:42.119194 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.122613 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:42.123236 10040 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.123345 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:42.123616 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:42.126051 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.072003 16082 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:42.140252 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.142570 10185 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.145157 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:42.147382 10182 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:42.145929 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:42.163285 10040 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:42.044971 16535 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 13:18:42.141896 16436 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.170806 10185 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:42.150619 16285 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.151832 16271 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:42.159252 16131 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:42.159705 16533 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:42.169407 16077 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:42.212517 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69083.9us
I20260709 13:18:42.177999 16436 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.217403 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.219352 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.221920 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.208293 16536 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:42.186339 16271 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.229394 16370 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.230082 16370 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.196996 16533 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.232502 16370 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:42.232841 16533 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.222810 16380 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:42.234440 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:42.223524 16375 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:42.235786 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.236709 10106 raft_consensus.cc:2410] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:42.235319 10716 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:42.241721 16536 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:42.242864 16536 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.262259 16544 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:42.263854 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:42.264492 10036 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:42.264771 10036 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:42.263684 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:42.259387 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.275100 10184 raft_consensus.cc:2410] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:42.235208 16436 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:42.265493 10036 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.259233 16521 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.282925 10036 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:42.288033  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:42.294057 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.309511 16485 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:42.314725 10036 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:42.316061 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:42.324779 16271 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:42.326503 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:42.328435 16469 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.319896 16533 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:42.332523 16469 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.334364 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:42.352284 16533 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:42.368120 10188 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:42.353780 16521 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:42.366909 16501 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.388063 16533 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.376116 16501 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.399776 16501 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.401131 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:42.401790 10711 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:42.402299 16167 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:42.402714 16167 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:42.403606 16167 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.405118 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:42.407714 16131 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.409715 10182 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:18:42.410099 10182 pending_rounds.cc:85] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 14
I20260709 13:18:42.410329 10182 pending_rounds.cc:107] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:18:42.410552 10182 raft_consensus.cc:2889] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:42.411484 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:42.422302 10033 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:42.428339 16377 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.430451 16501 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:42.431154 16501 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.441412 10036 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:42.444335 16205 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:42.445572 16150 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:42.448926 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.450031 10185 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:42.451174 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.419524 16499 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:42.408264 16131 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.455919 16499 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.456363 16499 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.451848 10189 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:42.446010 16346 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:18:42.460704 16131 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.464056 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:42.466430 10038 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:42.470150 16518 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.470762 16518 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.473512 16535 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:42.474464 16535 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:42.474838 16535 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:42.474249 16518 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.479322 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:42.484781 10711 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:42.485775 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:42.475625 16535 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.486382 10111 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:42.486969 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:42.470024 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.482553 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:42.494660 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.496213 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.496951 10112 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:42.495327 10114 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 23.
I20260709 13:18:42.498214 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.498806 10185 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:18:42.475792 16501 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.499925 16310 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:42.502573 16310 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:42.502321 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.502982 16310 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:42.508823 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.513898 10185 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:42.513264 10113 raft_consensus.cc:1275] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:42.484151 16458 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:42.500811 16488 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:42.520951 10113 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:42.509480 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:42.512746 10111 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:42.502348 16501 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:18:42.534001 16499 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.534881 10187 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:42.536077 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:42.536773 10039 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:42.537043 10108 raft_consensus.cc:2368] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:42.539603 10039 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:42.519647 16458 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.542853 16167 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.547770 16523 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:42.553047 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:42.552791 16310 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.560762 16310 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.565683 16535 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:42.567445 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:42.569185 16499 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.543758 16521 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:42.570756 16521 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.571143 16521 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:42.571991 10113 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:42.573734 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.574517 10108 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:18:42.575276 10713 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:42.543660 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:42.576869 16357 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:42.577273 16357 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.577602 16357 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:42.577510 16432 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:42.580099 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:42.580772 10112 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:42.581478 10079 consensus_peers.cc:597] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a5cf83b6b34444eb97230c9c7106ca4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.583215 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:42.584916 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:42.585701 10187 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:42.587947 10034 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:42.587181 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:42.589682 10182 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.586226 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:42.590871 10713 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:42.593901 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:42.602236 10713 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:42.603731 10079 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:42.607479 10035 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:42.591557 10112 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:18:42.546259 16458 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.617674 10114 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:42.618150 10114 pending_rounds.cc:85] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 11
I20260709 13:18:42.618422 10114 pending_rounds.cc:107] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:42.618642 10114 raft_consensus.cc:2889] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:42.628414 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:42.630645 10182 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:42.602751 16523 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:42.636198 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.638613 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:42.642347 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.644376 15699 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:42.644913 15699 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.619449 16499 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:42.656703 10153 leader_election.cc:400] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:42.657119 10153 leader_election.cc:403] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:42.663329 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52224.3us
I20260709 13:18:42.646452 16533 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:42.675621 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.654819 16431 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:42.692577 10182 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:42.645826 16432 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:18:42.649228 16328 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:18:42.671214 16271 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:42.662837 16441 consensus_queue.cc:1048] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:18:42.664958 16364 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:18:42.712028 16438 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:42.669054 16499 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:42.724453 16499 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.671990 16533 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:42.699420 16544 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:42.665709 16488 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:18:42.736176 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 86212.6us
I20260709 13:18:42.739948 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:42.742136 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:42.740788 16470 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.732647 16533 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:42.715387 16346 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:18:42.723619 16438 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.747275 16082 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:42.749126 16523 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:42.812693 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 60135.6us
I20260709 13:18:42.816704 16046 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:42.817296 16357 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.822923 10111 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:42.807121 16387 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:42.808247 16082 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:42.828063 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:42.827842 16082 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:42.828676 10716 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:42.830389 10189 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:42.832057 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.824848 16438 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:42.819533 16357 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:42.807456 16557 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:18:42.848872 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 98937.9us
I20260709 13:18:42.839504 16563 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:18:42.868451 10111 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:42.839327 16535 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:42.881858 16544 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:42.883381 10716 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:42.891896 16523 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.959365 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:42.962564 10184 raft_consensus.cc:2368] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 20. Current term is 21.
I20260709 13:18:42.954313 16458 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.966593 10153 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:42.969388 16172 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:42.969708 15699 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:42.969934 16172 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:42.970933 16172 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.966482 16458 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:42.975368 16458 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:42.994776 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:43.000732 16414 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:43.001706 10679 leader_election.cc:400] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 20. Current term is 21.
I20260709 13:18:43.002072 10679 leader_election.cc:403] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:43.002748 16414 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.005326 16370 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 20. Current term is 21.
I20260709 13:18:43.009312 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:43.010003 10716 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:43.010231 10036 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:43.011698 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:43.014058 10039 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:42.944337 16521 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.032557 10036 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:43.031917 16437 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:18:43.044739 10039 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:43.046231 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:43.078451 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:43.077097 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:43.059530 16562 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:43.090375 16377 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:43.092312 16377 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.086059 10033 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:18:43.093832 16488 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:43.094764 16562 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.097218 16562 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:43.157982 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:43.158991 10039 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:43.136001 16488 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:18:43.161507 16488 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:43.161882 16488 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:43.162705 16488 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.169715 16488 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:43.188697 16533 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.189868 10189 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:43.190955 16533 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:43.192694 16521 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:43.193984 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:43.194756 10716 raft_consensus.cc:2393] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:43.196952 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:43.203454 16044 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:43.213611 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:43.214804 16483 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:43.215852 16483 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:43.216300 16437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55800 (request call id 1) took 4878 ms. Trace:
I20260709 13:18:43.217449 16437 rpcz_store.cc:276] 0709 13:18:38.338137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.343405 (+  5268us) service_pool.cc:224] Handling call
0709 13:18:38.618264 (+274859us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b54001c7da0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45da1d 00007f3c6f4441a4 00007f3c6f4c6447 00007f3c6f4e370a 00007f3c6f4e476a 00007f3c6f4e391b 00007f3c6f4ef03c 00007f3c6f4ee6b3 00007f3c744aed29 00007f3c6da2d1d4
0709 13:18:38.626831 (+  8567us) log.cc:844] Serialized 506 byte log entry
0709 13:18:43.216185 (+4589354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90,"raft.queue_time_us":440,"raft.run_cpu_time_us":1755,"raft.run_wall_time_us":1763,"spinlock_wait_cycles":198666752,"thread_start_us":106969,"threads_started":1,"wal-append.queue_time_us":188880,"wal-append.run_cpu_time_us":5645,"wal-append.run_wall_time_us":1057960}
I20260709 13:18:43.219928 16483 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.221411 16577 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:43.223264 16483 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:43.254797 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:43.255509 10182 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:43.258654 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:43.275853 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:43.277072 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:43.278723 16436 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:43.279186 16436 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.279577 16436 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:43.280304 16437 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:43.280776 16437 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:43.281212 16437 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.283267 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:43.288061 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:43.291776 10184 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:18:43.295305 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.297508 10186 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:18:43.298096 10186 pending_rounds.cc:85] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 10
I20260709 13:18:43.298372 10186 pending_rounds.cc:107] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:18:43.298662 10186 raft_consensus.cc:2889] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.298681 10712 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:43.300211 16577 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:43.316481 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:43.331136 16438 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.336747 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:43.338217 16364 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:43.349123 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45770.7us
I20260709 13:18:43.364387 16414 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:43.348137  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:43.373102 16499 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.374531 16436 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.384291 16588 ts_tablet_manager.cc:933] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:43.388442 10033 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:18:43.391861 10111 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:43.405018 16471 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:43.428615  9931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 188) took 8737 ms. Trace:
I20260709 13:18:43.429071  9931 rpcz_store.cc:276] 0709 13:18:34.691459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.691796 (+   337us) service_pool.cc:224] Handling call
0709 13:18:43.428505 (+8736709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.581606 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:41.582151 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:41.582186 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:41.582203 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:41.583169 (+   966us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:41.583228 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:41.583255 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:18:41.760260 (+177005us) tablet.cc:701] Row locks acquired
0709 13:18:41.760283 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:41.760443 (+   160us) write_op.cc:270] Start()
0709 13:18:41.760568 (+   125us) write_op.cc:276] Timestamp: P: 1783603121760393 usec, L: 0
0709 13:18:41.760590 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:41.761328 (+   738us) log.cc:844] Serialized 4367 byte log entry
0709 13:18:42.148643 (+387315us) op_driver.cc:464] REPLICATION: finished
0709 13:18:42.320967 (+172324us) write_op.cc:301] APPLY: starting
0709 13:18:42.321058 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:42.385033 (+ 63975us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.385149 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.541203 (+156054us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.541459 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:18:42.541501 (+    42us) write_op.cc:312] APPLY: finished
0709 13:18:42.541788 (+   287us) log.cc:844] Serialized 105 byte log entry
0709 13:18:42.541961 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.542102 (+   141us) write_op.cc:454] Released schema lock
0709 13:18:42.542152 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.542557 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.542587 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4026171,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":164839,"apply.run_cpu_time_us":16744,"apply.run_wall_time_us":221579,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50041,"num_ops":11,"prepare.queue_time_us":126326,"prepare.run_cpu_time_us":45208,"prepare.run_wall_time_us":279754,"raft.queue_time_us":90198,"raft.run_cpu_time_us":25589,"raft.run_wall_time_us":240745,"replication_time_us":358089,"thread_start_us":280652,"threads_started":4,"wal-append.queue_time_us":144619}]]}
I20260709 13:18:43.456506 16437 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.458753 16437 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:43.461048 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:43.479239 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:43.482398 16414 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:43.482937 16414 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:43.493888 16471 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.494562 16471 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.497717 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:43.506764 10036 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:43.483078 16587 log.cc:927] Time spent T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:43.503288 10189 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:18:43.516919 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:43.516948 10188 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:43.520025 10187 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:43.542886 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:43.543470 10716 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:43.545115 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:43.549105 16488 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:43.549620 16488 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:43.550441 16488 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.567574 10036 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:18:43.593432 16591 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:43.544530 16436 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:43.610391 10716 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:43.612072 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:43.597688 16150 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:43.614678 16150 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.617115 16150 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:43.620256 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:43.620973 10713 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:43.622346 16431 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:43.622923 16431 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:43.623822 16431 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.628975 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:43.632233 16562 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:43.632695 16562 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:43.633049 16562 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.633709 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:43.650048 10032 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:43.547770 16437 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:18:43.657294 16437 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:43.657727 16437 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:43.658742 16437 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.647720 10713 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:18:43.697014 16596 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
W20260709 13:18:43.707799 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59659.3us
I20260709 13:18:43.530673 16414 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:43.717094 16437 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:43.703203 16562 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:43.718111 16172 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:18:43.785404  9932 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 12 to 16, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 16 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.789944 16471 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:43.792232 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:43.793286 10186 raft_consensus.cc:2410] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:43.801692 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:43.904773 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 194493us
I20260709 13:18:43.916329 16172 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:18:43.787685  9932 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.013972 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:44.025326 16346 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:44.019538 16588 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.007s	sys 0.005s
I20260709 13:18:44.022063 16483 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.074716 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 140778us
I20260709 13:18:44.155691 10039 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:44.076123 16483 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.170598 16483 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:44.164337 16150 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:18:44.221055 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:44.223081 10039 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:44.205420  9932 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 11 to 17, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:44.306928 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:44.307658 10110 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
W20260709 13:18:44.074404 16588 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.008s	sys 0.005s
W20260709 13:18:44.330483 16437 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.003s
I20260709 13:18:44.331933 16588 tablet_copy_client.cc:323] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
I20260709 13:18:44.350801 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:44.296873  9932 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 8 to 15, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 15 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:18:44.361220 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 419728us
I20260709 13:18:44.346825 16562 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:44.373519 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 475010us
I20260709 13:18:44.376128 10711 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
W20260709 13:18:44.353138 16597 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 13:18:44.370564 16431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.221s	sys 0.316s
I20260709 13:18:44.399905 16571 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:44.400545 16571 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:44.402738 16571 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:44.418074 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:44.421097 10039 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 24: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:18:44.405875 16431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.221s	sys 0.317s
I20260709 13:18:44.436543 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:44.437531 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:44.440168 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet 6a5cf83b6b34444eb97230c9c7106ca4 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:18:44.440852 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet 6a5cf83b6b34444eb97230c9c7106ca4 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-6a5cf83b6b34444eb97230c9c7106ca4
I20260709 13:18:44.437677 16046 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:44.441870 16046 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.442276 16046 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:44.439407  9932 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 12 to 16, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 16 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.440539 16438 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:44.448510 16438 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:44.449442 16438 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.456583 16046 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.458986 16046 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:44.459822 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:44.464385 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 85041.7us
I20260709 13:18:44.473287 10107 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:44.486598 10182 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:44.511005 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:44.448092  9932 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 9 to 10, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 10 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.555289  9932 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 9 to 11, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 11 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.559008  9932 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 13 to 14, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 14 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:44.600251 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:44.601428 10709 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:44.617628 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:44.641152 10035 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:44.663234 16150 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:44.659183 10107 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:44.686780 16377 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:44.694885 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:44.695760 10125 tablet_copy_source_session.cc:215] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:44.714881 10709 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:44.778788 16588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5cf83b6b34444eb97230c9c7106ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:44.782912 16291 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:44.786906 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:44.787834 10712 raft_consensus.cc:606] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:44.789032 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 94619.7us
I20260709 13:18:44.783727 16291 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.797676 16291 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:44.800905 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:44.807821 10036 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:44.812829  9932 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 11 to 14, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 14 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.819619 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:44.820503 10107 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:44.761636 16562 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:44.828385 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:44.829882 16604 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:44.830317 16604 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:44.830787 16604 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:44.841674 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 61517.4us
W20260709 13:18:44.848870 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 87077.9us
I20260709 13:18:44.851843 16533 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:44.858335 10712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:44.875301 16346 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.875970 16346 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.878465 16346 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:44.862778 10712 raft_consensus.cc:606] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:44.816766  9932 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:44.885275  9932 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 9 to 13, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.889432 10036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:44.920310 10036 raft_consensus.cc:606] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:44.920857 16610 raft_consensus.cc:993] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:44.921482 16610 raft_consensus.cc:1081] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:44.903980 16604 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.923897 10709 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e"
dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:18:44.924569 10709 raft_consensus.cc:606] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:44.924827 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:44.925606 10036 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:44.925643 10107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:53672
I20260709 13:18:44.926671 10107 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:44.927099 10107 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:44.926136 16604 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:44.933746 10709 raft_consensus.cc:614] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:44.937260 10036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:44.937482 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:44.937933 10036 raft_consensus.cc:606] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:44.938371 10036 raft_consensus.cc:614] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:44.941926 10114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:44.951085 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:44.955840 10113 pending_rounds.cc:85] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 10
I20260709 13:18:44.956346 10113 pending_rounds.cc:107] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:44.956761 10113 raft_consensus.cc:2889] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.975605 10106 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:44.976222 10114 raft_consensus.cc:606] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:18:44.976608 10114 raft_consensus.cc:614] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:44.975052 10107 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:44.968379 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:44.979868 10712 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:44.994809 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:45.000483  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:45.001377 10036 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:45.002681 16604 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:45.003430 16604 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:45.009196 10107 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:45.014473 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:45.015179 10712 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:45.016638 10712 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:44.922142  9932 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.004603 16604 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.032637 16588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42392 (request call id 1201) took 1747 ms. Trace:
I20260709 13:18:45.047169 10713 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:45.048259 16263 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:18:45.060691 16564 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:45.067477  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:45.056474 10712 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:45.079778 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.089546 10712 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:45.090269 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:45.097920 10039 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:45.046141 16588 rpcz_store.cc:276] 0709 13:18:43.277444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.277556 (+   112us) service_pool.cc:224] Handling call
0709 13:18:43.397746 (+120190us) ts_tablet_manager.cc:934] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
0709 13:18:43.668824 (+271078us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6c3de0ac 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f7caa 00007f3c6c3f7bd2 00007f3c7445c131
0709 13:18:44.776843 (+1108019us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:44.821611 (+ 44768us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:44.821746 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:44.916660 (+ 94914us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:44.917108 (+   448us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:44.981378 (+ 64270us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:45.023806 (+ 42428us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10041,"spinlock_wait_cycles":9693056,"tablet-copy.queue_time_us":106183,"thread_start_us":973507,"threads_started":2}
I20260709 13:18:45.126292 16588 tablet_copy_client.cc:806] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:45.127058 16588 tablet_copy_client.cc:670] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:45.128283 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:45.130172 16046 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:45.130456 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:45.130750 16046 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:45.143045 16572 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:45.206214 10712 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:45.131825 16046 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.228917 10039 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:45.207522 16572 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.244125 16499 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:45.273814 16572 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:45.274118 16499 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:45.332897 16499 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.334504 16499 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:45.347353 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:45.349546 16438 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:45.349941 16588 tablet_copy_client.cc:538] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:45.350164 16438 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:45.354789 16438 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:45.328941 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 54354.5us
I20260709 13:18:45.504637 16588 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:18:45.505836 16640 raft_consensus.cc:993] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
W20260709 13:18:45.545852 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 133778us
I20260709 13:18:45.564000 16477 raft_consensus.cc:1081] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:45.568656 10189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:18:45.569271 10189 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:45.569643 10189 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:45.575634 10113 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:45.581629 16644 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:45.582297 16644 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.584906 16644 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:45.586165 16643 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:45.594061 16572 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.600118 15699 raft_consensus.cc:993] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:45.600678 15699 raft_consensus.cc:1081] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:45.609951 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:45.615535 10189 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:45.616169 10182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:47762
I20260709 13:18:45.616911 10182 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:45.617316 10182 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.622080 10189 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:45.626657 16572 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:45.627296 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:45.627614 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:45.628155 10039 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:45.628453 10039 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:45.629187 10039 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:45.630496 10039 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:45.641930 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:45.644707 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45514.3us
I20260709 13:18:45.655918 10182 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.657343 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:45.666663 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:45.666718 16646 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:45.664826 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:45.667325 10107 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:45.692487 10107 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:45.721282 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:45.722121 16604 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:45.724912 10107 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:18:45.725342 10107 pending_rounds.cc:85] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 13
I20260709 13:18:45.725582 10107 pending_rounds.cc:107] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:18:45.725803 10107 raft_consensus.cc:2889] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.732848 16346 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:45.738374 10713 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:45.742455 10182 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:45.744434 10039 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:45.739609 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:45.750927 10033 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:45.753604 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:45.754317 10031 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.760748 16082 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:18:45.775885 16533 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:45.779886 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:45.780550 10709 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:45.780861 10709 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:45.781689 10709 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.783046 10709 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.778319 16533 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:45.789505 16533 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:45.798306 10712 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:45.800606 16263 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:45.827003 16604 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:45.844863 10709 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:45.846047 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:45.854046 10031 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:45.858311 10038 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:45.866000 16438 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:18:45.871299 10038 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:18:45.880396 16291 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:18:45.882521 16536 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:45.883807 16648 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:45.884267 16648 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:45.894253 16536 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:45.895376 16536 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.902072 16648 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:45.903702 16648 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:46.088260  9931 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:46.089449  9932 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 294) took 30002 ms (client timeout 15000 ms). Trace:
I20260709 13:18:46.109426  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:46.091198  9931 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:46.125015  9931 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 9 to 13, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 13 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:46.126914  9931 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.129777  9931 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 18 to 19, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.132272  9931 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.134697  9931 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 8 to 10, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 10 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.136871  9931 catalog_manager.cc:5697] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 20, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:46.096459  9932 rpcz_store.cc:269] 0709 13:18:16.125061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.125481 (+   420us) service_pool.cc:224] Handling call
0709 13:18:46.089311 (+29963830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:45.306286 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:45.306948 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:45.307000 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:45.307034 (+    34us) tablet.cc:662] Decoding operations
0709 13:18:45.433738 (+126704us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:45.456755 (+ 23017us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:45.456790 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:45.478601 (+ 21811us) tablet.cc:701] Row locks acquired
0709 13:18:45.478653 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:18:45.478840 (+   187us) write_op.cc:270] Start()
0709 13:18:45.478999 (+   159us) write_op.cc:276] Timestamp: P: 1783603125478771 usec, L: 0
0709 13:18:45.479035 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:18:45.479834 (+   799us) log.cc:844] Serialized 4806 byte log entry
0709 13:18:45.763878 (+284044us) op_driver.cc:464] REPLICATION: finished
0709 13:18:45.913969 (+150091us) write_op.cc:301] APPLY: starting
0709 13:18:45.914063 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:45.933278 (+ 19215us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:45.933384 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:45.947223 (+ 13839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:45.947547 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:18:45.947597 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:45.952051 (+  4454us) log.cc:844] Serialized 113 byte log entry
0709 13:18:45.966737 (+ 14686us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.970675 (+  3938us) write_op.cc:454] Released schema lock
0709 13:18:45.970752 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:45.975042 (+  4290us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.975091 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":149728,"apply.run_cpu_time_us":16980,"apply.run_wall_time_us":61049,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":93490,"prepare.run_cpu_time_us":10360,"prepare.run_wall_time_us":245754,"raft.queue_time_us":121118,"raft.run_cpu_time_us":10132,"raft.run_wall_time_us":101098,"replication_time_us":269287,"thread_start_us":329546,"threads_started":4,"wal-append.queue_time_us":120702}]]}
I20260709 13:18:46.144886  9931 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 16 to 18, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 18 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:46.159994  9931 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.166505 16588 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.173857 16588 tablet_bootstrap.cc:492] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:18:46.176323 16588 ts_tablet_manager.cc:1403] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.672s	user 0.041s	sys 0.017s
I20260709 13:18:46.174487  9931 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 23, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 23 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:46.188228 16588 raft_consensus.cc:359] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:46.184367  9931 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 17, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:46.195536  9931 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:46.196727 16588 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:18:46.199998 16588 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:46.207028 16588 ts_tablet_manager.cc:1434] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:18:46.214684 10113 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:46.217398 16536 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:46.218040 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-6a5cf83b6b34444eb97230c9c7106ca4 received from {username='slave'} at 127.0.0.1:53672
I20260709 13:18:46.218617 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-6a5cf83b6b34444eb97230c9c7106ca4 on tablet 6a5cf83b6b34444eb97230c9c7106ca4 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:46.275767 10038 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:46.279688 16533 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:46.292927 10712 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:46.295051 16536 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:46.449928  9931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 189) took 2082 ms. Trace:
W20260709 13:18:46.480602 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82906us
W20260709 13:18:46.487890 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 78372.3us
I20260709 13:18:46.490419 10038 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:46.451473  9931 rpcz_store.cc:276] 0709 13:18:44.367127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.370588 (+  3461us) service_pool.cc:224] Handling call
0709 13:18:46.449806 (+2079218us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:46.250593 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:46.251156 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:46.251191 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:46.251208 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:46.252331 (+  1123us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:46.252412 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:46.252443 (+    31us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:18:46.253497 (+  1054us) tablet.cc:701] Row locks acquired
0709 13:18:46.253517 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:46.253657 (+   140us) write_op.cc:270] Start()
0709 13:18:46.253772 (+   115us) write_op.cc:276] Timestamp: P: 1783603126253610 usec, L: 0
0709 13:18:46.253795 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:46.259923 (+  6128us) log.cc:844] Serialized 5259 byte log entry
0709 13:18:46.277284 (+ 17361us) op_driver.cc:464] REPLICATION: finished
0709 13:18:46.279866 (+  2582us) write_op.cc:301] APPLY: starting
0709 13:18:46.279954 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:46.297295 (+ 17341us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:46.299980 (+  2685us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:46.346160 (+ 46180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:46.346420 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:18:46.346467 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:46.368512 (+ 22045us) log.cc:844] Serialized 121 byte log entry
0709 13:18:46.370641 (+  2129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:46.375638 (+  4997us) write_op.cc:454] Released schema lock
0709 13:18:46.377495 (+  1857us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:46.390983 (+ 13488us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:46.391016 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16509,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":2266,"apply.run_cpu_time_us":18122,"apply.run_wall_time_us":111059,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54262,"num_ops":13,"prepare.queue_time_us":31916,"prepare.run_cpu_time_us":4275,"prepare.run_wall_time_us":11961,"replication_time_us":23204,"thread_start_us":27232,"threads_started":1}]]}
W20260709 13:18:46.660022 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 125912us
I20260709 13:18:46.627444 16669 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:18:46.670415  9935 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 16 to 18, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 18 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.672061  9935 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 13 to 14, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 14 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.674151  9935 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 10 to 14, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 14 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.689363  9935 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.691318  9935 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.694404  9935 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 12 to 17, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 17 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.700603  9935 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 16 to 17, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:18:46.706671 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 217825us
I20260709 13:18:46.716048  9935 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 10 to 12, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.717535  9935 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.719027  9935 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 13 to 15, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 15 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.737334  9935 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 10 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.738771  9935 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.744048  9935 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 13 to 20, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.746913  9935 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 8 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.750439  9935 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 10 to 15, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 15 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:46.794690 10712 raft_consensus.cc:1217] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEARNER]: Deduplicated request from leader. Original: 18.10->[20.11-20.11]   Dedup: 20.11->[]
I20260709 13:18:47.058758  9930 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 9 to 18, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 18 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.061688  9930 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.066661  9935 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 295) took 13708 ms (client timeout 15000 ms). Trace:
I20260709 13:18:47.071655  9930 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 15 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 21 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.082068  9930 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 15 to 16, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 16 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:47.080385  9935 rpcz_store.cc:269] 0709 13:18:33.358281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.375859 (+ 17578us) service_pool.cc:224] Handling call
0709 13:18:47.066581 (+13690722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:46.865180 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:46.865728 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:46.865764 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:18:46.865783 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:46.867124 (+  1341us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:46.867184 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:46.867212 (+    28us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:18:46.882295 (+ 15083us) tablet.cc:701] Row locks acquired
0709 13:18:46.882316 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:46.882476 (+   160us) write_op.cc:270] Start()
0709 13:18:46.882611 (+   135us) write_op.cc:276] Timestamp: P: 1783603126882427 usec, L: 0
0709 13:18:46.882634 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:46.896922 (+ 14288us) log.cc:844] Serialized 5970 byte log entry
0709 13:18:46.931941 (+ 35019us) op_driver.cc:464] REPLICATION: finished
0709 13:18:46.943159 (+ 11218us) write_op.cc:301] APPLY: starting
0709 13:18:46.943251 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:46.956996 (+ 13745us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:46.957105 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:46.979535 (+ 22430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:46.979815 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 13:18:46.979858 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:46.980167 (+   309us) log.cc:844] Serialized 139 byte log entry
0709 13:18:46.980947 (+   780us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:46.981097 (+   150us) write_op.cc:454] Released schema lock
0709 13:18:46.981149 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:46.981555 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:46.981583 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":356,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":10947,"apply.run_cpu_time_us":18205,"apply.run_wall_time_us":38400,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":86349,"prepare.run_cpu_time_us":5222,"prepare.run_wall_time_us":36709,"replication_time_us":49140,"spinlock_wait_cycles":34048,"thread_start_us":36370,"threads_started":2}]]}
I20260709 13:18:47.085438  9930 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.087296  9930 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.090482  9930 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.097779  9930 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 15 to 17, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.107156  9930 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 13 to 18, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.172317  9931 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 13 to 14, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 14 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.174198  9931 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 20, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.175696  9931 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.240367  9931 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 16, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 16 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.241918  9931 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index -1 to 10, term changed from 18 to 20, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:18:47.243424  9931 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 16 to 18, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.253631 16686 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:47.254205 16686 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.259235 16686 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:47.260100 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:47.260772 10710 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:47.262282 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:47.264312 16571 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:47.264708 16571 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:47.265065 16571 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.280905 16571 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.283584  9930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 291) took 8420 ms. Trace:
I20260709 13:18:47.299376  9930 rpcz_store.cc:276] 0709 13:18:38.865486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.872429 (+  6943us) service_pool.cc:224] Handling call
0709 13:18:47.283509 (+8411080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:47.113001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:47.113524 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:47.113560 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:18:47.113573 (+    13us) tablet.cc:662] Decoding operations
0709 13:18:47.114483 (+   910us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:47.114542 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:47.114567 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:18:47.115290 (+   723us) tablet.cc:701] Row locks acquired
0709 13:18:47.115308 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:47.115432 (+   124us) write_op.cc:270] Start()
0709 13:18:47.115545 (+   113us) write_op.cc:276] Timestamp: P: 1783603127115395 usec, L: 0
0709 13:18:47.115567 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:47.116151 (+   584us) log.cc:844] Serialized 3646 byte log entry
0709 13:18:47.128951 (+ 12800us) op_driver.cc:464] REPLICATION: finished
0709 13:18:47.129298 (+   347us) write_op.cc:301] APPLY: starting
0709 13:18:47.129381 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:47.134561 (+  5180us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:47.134650 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:47.140849 (+  6199us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:47.141059 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:18:47.141101 (+    42us) write_op.cc:312] APPLY: finished
0709 13:18:47.141362 (+   261us) log.cc:844] Serialized 89 byte log entry
0709 13:18:47.141526 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.141656 (+   130us) write_op.cc:454] Released schema lock
0709 13:18:47.141704 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:47.142056 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.142082 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1330737,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":11498,"apply.run_wall_time_us":12716,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37566,"num_ops":9,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":3412,"prepare.run_wall_time_us":3412,"replication_time_us":12923}]]}
I20260709 13:18:47.285046 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:47.325387  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:47.327960 10031 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:47.383977  9934 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 17 to 19, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 19 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.385753  9934 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 18 to 20, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 20 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.393118  9934 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 17 to 22, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 22 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.401021  9934 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.409497 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:47.410400 10031 raft_consensus.cc:2393] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:47.406780  9934 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 20 to 21, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.423633  9934 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 15 to 16, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 16 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.425760  9934 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 13 to 23. New cstate: current_term: 23 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:18:47.430053 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 84129.3us
I20260709 13:18:47.439045 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:18:47.436902 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 92050.3us
I20260709 13:18:47.441430  9934 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.448925  9934 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 19. New cstate: current_term: 19 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.436920 16571 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:47.466215 10710 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:47.475569  9934 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 13 to 17, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 17 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.478753  9934 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 17 to 20, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 20 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.494084  9934 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 20 to 24, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 24 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.495715  9934 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 16 to 17, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.497429  9934 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 8 to 18, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 18 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.501296  9934 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 18 to 19, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 19 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.502764  9934 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 15 to 18, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 18 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.504424  9934 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 14 to 19, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 19 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:47.505859 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57826us
I20260709 13:18:47.522370 10079 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:47.529786 16695 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:47.530328 16695 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:47.522590 10112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "366d253a473243de9090f7b03b1c955b"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:47.531219 16695 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.532048 10112 raft_consensus.cc:606] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:47.532410 10112 raft_consensus.cc:614] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.552449 10112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:47.553143 10112 raft_consensus.cc:606] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:47.568972 16691 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.569564 16691 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.570417 16672 raft_consensus.cc:1064] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:18:47.572862 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:47.573911 16672 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.576663 16699 raft_consensus.cc:993] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:47.577337 16699 raft_consensus.cc:1081] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:47.603322 16691 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:47.595469 10182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39164
I20260709 13:18:47.607059 10182 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.607478 10182 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.614269 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:47.615188 10710 raft_consensus.cc:2410] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:18:47.616911 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:47.619104 16676 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:47.618824 10182 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.623019 10031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:18:47.623668 10031 raft_consensus.cc:606] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:47.639700 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:47.640470 10112 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:47.640808 10112 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:47.641601 10112 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.642779 10112 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.648048 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:47.648631 10710 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.650429 10110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:47.651041 10110 raft_consensus.cc:606] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:47.658771 10110 raft_consensus.cc:614] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.660025  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:47.661898  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:47.668898 10710 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:47.670166 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:47.671470 16436 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:47.672020 16436 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:47.672896 16436 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:47.647873 10182 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:47.700250 10112 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:47.722668 10710 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:47.724303 10182 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:47.725798 16695 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:47.726769 16694 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:47.736310 10031 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:47.740137 16695 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:47.777719 16691 raft_consensus.cc:993] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:47.778257 16691 raft_consensus.cc:1081] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:18:47.781792 10187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39166
I20260709 13:18:47.782388 10187 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.782716 10187 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.802922 10187 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:47.813791 10187 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:47.815948 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:47.816550 10112 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.823428 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:47.824311 10032 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:47.824630 10032 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:47.825359 10032 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:47.825906 16672 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index 10 to 12, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.827916 10182 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 10 to 12, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.838021 10112 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:18:47.842875 10032 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.845180 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:47.847340 16536 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:47.847893 16536 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:47.849119 16536 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:47.862021 10033 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 10 to 12, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.890383 10710 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 10 to 12, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:47.861917 10032 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:18:47.925472  9931 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 19 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.944550 10033 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:47.946470 16694 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:47.967572  9931 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 14 to 17, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:18:47.973342 10710 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:47.975184 16695 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:47.988657  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 290) took 3028 ms. Trace:
I20260709 13:18:47.989923  9934 rpcz_store.cc:276] 0709 13:18:44.956546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.957642 (+  1096us) service_pool.cc:224] Handling call
0709 13:18:45.014209 (+ 56567us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b5400002490. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c40b2 00007f3c7533da89 00007f3c752d5da6 00007f3c752a7088 00007f3c753a537e 00007f3c738662a4 00007f3c73866232 00007f3c73866161 00007f3c738660dc
0709 13:18:47.984543 (+2970334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:47.658157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:47.658671 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:47.658709 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:47.658725 (+    16us) tablet.cc:662] Decoding operations
0709 13:18:47.660100 (+  1375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:47.660157 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:47.660183 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:47.661335 (+  1152us) tablet.cc:701] Row locks acquired
0709 13:18:47.661350 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:47.661501 (+   151us) write_op.cc:270] Start()
0709 13:18:47.661633 (+   132us) write_op.cc:276] Timestamp: P: 1783603127661457 usec, L: 0
0709 13:18:47.661655 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:47.662318 (+   663us) log.cc:844] Serialized 6746 byte log entry
0709 13:18:47.673989 (+ 11671us) op_driver.cc:464] REPLICATION: finished
0709 13:18:47.674410 (+   421us) write_op.cc:301] APPLY: starting
0709 13:18:47.674495 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:47.727541 (+ 53046us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:47.727637 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:47.848321 (+120684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:47.848587 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:18:47.848637 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:47.849026 (+   389us) log.cc:844] Serialized 156 byte log entry
0709 13:18:47.849202 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.849363 (+   161us) write_op.cc:454] Released schema lock
0709 13:18:47.849416 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:47.849802 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.849830 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":13292672,"child_traces":[["op",{"apply.queue_time_us":135,"apply.run_cpu_time_us":22116,"apply.run_wall_time_us":175357,"cfile_cache_hit":68,"cfile_cache_hit_bytes":70958,"num_ops":17,"prepare.queue_time_us":5451,"prepare.run_cpu_time_us":4467,"prepare.run_wall_time_us":6010,"replication_time_us":12212}]]}
W20260709 13:18:48.002379 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 82566.8us
I20260709 13:18:48.037348  9930 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 10 to 12, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:48.069707 10110 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:18:48.073825 16670 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:48.132560  9930 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:48.208503 10710 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:18:48.214104 16536 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:48.240602 10033 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:48.249375 16436 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:48.254135 10112 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:48.257440 16436 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:48.300165  9931 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 20, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:48.368911  9930 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 21 to 22, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 22 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:18:48.396626  9936 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 289) took 19428 ms (client timeout 15000 ms). Trace:
W20260709 13:18:48.397042  9936 rpcz_store.cc:269] 0709 13:18:28.964241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.964428 (+   187us) service_pool.cc:224] Handling call
0709 13:18:48.392754 (+19428326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3771129,"reported_tablets":50}
W20260709 13:18:48.516369  9937 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 289) took 56607 ms (client timeout 15000 ms). Trace:
W20260709 13:18:48.516834  9937 rpcz_store.cc:269] 0709 13:17:51.909215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.916005 (+  6790us) service_pool.cc:224] Handling call
0709 13:18:48.516144 (+56600139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1223509,"reported_tablets":49}
W20260709 13:18:48.552109 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 123474us
W20260709 13:18:48.647296  9938 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 290) took 30042 ms (client timeout 15000 ms). Trace:
I20260709 13:18:48.663395  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:48.672087  9938 rpcz_store.cc:269] 0709 13:18:18.605340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.605561 (+   221us) service_pool.cc:224] Handling call
0709 13:18:48.647098 (+30041537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459956,"reported_tablets":49}
I20260709 13:18:48.707782  9935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 296) took 1510 ms. Trace:
I20260709 13:18:48.715787  9935 rpcz_store.cc:276] 0709 13:18:47.197305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.197419 (+   114us) service_pool.cc:224] Handling call
0709 13:18:48.707692 (+1510273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128233,"reported_tablets":42,"spinlock_wait_cycles":9600}
I20260709 13:18:48.780972 10112 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:48.812558 10713 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:48.814419 16678 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:48.827423 10187 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:48.828907 16672 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:48.841194 10713 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:48.843290 16678 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:48.934756  9933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 293) took 56271 ms (client timeout 15000 ms). Trace:
W20260709 13:18:48.935932  9933 rpcz_store.cc:269] 0709 13:17:52.663390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.664036 (+   646us) service_pool.cc:224] Handling call
0709 13:18:48.934650 (+56270614us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32387,"reported_tablets":50}
I20260709 13:18:48.965531  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a5cf83b6b34444eb97230c9c7106ca4 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:48.970063  9933 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 12 to 13, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.984153 10182 raft_consensus.cc:2955] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:49.168197 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a5cf83b6b34444eb97230c9c7106ca4 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:39406
I20260709 13:18:49.188620 16726 tablet_replica.cc:333] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:18:49.208026 16726 raft_consensus.cc:2243] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:49.210122 16726 raft_consensus.cc:2272] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:49.215216 16726 ts_tablet_manager.cc:1916] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:49.249086 16726 ts_tablet_manager.cc:1929] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.12
I20260709 13:18:49.249663 16726 log.cc:1199] T 6a5cf83b6b34444eb97230c9c7106ca4 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/6a5cf83b6b34444eb97230c9c7106ca4
I20260709 13:18:49.251793  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 6a5cf83b6b34444eb97230c9c7106ca4 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
W20260709 13:18:49.680203 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 114590us
I20260709 13:18:49.995707  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.084565 10182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:44554
I20260709 13:18:50.085216 10182 raft_consensus.cc:606] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:50.088500 10182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:44554
I20260709 13:18:50.089077 10182 raft_consensus.cc:606] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Received request to transfer leadership to TS fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:50.090451  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:50.092182  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:50.093583 16708 raft_consensus.cc:993] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:50.094106 16708 raft_consensus.cc:1081] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:50.099334 10110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:18:50.099972 10110 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.100347 10110 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.109032 10110 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:50.112178 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:50.112813 10182 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:50.113085 10182 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:50.113830 10182 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:50.114892 10182 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.123896 10110 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:50.124953 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:50.129244 10713 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.142999 10713 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:50.125726 10182 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:50.209940 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:50.213593 16672 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:50.214162 16672 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:50.215039 16672 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:50.324648  9938 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 16 to 17, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.321390 16748 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.327368 16748 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.331391 16748 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.323666 16749 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.334873 16749 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.372678 16741 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.373421 16741 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.375892 16741 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.425025 16730 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.425931 16730 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.429487 16730 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.439481 16730 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.440145 16730 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.442507 16730 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.474758 16744 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.475595 16744 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.478129 16744 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.479326 16744 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.487097 16741 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.742053 16741 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.742596 16751 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.743305 16751 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.744688 16741 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.745792 16751 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.746403 16751 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.746527 16741 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.502440 16678 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.746901 16751 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.747371 16678 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.748678 16753 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.749251 16753 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:51.749711 16678 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.565812 16721 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.750622 16721 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.752956 16721 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.570837 16729 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.753726 16729 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.575249 16685 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.756058 16685 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.758322 16685 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.760107 16729 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.760716 16729 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.761179 16729 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.762748 16752 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.763180 16729 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.588061 16746 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.764403 16721 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.764364 16746 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.765071 16721 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.766983 16746 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.590752 16749 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.607944 16745 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.614547 16742 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.768070 16685 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.615276 16739 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.768615 16685 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.768929 16739 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.771057 16685 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.771358 16739 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.764647 16741 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.625377 16731 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.773566 16731 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.775374 16685 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.775988 16685 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.777061 16731 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.777877 16731 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.778296 16685 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.778855 16739 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.779469 16739 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.781921 16739 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.619457 16708 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.782745 16708 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.785121 16708 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.633603 16672 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.788683 16672 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.791242 16678 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.791990 16678 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.794286 16678 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.794916 16678 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.795440 16678 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.797688 16678 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.666904 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.676386 16747 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:51.709518  9969 debug-util.cc:398] Leaking SignalData structure 0x7b0800316be0 after lost signal to thread 8942
I20260709 13:18:51.871174 16763 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.870828 16747 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.712304 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.871771 16763 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.767485 16721 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.768497 16742 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.874068 16747 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.874567 16747 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.874960 16747 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.734722 16750 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.875133 16742 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.626309 16740 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.875639 16750 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.876116 16740 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.876952 16678 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.877490 16678 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.778441 16731 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.878283 16740 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.878970 16721 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.879671 16731 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.879475 16721 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.880200 16731 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.880666 16731 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.786399 16741 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.798175 16729 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.881855 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:51.786984 16745 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.882706 16731 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.656985 16730 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.801915 16755 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.883402 16730 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.883549 16755 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.884459 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:51.885767 16755 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.886332 16755 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.802084 16672 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.804930 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.805258 16757 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.808168 16708 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.810499 16753 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:51.814080 16744 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.819299 16758 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.819921 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.763343 16752 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.822302 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.823112 16759 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.819855 16751 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.886457 16730 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.920468 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.924626 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.925803 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.926925 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.883074 16749 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.861789 16765 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.861960 16756 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.863404 16767 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.868491 16761 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.869053 16754 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.933698 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.869712 16760 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:51.872557  9969 debug-util.cc:398] Leaking SignalData structure 0x7b08003315e0 after lost signal to thread 9972
I20260709 13:18:51.870739 10181 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:51.872759 16762 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.626962 16436 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.935971 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.664299 16743 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.936928 16743 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.767620 16746 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.937587 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.906312 10185 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:51.938158 16754 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.939180 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:51.823813 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48533us
I20260709 13:18:51.939484 16743 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.940071 16743 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.877872 16750 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.911828 16759 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.937958 16746 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.942721 16746 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.942909 16741 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.943209 16672 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.911734 16697 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.943540 16741 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.914837 16752 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.944047 16742 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.944490 16752 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.944173 16750 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.908358 16740 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.945308 16750 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.945434 16740 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.940485 16743 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.937919 16756 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.915443 16758 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.916251 16755 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.947618 16740 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.944818 16742 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.945600 16762 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.949216 16755 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.942653 16759 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.909916 16757 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.950150 16742 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.950666 16742 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.951121 16742 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.951469 16757 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.910079 16708 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.943696 16672 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.953537 16708 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.953866 16672 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.949357 16756 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.882241 16729 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.920044 16744 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.959328 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.932489 16749 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.935925 16436 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.800678 16739 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.947414 16750 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.898100 16731 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.883376 16748 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:51.913031 16763 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.954741 10186 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:51.959667 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:51.942972 16753 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.973152 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:51.979149 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.954474 16672 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:51.940548 16754 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.945710 16741 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.984303 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.947582 16743 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:51.959095 16755 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:51.987371 10110 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:51.987792 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:51.988966 10181 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:51.988471 16436 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.988317 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.945030 16752 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.991816 16753 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.944039 16697 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.982352 16739 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:51.986658 16731 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:51.948634 16761 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.006788 16752 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.007419 16739 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:51.999779 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:51.978962 16744 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.004117 16436 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.005402 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.006155 16754 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.008270 16758 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.957823 16760 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.019397 16753 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.009765 16729 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.020844 16760 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.012116 16436 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.008558 16761 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.008984 16770 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.992208 16672 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.012841 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.006640 16697 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:51.987207 16730 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:51.988174 16748 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.014794 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.012351 10183 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:52.013381 16754 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.033850 16754 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.034209 16436 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.016266 16740 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.029796 16685 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.015692 16744 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.034973 16685 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.035678 16747 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.036981 16744 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.038479  9938 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 301) took 1742 ms. Trace:
I20260709 13:18:52.038862 16748 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.018857 16643 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.029769 16770 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.022771 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:51.137974  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.025441 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:51.958630 16765 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.031365 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.046500 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.046681 10112 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:18:52.034866 16740 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.041976 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.049989 16436 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.050262 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.050416 10032 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:51.990703 16678 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.055764 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.050886 16436 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.044760 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.025961 16739 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.009341 16755 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.047817 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.048323 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.053926 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.051635 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.038674 16672 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.040061 16643 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.036986 16685 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.072860 16770 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.056346 16746 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.055406 16697 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.077873 16697 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.079349 16643 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.080189 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.080843 10037 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:52.080950 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.071645 16742 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.071314 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.075084 16436 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.076351 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.081583 10110 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:52.079983 16739 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.092064 16739 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.092235 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.092919 10040 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:52.093770 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.050304 16762 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.094848 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.100292 16745 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.101351 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.102454 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.104048 16697 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.087507 16740 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.105278 16758 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.106040 16750 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.106590 16750 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.105901 16758 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.067425 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.108305 10031 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:52.108767 16750 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.109231 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.109566 16758 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.105862 16672 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.110370 16672 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.110810 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.112422 16672 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.107070 16761 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.113332 16761 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.093984 16765 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.114394 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.114823 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.115381 16761 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.115423 10711 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:52.116087 16749 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.058640 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.117822 10032 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:18:52.119249 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.120437 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.098282 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.081719 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.070572 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.083676 10183 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:52.055610 16748 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.058622 16731 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.077454 16746 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.071175 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.086321 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.087147 16755 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.059576 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.088493 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:51.964341 16767 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.084710 10114 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:52.076058 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.054324 16730 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.153759 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.153870 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.159351 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.174017 10110 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:52.175630 10181 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:52.084527 10107 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:52.143131 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.153913 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.143611 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.155998 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.128727 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.178848 10032 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:18:52.153443 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.153453 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.103439 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.180161 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.176328 10106 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
W20260709 13:18:52.173990  9969 debug-util.cc:398] Leaking SignalData structure 0x7b080008a200 after lost signal to thread 10064
I20260709 13:18:52.175558 10036 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:52.181517 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:52.183251  9969 debug-util.cc:398] Leaking SignalData structure 0x7b0800091840 after lost signal to thread 10139
W20260709 13:18:52.183573  9969 debug-util.cc:398] Leaking SignalData structure 0x7b0800091800 after lost signal to thread 10140
W20260709 13:18:52.184837  9969 debug-util.cc:398] Leaking SignalData structure 0x7b08003efde0 after lost signal to thread 10213
I20260709 13:18:52.176604 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.142740 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.175786 10037 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:18:52.173450 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.187381 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.152416 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:52.186300  9969 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd860 after lost signal to thread 10740
I20260709 13:18:52.178208 10180 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:52.236215 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.273056 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.455278 10712 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:52.270156 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.234921 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.233840 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.082087 16721 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.355309 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.253029 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.403837 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.244619 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.446488 16774 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.266819 10003 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.233700 16767 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:52.400662 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.152172 16749 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.244465 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.302681 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.402952 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.402944 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.234048 16768 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.235873 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.232584 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.267241 16771 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.232954 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.283463 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.313102 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.229915 16754 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.235535 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.235628 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.235443 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.294605 16775 raft_consensus.cc:993] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower fd3903ba079e4f47aaf0aa4432382c23 to start an election
W20260709 13:18:52.188633 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 45598.7us
I20260709 13:18:52.237625 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.230491 16746 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.230659 16748 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.238142 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.313344 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.231313 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.272279 10032 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:52.252323 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.269917 16755 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.307467 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.188212 16762 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.260597 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.455725 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.482817 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.483960 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.239759 10113 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:52.284227 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.237597 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.265107 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.485548 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.038868  9938 rpcz_store.cc:276] 0709 13:18:50.296325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.319788 (+ 23463us) service_pool.cc:224] Handling call
0709 13:18:52.038412 (+1718624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:50.339596 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:50.340176 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:50.340211 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:50.340228 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:50.340548 (+   320us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:50.340622 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:50.340649 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:50.340841 (+   192us) tablet.cc:701] Row locks acquired
0709 13:18:50.340864 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:50.341008 (+   144us) write_op.cc:270] Start()
0709 13:18:50.341109 (+   101us) write_op.cc:276] Timestamp: P: 1783603130340956 usec, L: 0
0709 13:18:50.341128 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:50.341826 (+   698us) log.cc:844] Serialized 536 byte log entry
0709 13:18:50.436880 (+ 95054us) op_driver.cc:464] REPLICATION: finished
0709 13:18:50.456662 (+ 19782us) write_op.cc:301] APPLY: starting
0709 13:18:50.456762 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:50.458001 (+  1239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:50.458119 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:50.458863 (+   744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:50.459126 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:18:50.459175 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:50.459400 (+   225us) log.cc:844] Serialized 25 byte log entry
0709 13:18:50.461095 (+  1695us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.461193 (+    98us) write_op.cc:454] Released schema lock
0709 13:18:50.461245 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:50.778783 (+317538us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.778819 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":19479,"apply.run_cpu_time_us":3623,"apply.run_wall_time_us":322092,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":11843,"prepare.run_cpu_time_us":3162,"prepare.run_wall_time_us":8927,"raft.queue_time_us":76096,"raft.run_cpu_time_us":5226,"raft.run_wall_time_us":19797,"replication_time_us":95589,"thread_start_us":112673,"threads_started":4,"wal-append.queue_time_us":4206,"wal-append.run_cpu_time_us":24782,"wal-append.run_wall_time_us":1114071}]]}
I20260709 13:18:52.241382 16730 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.403334 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.457868 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.459339 16752 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:52.459422 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 104209us
I20260709 13:18:52.471184 16731 raft_consensus.cc:1081] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Signalling peer fd3903ba079e4f47aaf0aa4432382c23 to start an election
I20260709 13:18:52.499537 16752 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.481067 16762 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:52.500680 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 263265us
I20260709 13:18:52.500026 16752 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.501547 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:52.501703 16762 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.467240 16776 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.503257 16776 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.475405 10111 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:52.474535 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.466351 16771 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.504944 16761 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.501086 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.506079 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.466611 16749 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.506563 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.506908 16771 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.462426 16774 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.504417 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.460917 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.507252 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.508471 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.508970 16774 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.462340 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.509887 10189 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:52.510185 16731 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:52.510661 16731 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.510895 16749 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.511104 16731 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:52.510562 16771 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.479959 16755 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.511687 16771 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.465545 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.462932 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.512589 16756 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.513021 16756 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.513345 16755 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.513373 16756 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.465126 16768 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.514235 16768 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.473184 10187 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 11.
I20260709 13:18:52.468007 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.474140 10714 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:52.459216 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:52.512262 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 247240us
I20260709 13:18:52.480566 10106 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 13.
I20260709 13:18:52.469089 10031 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.518105 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.509794 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:52.467067 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 200263us
I20260709 13:18:52.519093 10713 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:52.516752 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.479403 10711 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:52.460014 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.456522 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.464823 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.468379 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.466343 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.472822 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.520960 10180 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:18:52.467945 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.472105 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.503621 16776 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.505837 16761 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:52.512161 10036 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:18:52.505337 16767 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:52.474898 16748 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.456274 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.470541 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.469381 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.476812 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.477857 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.524380 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.469223 10716 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
W20260709 13:18:52.528923 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 56910.7us
I20260709 13:18:52.528925 10153 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.528122 16761 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.530006 10081 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.531248 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.532114 10079 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.532827 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.549134 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.534296 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.550611 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.551019 10081 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.534657 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:52.553184 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.553825 16436 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.530822 16767 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.554196 16436 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.554580 16436 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.554610 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.512616 16771 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.551663 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.555349 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.556237 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.559347 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.560997 10081 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.561182 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.470479 16754 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.563566 16685 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:52.564177 16763 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:52.564584 16763 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.564935 16763 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:52.566068 16685 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.566565 16685 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.534073 16678 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:52.555599 16775 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.568305 16775 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.568672 16775 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.557245 16750 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:52.572718 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64537.1us
I20260709 13:18:52.557432 16767 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.573778 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.575383 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.580273 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.580621 16672 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.581413 16672 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.584414 16756 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.585770 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.586630 16756 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.586938 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.555234 16741 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.587613 16741 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.567634 16769 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:52.598954 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.588376 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:52.588620 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.533838 16761 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:52.590083 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.555729 16740 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:52.593688 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.534475 16746 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:52.595444 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 43858.1us
I20260709 13:18:52.600071 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.602299 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.602535 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.528303 16721 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.613441 16721 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.613978 16721 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.604311 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.596949 16678 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.596839 16772 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:18:52.609123 16765 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:52.587954 16757 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:52.609884 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.620556 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.596792 16741 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.612514 16745 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:52.603096 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.609129 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.622576 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.615586 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.613160 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.587421 16752 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.626475 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.617863 16436 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.618706 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:52.598423 16672 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:52.598094 16769 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.622349 16740 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.654656 16740 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.655150 16740 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.656984 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.626353 16745 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.658670 16745 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:52.659381 16743 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:52.659917 16743 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.660292 16743 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.661865 16685 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.613164 16766 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.629961 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.631980 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.626710 16678 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:52.632963 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.634066 16752 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.620218 16765 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.689808 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.635993 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.688621 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.636621 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.636395 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.691368 10182 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:52.621891 16757 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.691951 16757 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.630920 16753 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.622148 16749 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:52.619581 16758 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:18:52.663699 10003 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:52.673146 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 116986us
I20260709 13:18:52.677390 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.699128 16436 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.701274 10153 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:52.705803 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.706822 10181 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:52.708392 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.709811 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.710145 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.635711 16672 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.688721 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:52.664166 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 105890us
I20260709 13:18:52.696388 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.710592 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.663203 16769 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.698405 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.704990 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:52.680817 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 84927.5us
I20260709 13:18:52.709448 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:52.721312 10081 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.722530 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.717864 10003 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.720288 10716 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:52.723948 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:52.725612 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.727319 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.728152 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.696023 16765 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:52.728785 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.735998 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.736285 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.737031 16436 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.737416 16436 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.737721 16436 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.698325 16753 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.699790 16749 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:52.717188 16762 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:52.721180 16672 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.727450 16678 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:52.750564 16678 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.750968 16678 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.753085 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:52.754601 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:52.755159 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.741787 16756 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.756026 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.758159 16756 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.758555 16756 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:52.758893 16756 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.747185 16762 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.760154 16762 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.750026 16685 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.745489 16753 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.727669 16730 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.765426 16730 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.765935 16730 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.772420 16772 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:52.772941 16772 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.773363 16772 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.750026 16754 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.775969 16754 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.776388 16754 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.773460 16731 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.724313 16785 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.779806 16731 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.781622 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.746917 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:52.782055 16749 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.767563 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.762408 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:52.796746 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 87379.4us
I20260709 13:18:52.801069 10155 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:52.799974 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 79495us
I20260709 13:18:52.802742 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.804859 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.810129 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.811420 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.812700 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.813970 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:52.814343 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.822026 16757 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.823302 16769 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.839062 16769 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.844928 16730 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.827031 16772 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.828888 16672 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.825446 16745 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.829530 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:52.796380 16749 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:52.861608 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 125679us
I20260709 13:18:52.834800 16678 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.835888 16776 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.835863 10679 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:52.846318 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45348.1us
I20260709 13:18:52.847137 16436 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.830880 16761 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.833384 16763 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.866235 10708 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:52.866739 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.845546 16757 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.864133 16765 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.870731 16773 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:52.872113 16765 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.835322 16754 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.873629 16763 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.874250 16754 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.862406 16771 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.875042 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.876897 16771 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.877076 16766 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:52.877568 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.878086 16761 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:52.867616 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64795.6us
I20260709 13:18:52.868464 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:52.881176 16771 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:52.882779 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:52.883630 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.883790 16771 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:52.862913 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:52.885389 10155 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:52.887072 16771 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:52.889204 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:52.848489 16752 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:52.893217 16436 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.890883 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:52.890504 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 150636us
W20260709 13:18:52.891378 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 53463.5us
I20260709 13:18:52.896349 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:52.896842 10114 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:52.878741 16761 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:52.899066 10113 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:52.867274 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.901432 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.899322 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.902302 10110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:18:52.902716 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.903012 10110 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.903460 10110 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.904717 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.905809 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.906461 16672 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.906239 16767 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.906805 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.910883 16772 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.890074 16769 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:52.913244 16769 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:52.862205 16743 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.913605 16768 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.853602 16740 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.898691 16756 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.918679 16730 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.919340 16730 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:52.919672 16776 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.920961 16678 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.921622 10107 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:52.921940 16762 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.898558 16761 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:52.924986 16745 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.890409 16777 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:52.929404 10111 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:52.931077 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:18:52.932160 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 69330.8us
I20260709 13:18:52.932905 10716 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:18:52.927815 16777 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.930764 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.936607 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.936939 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:52.938354 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 215889us
I20260709 13:18:52.939873 16762 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.942723 16678 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:52.915524 16768 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.944873 10113 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:52.947731 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.948334 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.945497 10111 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:52.853060 16775 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.913635 16769 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.963718 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.964860 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.965111 10188 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:52.966377 10188 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:52.951618 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.968580 16785 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:52.952606 10187 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:52.955664 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.925196 16761 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.955580 16697 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.972398 16761 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.972458 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.973208 16697 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:52.973655 16697 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.973883 16790 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.976239 10034 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:52.972060 16768 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.978895 16789 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:52.979067 16721 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:52.980082 10109 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:52.980023 16789 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:52.980603 16789 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:52.981101 16767 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.930619 16771 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:52.981912 10106 raft_consensus.cc:1240] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:52.982671 16756 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:52.982445 16789 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.984119 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.984329 16789 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.934892 16792 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:52.964821 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.915637 16743 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.957191 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:52.957778 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.955253 10181 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.960016 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.960932 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:52.954593 16753 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:52.986241 16741 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:52.990237 10112 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.978117 16775 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:52.991086 16753 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:52.945163 16763 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:52.991981 16763 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:52.952829 16777 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.992372 16763 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:52.993170 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:52.951859 16770 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.994850 10034 raft_consensus.cc:1240] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:52.966336 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:52.997987 16749 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:52.999145 16749 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:52.999472 16749 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.008862 10081 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.009037 16762 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.009863 16678 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:53.010280 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.010326 16776 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:53.010447 16761 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.011049 16776 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.002848 16643 consensus_queue.cc:1059] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:53.012104 16776 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.013542 16780 raft_consensus.cc:3055] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:53.013958 16780 raft_consensus.cc:740] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:52.980226 16740 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:53.007687 16791 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:53.010325 16678 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:53.016086 16678 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:53.016408 16791 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:53.016822 16791 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.017563 16757 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.018556 16757 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:53.019280 16765 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:53.019636 16765 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.014806 16780 consensus_queue.cc:260] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.021813 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.022446 10035 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:52.978042 10185 raft_consensus.cc:1240] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:52.949348 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 46688.9us
I20260709 13:18:52.995357 16731 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:53.024588 16752 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:53.000588 16741 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:18:53.020622 16765 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.034066 16765 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:53.034348 16678 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.027820 10115 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:53.036731 16678 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:53.028569 16780 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.006672 16769 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.028971 16788 consensus_queue.cc:1059] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:53.039583 16788 raft_consensus.cc:3055] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:53.040392 16788 raft_consensus.cc:740] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.030176 16731 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.041308 16788 consensus_queue.cc:260] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.041579 16731 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:53.027073 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 70823.8us
I20260709 13:18:53.008193 16763 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.029814 16721 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:53.030237 16752 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.030742 16776 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:53.032456 16748 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:53.019858 16791 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:53.009832 16749 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.040580 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.042725 16793 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:53.044992 10185 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.042941 16762 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:18:53.060153 16793 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:53.058635 16791 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:53.058718 16749 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:53.047370 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.051978 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:53.063792 10112 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:53.052574 10188 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:53.064913 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 170004us
I20260709 13:18:53.053107 10110 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.055367 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.055493 16752 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.056058 10033 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:53.068655 10188 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:53.057152 16763 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:53.057631 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:53.054797 16748 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:53.052727 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.065774 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.065821 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.072331 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.063844 16777 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.075229 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.075462 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.076510 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.074898 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.054704 16787 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:18:53.077910 16739 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:53.064471 16762 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:53.090304 16762 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.091388 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.091475 16762 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.092080 16730 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.092797 16762 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.093351 16730 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:53.093744 16730 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.094528 16730 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.073141 16774 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.090282 10112 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:53.091821 16643 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.071060 16748 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.096728 16643 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:53.095866 16757 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.098397 16788 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.097796 16748 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.078068 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.081265 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.102638 16678 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.104212 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.104614 10033 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:53.106051 10110 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:53.110420 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.111595 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.112084 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.113045 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.117177 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.117486 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.117834 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.097831 16643 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:53.109220 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:53.122344 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47193.9us
I20260709 13:18:53.121506 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.119668 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.120072 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.123550 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.126274 10155 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.126425 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.126376 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.127382 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.099964 16748 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:53.099946 16730 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.130754 16685 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:53.131847 16685 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:53.102615 16746 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.133287 16746 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.077718 16775 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:53.074002 16731 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.128363 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.128666 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.183645 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.184223 10711 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.136236 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.121984 16643 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.124133 16757 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:53.090433 16697 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.116925 16769 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:53.125329 16752 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.189986 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.125861 16774 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:53.143167 16786 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:53.180889 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44017us
I20260709 13:18:53.125597 16740 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:53.185068 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64773.1us
I20260709 13:18:53.132177 16754 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:53.128578 16772 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.201241 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.183353 16787 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:18:53.202142 10185 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:53.206707 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:53.188179 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52001.1us
I20260709 13:18:53.182343 16743 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.180702 16785 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:53.194962 16754 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.209050 16785 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.181022 16770 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:53.209579 16770 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.210466 16787 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:53.210860 16787 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.211932 10712 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:53.211659 16785 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.213212 16785 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:53.214475 10711 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:53.134979 16756 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:18:53.189368 16771 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:53.124774 16765 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:18:53.193324 16643 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.241880 10079 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:53.242729 16793 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:53.196341 10188 raft_consensus.cc:1240] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:53.243242 16793 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.199278 16697 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:53.199771 10708 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.244378 16763 consensus_queue.cc:1059] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:53.209317 16757 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.245846 16771 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:53.245963 16757 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:53.246405 16757 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.211647 16787 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.209767 16754 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.242914 16643 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.247318 16757 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.247773 16754 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.249089 16763 raft_consensus.cc:3055] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:53.249468 16763 raft_consensus.cc:740] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.246332 16771 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.250262 16763 consensus_queue.cc:260] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.250658 16771 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:53.251292 16763 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.242065 16756 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:53.220112 16743 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.190379 16741 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.210402 16770 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.253000 16770 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.208113 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.227126 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:53.257190 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49177us
I20260709 13:18:53.258893 16757 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:53.259918 16786 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.188834 16739 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.261978 16771 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.263804 16741 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.192201 16678 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:53.238698 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 159324us
I20260709 13:18:53.244159 16793 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.265926 10110 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:53.218604 16745 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:53.251986 16756 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.261647 16739 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.191849 10081 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.275236 16756 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.276563 16756 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:53.274606 16678 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:53.278111 16678 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.225812 16777 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:53.267886 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:18:53.274163 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.278106 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86346.1us
I20260709 13:18:53.278258 10040 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:53.280472 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.283336 16678 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.284710 16678 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:53.286193 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.289059 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.294740 16765 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:53.296087 16743 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:53.296458 16743 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.297235 16743 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.301193 16800 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.302460 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.302838 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.302377 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.278961 16745 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:53.307922 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.313494 10180 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
I20260709 13:18:53.326385 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.327911 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.329274 10708 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:53.332206 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.332949 16754 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.340583 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.340780 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.341208 10183 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:53.342355 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.343474 10036 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.344360 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.346462 10185 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 25.
W20260709 13:18:53.347808 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 217862us
I20260709 13:18:53.341517 10183 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.349772 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.350548 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.350983 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.350025 10081 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:53.325726 16730 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.354746 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.358366 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.325503 16741 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.359009 10180 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:18:53.360507 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.360786 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.361070 16643 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.361902 16776 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.362020 16801 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.363222 10040 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:53.334160 16786 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:53.366856 16786 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.368081 10183 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.368983 16762 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.369328 10183 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.352407 16800 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:53.371937 16436 consensus_queue.cc:1175] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f672b54d4754c5aa62b5b919597a14e" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:53.374316 16786 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:53.359958 16791 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:53.382727 16743 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:53.380959 16773 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:53.385152 16768 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:53.354816 16777 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.392611 10189 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
W20260709 13:18:53.398613 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.404321 10115 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:53.402391 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.409205 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.420212 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.421546 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.423115 16756 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:53.423537 16756 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.424446 16756 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.425791 16756 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.429569 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.430827 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.431959 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.432072 10187 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:53.437454 10183 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:53.415961 16773 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.439831 10112 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:53.442585 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.441241 10110 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:53.441344 10680 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.434556 16755 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.433034 16762 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:53.449097 16787 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.449852 16777 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:53.450912 16777 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:53.451263 16777 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.452111 16777 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.453315 16777 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:53.432884 16800 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.438794 16781 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:18:53.458957 10188 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:53.462709 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.463270  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:53.460875 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.460865 10184 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
W20260709 13:18:53.467856 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.409168 16801 consensus_queue.cc:1059] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:18:53.474196 10680 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.436968 16739 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.478986 16773 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.462124 16746 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.474834 16791 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:53.483044 16789 raft_consensus.cc:3055] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:53.485890 16790 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:53.476485 16697 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:53.485711 16781 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:53.492254 16643 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:53.495960 16789 raft_consensus.cc:740] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.501416 16781 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.498569 16790 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.461822 16800 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.501400 16697 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.503711 16790 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.504036 16697 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.505051 16790 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:53.494764 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.506999 16741 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:53.508656 16789 consensus_queue.cc:260] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.509992 16643 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:53.494939 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.510857 16643 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.502501 16781 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.512373 16781 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:53.517592 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.522447 16739 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.532306 16789 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.540819 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.541769 16739 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.542186 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:53.543362 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.544435 16800 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:53.544849 16800 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:53.545187 16800 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:53.549117 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.547501 10186 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
W20260709 13:18:53.551800 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 194056us
I20260709 13:18:53.552687 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.559722 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:53.564771 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.564061 16761 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:53.566356 16761 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.567260 16761 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.568732 16791 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:53.579911 16791 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.585747 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.585784 10110 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:53.586066 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.587837 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.588236 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.582340 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.589255 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.590705 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.591056 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.591490 10037 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:53.592078 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.592105 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.557304 16793 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:53.591612 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:53.598803 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:53.600651 10031 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:53.601631 10106 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:53.604575 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.606660 10109 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:53.610841 10040 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:53.611881 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.614934 10078 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.616122  9938 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 21 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.604102 16741 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:53.628294 16741 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.629215 16741 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.641341 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.642799 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.644579 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.645275 16678 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:53.645888 16678 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.646088 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.649353 10112 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:53.651007 10036 raft_consensus.cc:2468] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:53.653285 10110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:53.653327 10115 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:18:53.654074 10110 raft_consensus.cc:606] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.654450 10110 raft_consensus.cc:614] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:53.654991 10712 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:53.656106 16743 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.656876 16731 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.659317 16800 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.605778 16739 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.606688 16793 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.661504 16800 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:53.661909 16793 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.664937 10035 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:53.666610 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.667223 10716 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 12.
I20260709 13:18:53.668524 10711 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
W20260709 13:18:53.670424 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 48515.5us
I20260709 13:18:53.672418 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.673957 10078 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.666823 16756 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:53.674989 16750 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:53.675844 16678 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:53.678306 16756 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.680373 10186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:44554
I20260709 13:18:53.680961 10186 raft_consensus.cc:606] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:18:53.684757 16750 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.686859 16750 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.687956 16754 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:53.689088 16754 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:53.666406 16775 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.691705  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:53.693552  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:53.700029 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.679278 16731 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.704131 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.704998 16685 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:53.705703 16685 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.705365 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.706728 16685 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.707247 16798 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:53.707913 16798 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.708535 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.709360 16436 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.708817 16798 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.709942 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.710769 16436 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:53.711237 16436 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.712036 16436 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.713284 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:53.713321 10155 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.714892 16786 raft_consensus.cc:2804] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:53.715387 16786 raft_consensus.cc:697] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.716244 16786 consensus_queue.cc:237] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.717068 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.717801 10115 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:53.696377 16804 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:53.719723 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.691135 16756 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.722497  9935 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 19 to 20, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 20 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.722476 16731 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:53.724300 16731 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.725227 16731 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.722517 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.728241 16754 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:53.728736 16754 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.729563 16754 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.732075 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.698559 16790 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:53.736174 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.699288 16763 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:53.697693 16770 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:53.740137 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:53.740760 10115 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:53.752548 16791 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:53.753093 16730 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:53.754411 16730 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:53.754786 16730 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.723488 16787 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.765911 10184 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:53.747794 16800 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:53.756307 16739 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:53.748690 16763 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.756147 16770 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.776683 10708 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:53.759977 16790 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:53.778152 10004 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:53.777042 10712 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:53.755753 16730 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.791067 16730 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.791848 16685 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:53.792447 16685 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.793344 16685 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.777344 16800 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.779150 16739 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.782773 16761 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:53.809381 16741 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:53.830224 16739 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.844437 16790 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.848793 16800 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.804519 16770 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.805992 16763 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:53.923946 16740 raft_consensus.cc:993] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: : Instructing follower 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:18:53.924523 16740 raft_consensus.cc:1081] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Signalling peer 9a67604b91f54791b1316fd327793337 to start an election
I20260709 13:18:53.929872  9933 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 20 to 21, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.935201 16763 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.943015 10035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29"
dest_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:39418
I20260709 13:18:53.943773 10035 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.944152 10035 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.951793 10035 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.969312 10186 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.969810 10035 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:53.970674 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:53.971297 10188 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:53.971211 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:53.972136 10115 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.971629 10188 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:53.984787 10186 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:18:53.986534 10112 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:53.989308 16643 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:53.970820 16770 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.983311 10188 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:53.992570 10188 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.994277 10115 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:53.995649 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:53.998284 16762 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:53.998806 16762 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:53.999260 16731 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.998960 10188 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:53.999794 16731 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.001972 16731 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.003134 10035 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.004595 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.006001 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:54.019387 10711 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:54.016144 10188 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.024215 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:53.990696 16739 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:18:54.031838 10188 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:54.035847 16643 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:54.039551 16762 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.049474 10711 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:18:54.053334 16730 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:54.063149 10036 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:54.065285 16643 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:54.028661 16782 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.080457 10183 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:54.080528 10187 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:54.081367 10031 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:54.081691 16824 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:18:54.085666 10038 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:54.086062 10034 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:54.088907 16790 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:54.090195 10184 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:54.090399 16790 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:54.091109 16769 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.067974 16782 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.092088 16782 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.086915  9934 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 17 to 18, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 18 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.094635  9934 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 24 to 25, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 25 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.096602  9934 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 18 to 19, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.098081  9934 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 22 to 23, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 23 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.099493  9934 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 20 to 21, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.106797 10031 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:54.106395  9934 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 22 to 23, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 23 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:54.109674 16822 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 13:18:54.126184  9934 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 19 to 20, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.128716  9934 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 13 to 14, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 14 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.133769  9934 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 19 to 20, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.144730 16678 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:54.091638 16769 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:54.141963 16831 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:54.131157 16781 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.109076 16790 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:54.109918 16756 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:18:54.166167 16762 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:54.181414 10712 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:54.166635 16781 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.184161 16781 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.199935 10034 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:54.200480 10183 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:54.200546 16730 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.201180 16730 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.203044 16763 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:54.204177 10115 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.204698 16769 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.208865 10035 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:54.209488 10189 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:54.180505 16762 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:18:54.213869 16762 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.214680 16740 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:54.215296 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:54.216153 10180 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 20: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:54.217607 16730 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.220366 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:54.220906 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:54.214563 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:54.223093 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:54.224066 10189 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:54.224068 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:54.240918 10115 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:18:54.226619 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 118560us
I20260709 13:18:54.248407 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.249220 10034 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:54.251291 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.252061 10034 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
W20260709 13:18:54.223673 16825 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:54.259690 16678 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:54.260648 10081 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:54.238224 16754 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:54.262039 16678 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:54.264885 16678 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.265297 16678 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:54.199404 16782 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:54.266500 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 126572us
I20260709 13:18:54.262804 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:54.255594 16685 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.274722 10112 raft_consensus.cc:3060] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.278221 16678 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.249902 16763 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:18:54.290587 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:54.255848 16731 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:54.292089 16678 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.292349 10186 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
W20260709 13:18:54.292541 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 144243us
I20260709 13:18:54.297610 10189 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:54.298977 10189 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:54.300104 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:54.300971 10180 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:54.301564 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:54.301865 10112 raft_consensus.cc:1275] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:54.303928 10181 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:54.304672 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:54.257347 16800 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:18:54.304684 10187 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:54.311041 10115 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:54.311546 10189 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:54.291864 16761 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:54.319566 16436 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.322968 16761 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.325222 16761 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.323146 16436 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.320108 16792 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:54.348654 10186 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:54.353093 10037 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:54.358457 10712 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:54.360194 10186 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:54.361191 10037 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:18:54.442940 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 79982.6us
W20260709 13:18:54.444025 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 95020us
W20260709 13:18:54.443948 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97571.3us
I20260709 13:18:54.443734 16436 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:54.444212 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 87229.9us
I20260709 13:18:54.452589 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:54.453433 10712 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:54.460542 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:54.461351 10110 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
W20260709 13:18:54.465330 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63148.3us
I20260709 13:18:54.399852 16792 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.477160 10712 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:54.518008 10038 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:54.447103 16773 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:18:54.455192 16739 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:18:54.517448 16824 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:54.528048 16842 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:18:54.481130 16762 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
W20260709 13:18:54.553665 16844 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:54.553963 16858 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:54.554538 16843 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:18:54.530218 16782 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.561673 16762 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:54.561658 16748 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:18:54.529966 16769 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:54.568583 16762 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:54.573199 16762 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.574604 16762 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.554548 16750 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:54.544464 16756 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:18:54.603068  9938 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 199) took 1007 ms. Trace:
W20260709 13:18:54.610227 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.613372 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:54.616278 10037 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:54.623875 16731 consensus_queue.cc:1048] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:54.625167 10037 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:54.623411 16786 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:54.619015 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:54.626811 16786 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.628908 16731 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:54.629346 16731 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.629704 16731 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.631383 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:54.636420 16436 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.637105 16436 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.643821 16678 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.644469 16678 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.670400 16739 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:54.576068 16750 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:54.689697 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52270.8us
I20260709 13:18:54.603638  9938 rpcz_store.cc:276] 0709 13:18:53.595868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.596145 (+   277us) service_pool.cc:224] Handling call
0709 13:18:54.602974 (+1006829us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:53.820710 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:53.861406 (+ 40696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:53.861445 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:18:53.861462 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:53.861787 (+   325us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:53.861845 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:53.861871 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:53.862064 (+   193us) tablet.cc:701] Row locks acquired
0709 13:18:53.862077 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:18:53.862216 (+   139us) write_op.cc:270] Start()
0709 13:18:53.862325 (+   109us) write_op.cc:276] Timestamp: P: 1783603133862168 usec, L: 0
0709 13:18:53.862342 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:18:53.863040 (+   698us) log.cc:844] Serialized 536 byte log entry
0709 13:18:54.165629 (+302589us) op_driver.cc:464] REPLICATION: finished
0709 13:18:54.462054 (+296425us) write_op.cc:301] APPLY: starting
0709 13:18:54.462170 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:54.463419 (+  1249us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:54.463543 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:54.464315 (+   772us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:54.464530 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:18:54.464581 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:54.469379 (+  4798us) log.cc:844] Serialized 25 byte log entry
0709 13:18:54.480562 (+ 11183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.493517 (+ 12955us) write_op.cc:454] Released schema lock
0709 13:18:54.519178 (+ 25661us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:54.533207 (+ 14029us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.534633 (+  1426us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":229790,"apply.run_cpu_time_us":8971,"apply.run_wall_time_us":124502,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":141616,"prepare.run_cpu_time_us":33840,"prepare.run_wall_time_us":217969,"raft.queue_time_us":48215,"raft.run_cpu_time_us":15197,"raft.run_wall_time_us":99477,"replication_time_us":303122,"thread_start_us":347355,"threads_started":4,"wal-append.queue_time_us":208240}]]}
I20260709 13:18:54.708338 16436 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:54.717407 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 165700us
I20260709 13:18:54.730188 10708 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:54.734258 16678 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.736114 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.742738 16436 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:54.751919 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.754455 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:54.716703 16789 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.755887 10715 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:54.757824 10182 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.757318 10033 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:54.759352 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 314004us
I20260709 13:18:54.760182 10153 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:18:54.755337 16770 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.759s	user 0.006s	sys 0.015s
I20260709 13:18:54.769665 10112 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.773152 10111 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:54.782693 10109 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:54.742210 16740 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:18:54.790923 10182 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:54.794134 16857 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.794782 16857 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.799358 16857 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.799612 16792 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.783851 16782 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:54.763715 16789 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.759022 16730 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:18:54.781306 16859 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:54.783402 16741 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:18:54.809281 16685 consensus_meta.cc:287] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.007s
I20260709 13:18:54.809659 16750 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.810130 16748 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.815949 16748 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.821660 16789 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.811952 16786 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.819674 16685 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:54.819252 16748 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:54.827586 16761 consensus_meta.cc:287] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.013s
I20260709 13:18:54.873870 10039 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:54.876065 10038 raft_consensus.cc:2410] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:18:54.886075  9933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 297) took 1065 ms. Trace:
W20260709 13:18:54.887720 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 122150us
I20260709 13:18:54.893711 10037 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:54.909242 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.910260 10031 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:54.895252 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:54.911464 10038 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.912562 10109 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:54.900085 10106 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:54.901479 10081 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:54.888244  9935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 298) took 1171 ms. Trace:
I20260709 13:18:54.917497  9935 rpcz_store.cc:276] 0709 13:18:53.716378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.718418 (+  2040us) service_pool.cc:224] Handling call
0709 13:18:54.888017 (+1169599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:54.063184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:54.128198 (+ 65014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:54.128244 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:18:54.128259 (+    15us) tablet.cc:662] Decoding operations
0709 13:18:54.128620 (+   361us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:54.128676 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:54.128705 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:54.128904 (+   199us) tablet.cc:701] Row locks acquired
0709 13:18:54.128922 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:54.129120 (+   198us) write_op.cc:270] Start()
0709 13:18:54.129242 (+   122us) write_op.cc:276] Timestamp: P: 1783603134129039 usec, L: 0
0709 13:18:54.129264 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:54.129946 (+   682us) log.cc:844] Serialized 536 byte log entry
0709 13:18:54.799051 (+669105us) op_driver.cc:464] REPLICATION: finished
0709 13:18:54.799415 (+   364us) write_op.cc:301] APPLY: starting
0709 13:18:54.799509 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:54.800398 (+   889us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:54.800547 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:54.801330 (+   783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:54.801495 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:18:54.801543 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:54.801736 (+   193us) log.cc:844] Serialized 25 byte log entry
0709 13:18:54.804312 (+  2576us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.804382 (+    70us) write_op.cc:454] Released schema lock
0709 13:18:54.804425 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:54.804737 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.804765 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10402,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":122,"apply.run_cpu_time_us":2914,"apply.run_wall_time_us":5313,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":304434,"prepare.run_cpu_time_us":2907,"prepare.run_wall_time_us":94562,"replication_time_us":667365}]]}
I20260709 13:18:54.907073 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.934237 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
W20260709 13:18:54.936647 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 176378us
I20260709 13:18:54.811570 16731 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.907851  9933 rpcz_store.cc:276] 0709 13:18:53.820548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.821006 (+   458us) service_pool.cc:224] Handling call
0709 13:18:54.885808 (+1064802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:54.130439 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:54.141407 (+ 10968us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:54.142339 (+   932us) write_op.cc:435] Acquired schema lock
0709 13:18:54.144823 (+  2484us) tablet.cc:662] Decoding operations
0709 13:18:54.176688 (+ 31865us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:54.178752 (+  2064us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:54.179848 (+  1096us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:54.202908 (+ 23060us) tablet.cc:701] Row locks acquired
0709 13:18:54.202929 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:54.203114 (+   185us) write_op.cc:270] Start()
0709 13:18:54.203253 (+   139us) write_op.cc:276] Timestamp: P: 1783603134203060 usec, L: 0
0709 13:18:54.203275 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:54.599063 (+395788us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b540024af20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c741ce5c4 00007f3c6f45f5ab 00007f3c6f45f2fa 00007f3c6f4e3965 00007f3c6f4e3e09 00007f3c72f1e581 00007f3c72f1dd58 00007f3c72f229f1 00007f3c72f229a9 00007f3c72f22939 00007f3c72f22901
0709 13:18:54.772600 (+173537us) log.cc:844] Serialized 541 byte log entry
0709 13:18:54.822348 (+ 49748us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e3e28 00007f3c72f1e581 00007f3c72f1dd58 00007f3c72f229f1 00007f3c72f229a9 00007f3c72f22939 00007f3c72f22901 00007f3c72f21b2d 000000000038f354 000000000038f199
0709 13:18:54.827087 (+  4739us) op_driver.cc:464] REPLICATION: finished
0709 13:18:54.835952 (+  8865us) write_op.cc:301] APPLY: starting
0709 13:18:54.836037 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:54.836795 (+   758us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:54.836813 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:54.837435 (+   622us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:54.837603 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:18:54.837643 (+    40us) write_op.cc:312] APPLY: finished
0709 13:18:54.837814 (+   171us) log.cc:844] Serialized 25 byte log entry
0709 13:18:54.837967 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.838048 (+    81us) write_op.cc:454] Released schema lock
0709 13:18:54.838090 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:54.841116 (+  3026us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.841321 (+   205us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":8610,"apply.run_cpu_time_us":2453,"apply.run_wall_time_us":2453,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":144664,"prepare.run_cpu_time_us":20187,"prepare.run_wall_time_us":692079,"replication_time_us":623666,"spinlock_wait_cycles":197932800}]]}
I20260709 13:18:54.946013 16761 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.952987 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:54.955941 16731 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.957523 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:54.958638 10034 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:18:54.960536 16781 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:54.961375 16781 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:54.962260 16748 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:54.962873 16748 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:54.963339 16748 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:54.963016 16781 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:54.964061 16761 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:54.967123 10184 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:54.972821 16835 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.973898 16835 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.974745  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.981031 16739 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:54.981757 16765 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:54.982810 16765 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.984138 16786 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:54.985021 16786 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.985743 16765 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.986497 16765 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.987303 16765 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.984200 16762 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:54.990238 16765 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:54.992799 16849 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:54.994452 16863 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.995409 16863 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:54.996295 10039 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:54.992799 16837 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.989974 16798 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:54.967146 10183 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:55.011315 16730 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.012281 16730 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
W20260709 13:18:55.016223 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 75020.2us
I20260709 13:18:55.019050 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.020323 10715 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:18:55.019061 16789 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.022073 16789 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.025779 16789 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:55.032130 16769 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:55.047176 10186 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:55.049131 16868 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.050240 16868 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.045094 16856 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 5 to 14, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:55.006891 16786 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.068568 10038 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:55.006484 16837 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.022584 16770 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:18:55.092968 16863 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.087894 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.087849 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.102470 10037 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:55.110809 10183 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:55.117547 10186 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.119906 10033 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:55.115271 10106 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:55.128229 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:55.128991 10106 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:55.129138 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.130298 10114 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 17: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:55.132129 16773 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.132879 16773 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.118861 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.134512 10715 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:55.139030 10182 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:55.140656 16730 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.104391 16835 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.112550 16863 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:55.150226 10187 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.155503 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.154783 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.158823 16853 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:55.163208 10184 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 22: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:55.159322 10113 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:55.167459 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.160346 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:55.169226 10708 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:55.169375 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.170387 10181 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:55.168370 10180 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:18:55.182298 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.183207 10709 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:18:55.179112 16762 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.184171 16762 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.186738 16762 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.178786 16863 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.188145 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:55.188267 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.192560 10709 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:18:55.192754 16786 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:55.194262 16739 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.195026 16739 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.195391 16798 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.192644 16880 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:18:55.188562 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 79649.3us
I20260709 13:18:55.196094 16786 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.192966 16837 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.200837 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.198418 16739 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.210378 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.218010 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.190188 16863 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:55.221766 10111 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:55.224331 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.225194 10107 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:55.225451 16786 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.231283 16856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39406 (request call id 80) took 1239 ms. Trace:
I20260709 13:18:55.211802 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.248742 10106 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:55.249922 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.159716 16853 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.258249 10708 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
W20260709 13:18:55.261204 16883 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:18:55.261773 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.262504 10111 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:18:55.262789 16875 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:55.263217 16875 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.263590 16875 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.265080 16748 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.268610 16748 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:55.269258 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:55.274575 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:55.272046 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 60441.2us
I20260709 13:18:55.275323 10107 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:55.231671 16786 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.236114 16773 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.295363 10187 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:55.212484 16798 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.302430 10180 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:18:55.308473 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.309463 10106 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:55.313115 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.314137 10712 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:55.315091 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.272063 16782 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:55.318432 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:55.318599 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.319799 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.330576 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.331190 10716 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:55.237725 16856 rpcz_store.cc:276] 0709 13:18:53.992207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.992354 (+   147us) service_pool.cc:224] Handling call
0709 13:18:54.023658 (+ 31304us) log.cc:844] Serialized 501 byte log entry
0709 13:18:54.194894 (+171236us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54003bc520. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f461142 00007f3c6f441eaa 00007f3c6f448d53 00007f3c6f448cd9 00007f3c6f448c69 00007f3c6f448c31 00007f3c6f447dfd 000000000038f354 000000000038f199 00007f3c6c3fb475
0709 13:18:54.574496 (+379602us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b54003bc520. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f45ddbe 00007f3c6f468930 00007f3c6f4688d8 00007f3c6f468858 00007f3c6f468813 00007f3c6f467a9c 00007f3c75353626 00007f3c7534ddd8 00007f3c6f4a47cb 00007f3c6f4a72c0
0709 13:18:55.231138 (+656642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1573,"raft.queue_time_us":1804,"raft.run_cpu_time_us":3302,"raft.run_wall_time_us":108060,"spinlock_wait_cycles":194508416,"thread_start_us":74115,"threads_started":1,"wal-append.queue_time_us":137408}
I20260709 13:18:55.340713 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.347582 10187 raft_consensus.cc:2393] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:55.349118 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.317569 16782 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:55.321766 16739 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:55.355557 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.319442 16835 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:55.360210 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.360965 10714 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:55.360327 10709 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 5 to 14, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:55.365592 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.366500 10185 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:18:55.368240 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.343803 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.372115 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:55.373845 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.374601 10187 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:55.355288 16730 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:55.385483 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64908.1us
I20260709 13:18:55.388842 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.389583 10716 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:55.357388 16739 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.394774 10107 raft_consensus.cc:2393] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:55.369944 16835 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.357847 16782 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:55.392870 10712 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:18:55.407805 10106 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:55.387944 16730 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.412088 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:55.416414 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.400678 16835 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:55.399789 16739 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.399973 16863 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:55.402388 16765 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.414520 16730 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:55.439067 16854 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:55.439473 16754 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:55.440346 16838 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:55.440755 16884 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.315s	user 0.005s	sys 0.000s
I20260709 13:18:55.441080 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.441709 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:55.441634 16765 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:55.443418 10112 consensus_meta.cc:287] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.010s
I20260709 13:18:55.443625 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.420260 16863 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.461879 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45526.2us
I20260709 13:18:55.457561 10110 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:55.398801 16866 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:18:55.468885 10183 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:55.468739 16436 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.435557 16856 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
W20260709 13:18:55.475126 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 115813us
I20260709 13:18:55.441665 16852 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:55.456449 16754 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.410044 10185 raft_consensus.cc:2955] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 5 to 14, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:55.473172 16436 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.463841 16863 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.489459 16868 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.483189 16769 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:55.492206 16769 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:55.492623 16769 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.493296 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.490582 10079 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.468861 16781 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.495466 16685 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.510768 10112 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:55.483573 16852 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.462716 16846 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:18:55.486702 16754 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.512449 16748 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:55.519582 16868 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:55.512225 16852 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.500973 16838 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.526389 16853 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:55.548007 16748 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.566648 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78714.4us
W20260709 13:18:55.568140 16892 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:18:55.572006 16894 log.cc:927] Time spent T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:18:55.576265 16876 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:18:55.516723 16781 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:55.609054 16890 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:18:55.613548 16875 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.517614 16685 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.615365 16436 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:55.554545 16798 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.555250 16868 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:55.603422 16748 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:55.627004 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 99160.8us
I20260709 13:18:55.632424 16868 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:55.632203 16798 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.650476 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.637995 16854 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:55.663556 16854 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.669133 16685 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:55.669410 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 132382us
I20260709 13:18:55.669868 16685 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:55.671125 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:55.672521 16862 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:55.675441 16855 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:55.676009 16855 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.676360 16855 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:55.684497 16877 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:55.724411 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 248654us
I20260709 13:18:55.719192 16837 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:55.727434 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.660527 16798 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.749827 16789 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:55.751427 16885 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:18:55.740273 16837 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.771549 16789 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.824951  9925 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:18:55.826459 16916 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:55.827234 16916 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.830756 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:55.839785 16844 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.078s	user 0.001s	sys 0.003s
I20260709 13:18:55.845320 16866 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:55.846556 16765 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.852022 16912 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:55.852813 16912 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.856199 16763 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:55.856807 16763 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.859069 16763 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.860989 16798 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.861723 16838 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.862547 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.863433 10709 raft_consensus.cc:2410] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:55.863900 16731 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:55.869522 10186 consensus_meta.cc:287] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.750s	user 0.004s	sys 0.008s
I20260709 13:18:55.814213 16837 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.843103 16739 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.809993 16902 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:55.819865 16789 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.835556 16916 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.876956 10186 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:55.891625 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.892086 16875 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.896688 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:55.831485 16868 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.846828 16769 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.885083 16912 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:55.906402 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 256007us
I20260709 13:18:55.948097 10180 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:55.951495 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:55.952589 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:55.954705 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.882620 16863 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.959126 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.882817 16852 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.947275 16761 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.962783 10715 consensus_queue.cc:237] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:55.972962 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 3496) took 1005 ms. Trace:
I20260709 13:18:55.974372 16769 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:55.976948 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:55.977661 10716 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:55.973289 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.979104 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:55.983837 16761 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.986335 16761 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:55.987159 10712 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 23: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:55.988569 16846 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.989199 16846 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:55.992657 16730 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.003s
I20260709 13:18:55.993232 16730 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:18:55.881458 16782 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:55.996667 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.997287 16914 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:55.997743 16914 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.997820 10184 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
W20260709 13:18:55.998456 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 426730us
I20260709 13:18:55.999329 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:55.999930 16852 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.000976 16740 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:18:56.001196 16860 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.017s	sys 0.018s
W20260709 13:18:56.001621 16860 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.017s	sys 0.019s
I20260709 13:18:56.005236 16754 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.006660 10039 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:18:55.972465 16835 consensus_meta.cc:287] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.008s
I20260709 13:18:56.010226 16835 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.897279 16902 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:55.973378 10035 rpcz_store.cc:276] 0709 13:18:54.890440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.925783 (+ 35343us) service_pool.cc:224] Handling call
0709 13:18:54.992120 (+ 66337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.992848 (+   728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.992883 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.993579 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.067924 (+ 74345us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:55.067970 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.068063 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.894827 (+826764us) raft_consensus.cc:1685] finished
0709 13:18:55.894848 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.894981 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":2498,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":199,"thread_start_us":73833,"threads_started":1,"wal-append.queue_time_us":418617}
I20260709 13:18:56.022658 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:56.026849 10031 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:56.035341 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:55.988716 16739 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.039527 10034 raft_consensus.cc:2368] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16.
I20260709 13:18:56.039785 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:56.040712 10183 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:18:55.992657 16781 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:56.044180 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.044706 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.998172 16914 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.039708 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:56.051469 10114 raft_consensus.cc:2393] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:56.059923 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 92058.8us
I20260709 13:18:56.062162 16770 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:56.062734 16770 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.063227 16762 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:56.031927 16754 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.071141 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.072326 10031 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
W20260709 13:18:56.074829 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 239673us
I20260709 13:18:56.077857 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.081703 10035 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:18:56.086609 10079 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:56.088469 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:56.089136 10716 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:56.089444 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:56.085693 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:56.063258 16917 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:56.122514 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.123961 10682 leader_election.cc:400] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16.
I20260709 13:18:56.077070 16835 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.128693 10682 leader_election.cc:403] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.128264 10712 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:18:56.125483 10114 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:56.130061 16786 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.130604 16786 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.131538 16436 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.132053 16436 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.132915 16731 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:56.133523 16731 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:56.135967 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50373.8us
I20260709 13:18:56.084882 16846 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:56.128863 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50825.4us
W20260709 13:18:56.146907 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 70644.2us
I20260709 13:18:56.155385 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:56.122651 16863 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.163651 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:56.124722 16868 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.084393 16855 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.136915 16782 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.198660 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:56.198442 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:56.161708 16773 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:56.146471 16730 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.211086 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:56.156778 16740 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.212440 10182 raft_consensus.cc:2368] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:18:56.208510 16909 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:56.141736 16838 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:18:56.186902 16835 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:18:56.212889 16773 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:56.229377 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 103704us
W20260709 13:18:56.227679 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 165095us
I20260709 13:18:56.228310 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.234603 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:56.239427 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.228645 16773 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:56.240018 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:56.212982 16917 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.260229 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.265353 10712 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:18:56.255700 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 92145.4us
I20260709 13:18:56.264331 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.273340 10112 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:56.283835 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.284613 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:56.284869 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.284623 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.287171 10113 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:56.287413 16864 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:56.288002 16864 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.288591 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.290124 16864 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.290589 16925 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:56.291869 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:56.292650 10189 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 23: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:56.296639 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.240368 16740 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.299243 16786 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.299484 16740 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:18:56.300518 16929 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:18:56.301525 16922 log.cc:927] Time spent T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:18:56.310520 16914 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.311480 16436 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:56.283725 16903 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.315090 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:56.318194 16902 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.318722 16932 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:56.338907 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.340553 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:56.341090 10038 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:56.227252 16909 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.342190 16917 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.343156 16731 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.343456 16909 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:56.345329 16855 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.348548 16868 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:56.350085 16932 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:56.351270 16932 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.352639 10183 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:18:56.339452 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 102174us
I20260709 13:18:56.353664 10038 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:56.288877 10031 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:56.314421 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:18:56.366837 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 243487us
I20260709 13:18:56.269254 16763 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.381902 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:56.315026 16903 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:56.386075 10079 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:56.385377 10114 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:18:56.363962 16770 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.395264 10079 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:18:56.396075 10079 leader_election.cc:403] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.398593 16946 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.398866 16855 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:18:56.399346 16946 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.402065 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:56.394140 16781 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:56.404861 16781 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.405224 16781 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:56.405426 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:56.406072 10188 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.408391 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:56.408631 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.412817 10712 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:56.419687 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:56.420387 10114 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 23: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:56.339015 16789 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.391765 16903 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.429791 10040 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:56.451602 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.452334 10713 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:56.454437 16925 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16.
I20260709 13:18:56.456017 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.457439 16855 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:56.458007 16855 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:56.460052 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56419.1us
I20260709 13:18:56.460881 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:56.483063 10716 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:18:56.489737 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86521us
I20260709 13:18:56.483533 10113 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:56.494253 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:56.488438 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.507223 16914 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.507860 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:56.512245 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:56.513427 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:56.512883 10112 raft_consensus.cc:3060] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.517306 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:56.478320 16863 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:18:56.494484 16837 consensus_meta.cc:287] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.004s
W20260709 13:18:56.500299 16748 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.846s	user 0.008s	sys 0.004s
I20260709 13:18:56.520217 10107 raft_consensus.cc:2368] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:56.483134 16866 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:56.480391 16926 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:56.528787 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.560408 10713 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:56.564436 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:56.569192 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 48931.2us
I20260709 13:18:56.571468 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.572254 10036 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:18:56.580899 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.531342 16914 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:56.583093 10715 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:56.583014 10107 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:18:56.554504 16863 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:56.599439 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.600525 10036 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:18:56.530433 16748 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.638118 16748 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.526505 16837 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.639716 10155 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:56.640686 16837 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.641490 10711 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:56.641701 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:56.645216 16853 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:56.646982 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:56.619148 16875 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:56.648440 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:56.654491 16941 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:56.621124 16773 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.592701 16926 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.623391 10107 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:56.661160 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:56.624038 16931 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:56.628460 16863 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.630287 16855 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:56.634694 16914 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:56.638234 10709 raft_consensus.cc:2368] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:56.642314 16740 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:56.599812 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.784071 16914 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.616591 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:56.661891 10112 raft_consensus.cc:2468] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:56.674919 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:56.617529 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.673312 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:56.787264 10107 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:18:56.787547 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 114320us
I20260709 13:18:56.685895 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:56.779912 16909 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:56.780786 16773 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:56.779932 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:56.807682 10032 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:56.580866 16866 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.785326 16789 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:56.685418 16853 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.648511 16875 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.657505 16925 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.198s
I20260709 13:18:56.872138 16949 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:56.814862 16762 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:56.815909 16786 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:56.834556 16939 log.cc:927] Time spent T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.438s	user 0.000s	sys 0.001s
W20260709 13:18:56.954557 10188 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.003s
I20260709 13:18:56.959084 10188 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:56.873350 16730 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:56.912865 16853 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.009505 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:57.047392 10113 raft_consensus.cc:2393] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:18:57.038894 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 464511us
I20260709 13:18:56.843109 16798 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:56.955657 16855 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:56.952173 16924 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:57.077845 10110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.024s
W20260709 13:18:57.084830 10110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.025s
I20260709 13:18:56.791453 16931 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.873745 16909 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:56.958367 16786 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.085932 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:57.090111 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:57.041466 16739 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:57.042009 16853 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.092073 10113 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:57.099752 10078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.009s	sys 0.029s
I20260709 13:18:57.057214 16926 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.076969 16964 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:57.077421 16930 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.105926 10078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.009s	sys 0.029s
I20260709 13:18:57.093179 16786 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:57.095285 16914 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.077010 16762 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.122148 16909 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:57.123907 16931 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:57.099261 16798 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:56.950719 16949 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:57.136776 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 645013us
I20260709 13:18:57.136339 16769 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:18:57.130002 10114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.032s	sys 0.034s
I20260709 13:18:57.097239 16731 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:57.148787 16781 consensus_meta.cc:287] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.003s
I20260709 13:18:57.089872 16855 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.136945 10113 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
W20260709 13:18:57.153779 10114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.032s	sys 0.034s
W20260709 13:18:57.153757 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 373901us
I20260709 13:18:57.056619 16730 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.094521 16924 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.139633 16966 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:18:57.170533 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:57.175359 10078 leader_election.cc:400] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:18:57.176400 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:57.175840 10680 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:57.138192 16964 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:57.165387 16960 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:57.179677 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 3171) took 1271 ms. Trace:
I20260709 13:18:57.140424 16930 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.157805 16769 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.201200 10186 rpcz_store.cc:276] 0709 13:18:55.908514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.920914 (+ 12400us) service_pool.cc:224] Handling call
0709 13:18:55.921353 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.948358 (+ 27005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.948390 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.994945 (+ 46555us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.231291 (+236346us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:18:56.242845 (+ 11554us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.259398 (+ 16553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.259473 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.179408 (+919935us) raft_consensus.cc:1685] finished
0709 13:18:57.179429 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.179581 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23566,"prepare.queue_time_us":17438,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7719,"raft.queue_time_us":16255,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":16719,"spinlock_wait_cycles":12722432,"thread_start_us":235855,"threads_started":1,"wal-append.queue_time_us":375146}
I20260709 13:18:57.204528 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:57.159615 16731 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.214284 10114 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:57.223704 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:57.163357 16781 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.233975 16945 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:57.236281 16945 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:57.237334 16948 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:18:57.236665 16955 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:57.240118 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 3175) took 1293 ms. Trace:
I20260709 13:18:57.240904 16924 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:57.241261 16770 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:57.242555 10114 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:57.243527 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:57.244267 10114 raft_consensus.cc:2393] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:57.245862 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.247217 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.249013 16855 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.230911 16965 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:18:57.238416 16940 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:57.248773 16949 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.248880 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.253252 16949 raft_consensus.cc:2804] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:57.253767 16949 raft_consensus.cc:697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:57.253994 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:18:57.257486 16971 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:18:57.238428 16945 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.240480 10181 rpcz_store.cc:276] 0709 13:18:55.946381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.951886 (+  5505us) service_pool.cc:224] Handling call
0709 13:18:55.966269 (+ 14383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.020329 (+ 54060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.020360 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.035228 (+ 14868us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.220554 (+185326us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18003c0160. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:18:56.352234 (+131680us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:56.380874 (+ 28640us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.381117 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.381189 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.239823 (+858634us) raft_consensus.cc:1685] finished
0709 13:18:57.239918 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.240056 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48461,"prepare.queue_time_us":47528,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":50284,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":12423,"spinlock_wait_cycles":2973952,"thread_start_us":131498,"threads_started":1,"wal-append.queue_time_us":1100223}
I20260709 13:18:57.254652 16949 consensus_queue.cc:237] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:57.266022 16967 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:57.267235 16762 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.269025 16769 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.270609 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:57.274362 16958 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.363s	user 0.006s	sys 0.005s
W20260709 13:18:57.275135 16903 consensus_meta.cc:287] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 13:18:57.276683 16798 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:57.270799 16930 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:57.277791 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:57.226286 16875 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:57.284652 16970 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:57.296072 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:57.298120 10113 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:57.275607 16903 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.294878 16970 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:57.372663 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 202204us
I20260709 13:18:57.376828 10155 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:57.377295 10155 leader_election.cc:403] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.363119 16866 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:57.381805 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 210635us
W20260709 13:18:57.390864 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 193624us
I20260709 13:18:57.371935 16932 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:57.370695 16925 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:57.406296 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:57.407097 10180 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:57.408856 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:57.198145  9933 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 18, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:57.409436 10187 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:57.409991 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:57.370960 16739 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:57.418982 10181 raft_consensus.cc:2368] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21.
I20260709 13:18:57.424142 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:57.409868 16868 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 1.061s	user 0.012s	sys 0.000s
I20260709 13:18:57.391945 16975 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:57.409584 16855 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:57.438907 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:57.441968 16739 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.443697 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:57.448977 10185 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:57.447999 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.450464 10040 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 23.
I20260709 13:18:57.452066 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.453892 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:57.461601 10187 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:57.436470 16868 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:57.465278 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:57.463558 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.472079 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:57.542397 10078 leader_election.cc:400] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21.
I20260709 13:18:57.542629 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.543051 10078 leader_election.cc:403] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:18:57.544430 16968 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:18:57.544718 16951 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21.
I20260709 13:18:57.546682 16949 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:57.547219 16949 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.548589 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:57.549378 16949 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.549831 16951 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:57.550251 16951 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:57.550580 16951 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.425664 16925 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.552088 10078 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:57.455250 16730 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.561769 16964 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.463104 16855 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.563585 16731 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:57.564064 16903 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.851684 10709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1321) took 1516 ms. Trace:
I20260709 13:18:57.541652 16983 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:57.575819 10153 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:57.620718 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:57.852692 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 277050us
I20260709 13:18:57.853466 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:57.762586 10180 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
W20260709 13:18:57.830592 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 278591us
I20260709 13:18:57.830745 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.540645 16781 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:57.866869 10114 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:57.867128 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 246497us
I20260709 13:18:57.878203 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:57.880982 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.438570 16786 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:57.865022 10004 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.194:35119 timed out after 2.117s (SENT) [suppressed 9 similar messages]
I20260709 13:18:57.540553 16974 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:57.852140 10709 rpcz_store.cc:276] 0709 13:18:56.313048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.314176 (+  1128us) service_pool.cc:224] Handling call
0709 13:18:57.829331 (+1515155us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540062dc54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:57.829484 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624902016}
I20260709 13:18:57.865840 16770 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:57.931041 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:57.836277 16949 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:57.862884 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:57.940588 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:57.941408 10711 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1320) took 1890 ms (client timeout 2103 ms). Trace:
W20260709 13:18:57.941875 10711 rpcz_store.cc:269] 0709 13:18:56.051392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.051796 (+   404us) service_pool.cc:224] Handling call
0709 13:18:57.941236 (+1889440us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54003cee54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:57.941354 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933656320}
I20260709 13:18:57.947955 17003 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.949374 17003 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:57.949479 16855 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:57.950322 16903 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:57.950912 16903 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:57.867564 16761 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:57.887627 16731 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:57.895679 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:57.831293 16853 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.887425 16875 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:57.952818 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.959802 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3812) took 1459 ms. Trace:
W20260709 13:18:57.960109 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81989.9us
I20260709 13:18:57.462785 16970 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:57.956802 16977 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.468s	user 0.000s	sys 0.001s
I20260709 13:18:57.972544 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:57.947026 16975 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:18:57.967861 10110 rpcz_store.cc:276] 0709 13:18:56.493977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.494104 (+   127us) service_pool.cc:224] Handling call
0709 13:18:56.514788 (+ 20684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.086004 (+571216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.086039 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.104744 (+ 18705us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.370282 (+265538us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:57.370315 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.370966 (+   651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.953368 (+582402us) raft_consensus.cc:1685] finished
0709 13:18:57.953382 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.953485 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5598,"raft.queue_time_us":85547,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":20374,"thread_start_us":783694,"threads_started":2,"wal-append.queue_time_us":321250}
I20260709 13:18:57.979254 10114 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:18:57.979166 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:57.930976 16770 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.025218 10153 leader_election.cc:400] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:58.027583 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:57.908840 16983 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.028048 10153 leader_election.cc:403] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.028769 10036 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:58.030587 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:57.933806 16974 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:57.967245 16875 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:57.977141 16855 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:57.960819 16987 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:58.052475 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 187482us
I20260709 13:18:58.047919 16770 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.048441 17002 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.965116 16860 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.056282 10040 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:18:57.956442 16949 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.054913 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.057988 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.061319 10185 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:18:57.949895 17003 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.066644 10186 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:18:58.073319 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.053161 16875 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:58.055996 16975 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:58.140314 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.077497 16762 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:58.076488 17002 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:58.115780 16770 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:58.067698 16987 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.061317 16855 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.162303 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.148376 17000 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.074704 16860 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.154515 17002 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.155272 16903 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.160372 16988 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.188354 16988 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.185709 16997 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.189776 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.190303 16997 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.191063 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.192245 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.193102 16997 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.193269 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.195078 16988 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.197667 16974 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.198171 16905 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:58.187273 16996 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:58.182024 17000 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.209954 17001 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.210516 16781 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.185792 16786 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.211512 16983 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.186136 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3818) took 1545 ms. Trace:
I20260709 13:18:58.160843 16770 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:58.162484 16762 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.215638 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.193452 16860 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.199728 17011 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:18:58.251456 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 127032us
W20260709 13:18:58.186522 16992 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:18:58.257634 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 227107us
I20260709 13:18:58.288709 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.288818 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.290213 10153 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.183995 17002 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.187219 16949 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.214371 16903 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.262969 10036 raft_consensus.cc:2468] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:58.264065 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.254491 16988 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.254449 16917 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.268580 10115 rpcz_store.cc:276] 0709 13:18:56.509897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.520453 (+ 10556us) service_pool.cc:224] Handling call
0709 13:18:58.054183 (+1533730us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:58.054406 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.054685 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.054716 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.054762 (+    46us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:58.054795 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.054858 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.054987 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5974784}
I20260709 13:18:58.261289 16853 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.291301 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.262578 16761 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:58.301599 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.303124 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.302065 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.282339 16781 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.292646 16786 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:58.300346 16999 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:18:58.294411 16983 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.314520 10709 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:18:58.338822 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 83583.7us
I20260709 13:18:58.340914 10187 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:58.342343 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.343094 10180 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:18:58.261376 16905 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.294597 16974 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:18:58.358898 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.287708 16762 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.349042 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.266716 17001 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.335717 17008 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.363581 17005 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.305404 16903 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.365906 10078 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:58.361126 16860 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.312140 16988 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.346685 17003 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:58.363428 16998 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:18:58.292557 17011 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.375733 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.377557 10110 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:18:58.378028 10188 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:58.379513 10188 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:58.363253 17004 raft_consensus.cc:2804] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:58.398924 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:58.399688 10036 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.400691 17020 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.401278 17020 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:58.404274 17009 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:18:58.404958 17023 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.405499 17023 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.405985 17000 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.406540 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.407088 17026 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.407799 17026 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.410598 16988 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.313762 16770 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.413779 16875 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.366912 16985 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.416230 16985 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.416819 16903 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.417582 17024 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:58.418406 17001 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.363049 17010 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.345016 16917 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.419468 17010 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.407229 17014 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.420799 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.421020 17014 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.421653 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1330) took 1002 ms. Trace:
I20260709 13:18:58.422099 10707 rpcz_store.cc:276] 0709 13:18:57.419303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.420411 (+1001108us) service_pool.cc:224] Handling call
0709 13:18:58.421588 (+  1177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.424568 16925 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.392611 16860 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.426214 10115 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:58.427363 16860 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:18:58.427673 10716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 1068) took 2164 ms (client timeout 2454 ms). Trace:
I20260709 13:18:58.423434 17014 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.414075 16905 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.428359 16985 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.421818 17010 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.432358 17020 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.403891 17016 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 3 to 12, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:18:58.415186 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49357.9us
I20260709 13:18:58.412575 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:58.438735 10036 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:18:58.430718 16946 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.415292 16761 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.502115 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3816) took 1992 ms. Trace:
I20260709 13:18:58.511121 10040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39418 (request call id 3517) took 1041 ms. Trace:
I20260709 13:18:58.532140 10040 rpcz_store.cc:276] 0709 13:18:57.470176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.830460 (+360284us) service_pool.cc:224] Handling call
0709 13:18:58.510869 (+680409us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540031bfd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:58.511009 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454672768}
W20260709 13:18:58.507246 16951 consensus_meta.cc:287] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.956s	user 0.014s	sys 0.000s
I20260709 13:18:58.533330 16951 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.534394 16925 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.535300 16925 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.467664 17019 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:18:58.534476 16903 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.531291 10078 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.531814 10106 rpcz_store.cc:276] 0709 13:18:56.509183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.513275 (+  4092us) service_pool.cc:224] Handling call
0709 13:18:57.236934 (+723659us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:57.237096 (+   162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.278982 (+ 41886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.279017 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.279062 (+    45us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:57.279105 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.501826 (+1222721us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b54000b5254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:58.501885 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.502039 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179204480}
I20260709 13:18:58.543198 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:18:58.440515 10716 rpcz_store.cc:269] 0709 13:18:56.262991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.263127 (+   136us) service_pool.cc:224] Handling call
0709 13:18:58.427460 (+2164333us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54006103d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:58.427592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425219968}
I20260709 13:18:58.546314 10153 leader_election.cc:400] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 17 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18.
I20260709 13:18:58.548107 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:58.536594 16903 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.428261 17026 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.468454 17004 raft_consensus.cc:697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:58.476619 16781 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.442230 16875 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.429347 17011 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.477566 17023 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.475592 16917 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.561906 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.550065 17014 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.550367 16985 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:58.565529 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.553704 16853 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.551201 17031 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:18:58.564337 10682 connection.cc:256] RPC call timeout handler was delayed by -1.2884431659999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:18:58.566157 16863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.649s	user 0.009s	sys 0.032s
W20260709 13:18:58.573257 16863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.009s	sys 0.032s
W20260709 13:18:58.573498 16934 log.cc:927] Time spent T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.916s	user 0.007s	sys 0.018s
I20260709 13:18:58.574851 17004 consensus_queue.cc:237] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.560782 16762 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.571703 10682 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.576323 17031 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.576885 16985 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:58.569487 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.577334 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 3160) took 2754 ms. Trace:
I20260709 13:18:58.584865 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.589187 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:58.623360 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.590371 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.624341 10713 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:58.586935 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:18:58.625334 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55943us
I20260709 13:18:58.623581 10711 raft_consensus.cc:2393] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:18:58.635296 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.591610 10714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 1329) took 1201 ms. Trace:
I20260709 13:18:58.622207 10037 rpcz_store.cc:276] 0709 13:18:55.823165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.867991 (+ 44826us) service_pool.cc:224] Handling call
0709 13:18:55.868299 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.880880 (+ 12581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.880914 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.887637 (+  6723us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.148791 (+261154us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:56.148831 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.148897 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.567271 (+2418374us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:18:58.577018 (+  9747us) raft_consensus.cc:1685] finished
0709 13:18:58.577039 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.577255 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6558,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":11964,"spinlock_wait_cycles":244130560,"thread_start_us":260146,"threads_started":1,"wal-append.queue_time_us":665347}
I20260709 13:18:58.627823 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.628516 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:58.629603 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.625783 10710 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
W20260709 13:18:58.631356 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 111845us
I20260709 13:18:58.632014 16985 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.588479 17031 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.633806 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.708251 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.706820 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 3177) took 2319 ms. Trace:
I20260709 13:18:58.636559 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.628741 17022 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:58.589169 16951 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.571441 16868 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:18:58.637557 16946 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.587070 16949 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:58.639384 10714 rpcz_store.cc:276] 0709 13:18:57.390438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.390553 (+   115us) service_pool.cc:224] Handling call
0709 13:18:58.590862 (+1200309us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b58001a5598. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:58.591079 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.591270 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.591294 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.591328 (+    34us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:58.591367 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.591419 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.591526 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602752}
I20260709 13:18:58.591984 16903 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.640872 10189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 2655) took 1233 ms. Trace:
I20260709 13:18:58.711238 16952 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.720299 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.710036 10035 rpcz_store.cc:276] 0709 13:18:56.387175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.409642 (+ 22467us) service_pool.cc:224] Handling call
0709 13:18:56.409944 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.410308 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.410336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.516531 (+2106195us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b2c00000658. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6dde1a11 00007f3c6ddf1372 00007f3c6f523a01 00007f3c6f4e843a 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2
0709 13:18:58.517112 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.553599 (+ 36487us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:58.553641 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.553707 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.639126 (+ 85419us) raft_consensus.cc:1685] finished
0709 13:18:58.639150 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.706743 (+ 67593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17590,"raft.queue_time_us":726,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":24495,"spinlock_wait_cycles":37323520,"thread_start_us":32399,"threads_started":1,"wal-append.queue_time_us":69114}
W20260709 13:18:58.724131 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 90410.7us
I20260709 13:18:58.642055 16913 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:58.707244 17011 raft_consensus.cc:3060] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:58.725203 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.711215 17022 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.728790 10189 rpcz_store.cc:276] 0709 13:18:57.407819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.407945 (+   126us) service_pool.cc:224] Handling call
0709 13:18:57.421299 (+ 13354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.421499 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:18:57.438800 (+ 17301us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.589148 (+1150348us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b18000e38c0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:18:58.640526 (+ 51378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.640582 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:58.640630 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.640701 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.640810 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16779,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":109,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":70247,"spinlock_wait_cycles":21204736,"thread_start_us":51108,"threads_started":1}
I20260709 13:18:58.729214 16946 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.740705 10186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 2651) took 1347 ms. Trace:
I20260709 13:18:58.741107 10186 rpcz_store.cc:276] 0709 13:18:57.397357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.405579 (+  8222us) service_pool.cc:224] Handling call
0709 13:18:58.740477 (+1334898us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54003f16d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:58.740613 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401531264}
I20260709 13:18:58.741793 16946 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.736524 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.737180 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.743826 17001 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:58.744727 17001 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:58.744879 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.745086 17001 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:58.743789 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.728772 16781 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:58.737624 16904 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.751238 16904 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.753041 16763 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.753443 16904 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.754703 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2824) took 1213 ms. Trace:
I20260709 13:18:58.748015 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:58.748960 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.737269 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.746029 17022 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.751050 17001 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.755096 10110 rpcz_store.cc:276] 0709 13:18:57.541220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.179436 (+638216us) service_pool.cc:224] Handling call
0709 13:18:58.754512 (+575076us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b54000b27d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:58.754624 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220923264}
I20260709 13:18:58.738808 16949 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:58.777436 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:58.772636 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.832484 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.781239 16769 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.789959 16976 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.753572 16763 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.833597 16949 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.850741 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2812) took 2275 ms. Trace:
I20260709 13:18:58.851327 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.852560 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.852723 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2822) took 1456 ms. Trace:
I20260709 13:18:58.853109 10114 rpcz_store.cc:276] 0709 13:18:57.396497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.425356 (+ 28859us) service_pool.cc:224] Handling call
0709 13:18:58.852550 (+1427194us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b540004a6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:58.852649 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961569024}
I20260709 13:18:58.854123 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.855126 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:58.788650 16987 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.856338 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.835278 10714 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:18:58.836807 16769 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.833384 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:58.834699 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.851166 10111 rpcz_store.cc:276] 0709 13:18:56.575229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.617296 (+ 42067us) service_pool.cc:224] Handling call
0709 13:18:56.685188 (+ 67892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.785295 (+100107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.785328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.785367 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:56.785398 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.850487 (+2065089us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b540002c954. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:58.850539 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.850665 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229783424}
I20260709 13:18:58.755425 16925 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:58.843873 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.831700 10713 raft_consensus.cc:2376] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19. Re-sending same reply.
I20260709 13:18:58.750522 16781 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.859946 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.865284 10110 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:18:58.869509 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.867864 10106 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:18:58.871556 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.868103 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.811539 17002 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.733112 16952 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.879844 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.876979 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.879941 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2821) took 1514 ms. Trace:
I20260709 13:18:58.858891 16987 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:58.868086 16781 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:58.884505 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.886121 10106 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:18:58.881187 10109 rpcz_store.cc:276] 0709 13:18:57.365755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.365907 (+   152us) service_pool.cc:224] Handling call
0709 13:18:57.372647 (+  6740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.372848 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:57.387880 (+ 15032us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.844576 (+1456696us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18003da320. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f08823a 00007f3c6f4f2a2a
0709 13:18:58.879568 (+ 34992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.879644 (+    76us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:58.879693 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.879775 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.879888 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16756,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":9077,"raft.queue_time_us":89,"spinlock_wait_cycles":2433792,"thread_start_us":34742,"threads_started":1}
I20260709 13:18:58.858073 16976 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.888825 17027 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:58.881474 17016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39936 (request call id 13) took 3102 ms. Trace:
I20260709 13:18:58.884833 17022 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.889292 17027 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.889739 17027 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.891685 16976 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.890720 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.882776 16970 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:58.897214 17012 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.897776 16769 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.899734 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2829) took 1328 ms. Trace:
I20260709 13:18:58.889328 17016 rpcz_store.cc:276] 0709 13:18:55.769956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.770126 (+   170us) service_pool.cc:224] Handling call
0709 13:18:55.982536 (+212410us) log.cc:844] Serialized 501 byte log entry
0709 13:18:58.872288 (+2889752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1325,"raft.queue_time_us":19579,"raft.run_cpu_time_us":1987,"raft.run_wall_time_us":197410,"thread_start_us":238766,"threads_started":1,"wal-append.queue_time_us":478069,"wal-append.run_cpu_time_us":2759,"wal-append.run_wall_time_us":1206054}
I20260709 13:18:58.901957 17022 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:58.906126 16740 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.907281 10183 raft_consensus.cc:1275] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:58.907220 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.926868 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.908376 16913 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:58.927618 10106 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:18:58.908865 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:58.908981 16875 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:58.909479 16983 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.909950 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:58.928886 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.929070 10186 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:58.912026 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.886353 16925 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:58.922104 10115 rpcz_store.cc:276] 0709 13:18:57.571418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.392960 (+821542us) service_pool.cc:224] Handling call
0709 13:18:58.899571 (+506611us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400189a54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:58.899672 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43756800}
I20260709 13:18:58.908875 16852 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.924711 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.934074 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:58.925431 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.934628 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.908675 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.927585 10004 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:58.926916 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.936789 10711 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:58.929772 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.933941 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:58.908162 17007 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.939689 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.936985 10040 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:58.941694 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.908211 16762 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:58.941073 10182 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:58.945005 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:58.940886 10081 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:58.945405 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.940641 16740 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:58.950310 16956 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 2.279s	user 0.011s	sys 0.031s
I20260709 13:18:58.951247 17011 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.917387 16970 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.952157 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.922900 16854 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.954561 10183 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.955169 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.954519 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:58.956981 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.957995 10081 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:58.960924 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.961067 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:58.943641 17007 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.965677 16740 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:58.966346 16970 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.981122 10081 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:58.962122 16985 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.971331 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:58.971979 16904 consensus_queue.cc:1048] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:58.973168 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.975096 10112 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:58.987197 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:58.961421 17004 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:18:58.989043 10182 raft_consensus.cc:2393] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:58.932586 16925 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:58.980962 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:58.983505 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.985750 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.996277 10184 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:18:58.986760 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:58.997320 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:58.989174 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:58.987815 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2813) took 2369 ms. Trace:
I20260709 13:18:58.998226 10112 rpcz_store.cc:276] 0709 13:18:56.670565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.806463 (+135898us) service_pool.cc:224] Handling call
0709 13:18:58.974699 (+2168236us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:58.974894 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.987500 (+ 12606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.987735 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8293632}
I20260709 13:18:58.999300 10183 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:18:59.000167 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.000576 10183 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:18:58.977154 16762 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.004254 16925 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:59.005300 17042 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:58.990304 10679 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.003574  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:18:59.006943 10184 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 18: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:58.941510 16875 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.944768 16852 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:58.940834 16983 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.008764 10040 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:59.008049 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:59.017200 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:59.017143 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.992570 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:59.009501 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.988819 16969 raft_consensus.cc:2804] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:59.025060 16853 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.020301 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.009240 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:58.988695 16740 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.012710 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:58.984609 16854 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.008190 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.031632 10115 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:58.976152 17027 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:58.984443 16965 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:59.043066 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.043766 10037 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:59.031980 16837 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:59.044312 16837 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.044731 16837 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.045230 10032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39418 (request call id 3504) took 2621 ms. Trace:
I20260709 13:18:59.045603 10032 rpcz_store.cc:276] 0709 13:18:56.423466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.841540 (+418074us) service_pool.cc:224] Handling call
0709 13:18:56.923103 (+ 81563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.198038 (+274935us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:57.375632 (+177594us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.430520 (+ 54888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.430576 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:57.430631 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.744672 (+1314041us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b180046c1e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:59.045008 (+300336us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400065ed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:59.045059 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.045174 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":230251,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":6187,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"spinlock_wait_cycles":649747456,"thread_start_us":220321,"threads_started":2,"wal-append.queue_time_us":168899,"wal-append.run_cpu_time_us":980,"wal-append.run_wall_time_us":1004873}
I20260709 13:18:59.048573 17014 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.049189 16852 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:57.343823  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:59.015775 16949 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:58.991185 17023 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:59.034834 10038 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:18:59.036680 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.056964 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.057253 10679 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.057614 10182 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.058156 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.005738 16762 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.037730 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.041164 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:58.940413 16913 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.031523 16969 raft_consensus.cc:697] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:59.028865 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.035087 17016 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.054116 10189 raft_consensus.cc:2393] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:58.941644 17012 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.061230 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2828) took 1490 ms. Trace:
I20260709 13:18:59.039366 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:59.032667 16853 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:59.070560 10115 rpcz_store.cc:276] 0709 13:18:57.571192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.050922 (+1479730us) service_pool.cc:224] Handling call
0709 13:18:59.060699 (+  9777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.060900 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.060926 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.060982 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:59.061024 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.061075 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.061169 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.066363 10181 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:59.072036 10106 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 21: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:59.072860 17029 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:59.073318 17029 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:59.073653 16913 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.075510 16763 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.076428 17007 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.076586 16983 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.065486 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.064276  9933 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 21 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.080678 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.069465 16920 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.059067 16976 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.056290 17023 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.083927 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.091599 17023 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.064551 17010 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.085757 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.073678 17029 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:59.088986 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.089656 17002 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:59.090409 16853 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.059971 16863 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:59.086011 10187 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 23: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:59.075417 16964 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:59.070926 17016 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.098428 10035 raft_consensus.cc:2410] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:18:59.083631 16773 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.077677 16763 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.103271 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.107913 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.109719 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:59.112540 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54447.7us
I20260709 13:18:59.114629 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.112010 16773 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:18:59.120802 17047 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:59.122624 17012 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.124905 10037 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.125573 16925 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.188768 10713 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.189885 16925 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.106921 17016 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.131116 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.191205 16773 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.132423 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.197299 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.198112 10181 raft_consensus.cc:2393] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:18:59.198925 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.198767 17016 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.134636 16970 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.136399 10003 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.137630 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.139197 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:59.202008 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 65696.9us
I20260709 13:18:59.202832 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.139696 16969 consensus_queue.cc:237] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.140156 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.140501 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.205201 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.143203 16855 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.215409 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.101877 16964 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:59.145422 17027 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.146278 16952 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.146766 16854 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.148100 16781 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.149106 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.219202 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.220566 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.221182 10187 raft_consensus.cc:2468] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:59.221972 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.154462 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:18:59.161012 10715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 1066) took 2925 ms (client timeout 2149 ms). Trace:
I20260709 13:18:59.222286 10182 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
W20260709 13:18:59.223085 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68732.3us
I20260709 13:18:59.223834 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.215243 10185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 2668) took 1312 ms. Trace:
I20260709 13:18:59.175570 16837 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.182744 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.236394 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.199507 10181 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
I20260709 13:18:59.215353 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.215977 16685 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:59.216583 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.218953 16976 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:59.166986 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85015.7us
I20260709 13:18:59.225984 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.198645 17029 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.237792 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.228359 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:18:59.222708 10715 rpcz_store.cc:269] 0709 13:18:56.235492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.239141 (+  3649us) service_pool.cc:224] Handling call
0709 13:18:59.160781 (+2921640us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54006ad6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:59.160919 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498036096}
I20260709 13:18:59.240327 10184 raft_consensus.cc:1813] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Handling vote request from an unknown peer fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.240983 10184 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:59.242116 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:59.243774 10181 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:59.245155 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.245797 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.246054 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:59.247187 10153 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.247546 10714 raft_consensus.cc:2410] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:18:59.230662 17023 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.231544 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.230517 16970 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.232196 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.233127 10078 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:18:59.234782 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 97232.7us
I20260709 13:18:59.191486 16875 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.235666 17019 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:59.241197 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 126634us
I20260709 13:18:59.265272 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.249789 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.251346 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:59.235874 16763 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:59.252481 10183 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:59.253244 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.254984 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.258795 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.224540 10185 rpcz_store.cc:276] 0709 13:18:57.902874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.940353 (+ 37479us) service_pool.cc:224] Handling call
0709 13:18:59.215085 (+1274732us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003f11d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:59.215187 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276162816}
I20260709 13:18:59.258844 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:59.235977 16739 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.243454 16976 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.270030 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.276423 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.277590 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.276014 10078 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:59.248891 16972 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:59.257351 17002 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:59.284394 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.285075 10109 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.278805 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.278831 10185 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:59.278594 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.253006 16916 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.250445 16903 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:59.258446 16762 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.253419 16925 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.260426 16913 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:59.281709 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.276533 16875 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.287101 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.288520 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.290858 10003 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.262650 16945 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:59.292729 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.252584 16786 consensus_queue.cc:1059] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:18:59.281028 16854 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:59.283268 16926 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:59.287704 16863 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.281613 16970 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:59.278146 16685 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.342213 17023 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.342922 16981 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:59.343446 16981 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.343842 16981 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:59.347918 16970 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:59.348460 16781 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.348912 16970 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.349926 16837 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.280830 16964 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.351059 16964 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.322815 17016 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.352722 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:59.353251 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.353673 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.278759 16739 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:59.354831 16739 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.260203 17007 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:59.283239 16997 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.301222 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.284838 17002 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.356313 17002 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:59.311836 16920 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.287588 16985 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:59.356446 17007 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:59.312872 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.295113 16762 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:59.358170 16762 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.297257 17019 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.357934 17007 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:59.359270 17007 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.353829 10189 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.357179 16997 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.357581 16985 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:59.360105 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.304245 16913 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.360644 16985 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.361131 16913 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.361599 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.320894 16916 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.362648 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.360713 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:18:59.363219 10039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39426 (request call id 3183) took 2237 ms (client timeout 1781 ms). Trace:
W20260709 13:18:59.364279 10039 rpcz_store.cc:269] 0709 13:18:57.125636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.253727 (+128091us) service_pool.cc:224] Handling call
0709 13:18:59.362991 (+2109264us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b540031abd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:59.363120 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872608000}
I20260709 13:18:59.293833 16903 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:59.303130 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:59.365123 16903 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:59.365712 16837 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.364666 10038 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.366230 16837 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:18:59.368734 16837 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.371500 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.372315 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.363193 10185 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:18:59.372903 10181 raft_consensus.cc:2376] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18. Re-sending same reply.
I20260709 13:18:59.373279 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:59.373934 10185 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.374061 10709 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:18:59.298619 16950 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:18:59.375528 16950 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:18:59.365492 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62435.4us
W20260709 13:18:59.376250 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.377104 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.378116 16994 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:59.378670 16994 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.380373 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:18:59.381223 10108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33510 (request call id 3820) took 2870 ms (client timeout 2772 ms). Trace:
W20260709 13:18:59.381574 10108 rpcz_store.cc:269] 0709 13:18:56.510544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.513389 (+  2845us) service_pool.cc:224] Handling call
0709 13:18:58.911157 (+2397768us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:18:59.380120 (+468963us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3e9c 00007f3c6c3c3a5b 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:18:59.381124 (+  1004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18044544}
I20260709 13:18:59.382714 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.386102 10115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1530) took 1463 ms. Trace:
I20260709 13:18:59.355620 17010 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:59.386520 10115 rpcz_store.cc:276] 0709 13:18:57.922365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.082507 (+1160142us) service_pool.cc:224] Handling call
0709 13:18:59.091306 (+  8799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.094373 (+  3067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.094405 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.108534 (+ 14129us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.164187 (+ 55653us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:59.164222 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.385701 (+221479us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b54001bec54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:59.385751 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.385799 (+    48us) raft_consensus.cc:1685] finished
0709 13:18:59.385811 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.386038 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6491264,"thread_start_us":16873,"threads_started":1,"wal-append.queue_time_us":34587}
I20260709 13:18:59.389348 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:59.391394 10185 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:59.398416 17010 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.398931 17010 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.403831 16950 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:59.404917 16950 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.405894 16950 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.378384 16860 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:59.409089 16924 raft_consensus.cc:3055] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:59.409528 16924 raft_consensus.cc:740] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:18:59.410372 16924 consensus_queue.cc:260] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.411689 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.412521 16994 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.372762 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.349120 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.395869 17001 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:59.278216 17051 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:59.430493 10081 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.431486 10183 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:59.432230 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.434556 10185 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:59.451409 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.452329 10709 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:59.455374 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:59.455283 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:59.457249 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:18:59.453796 10708 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:59.452543 10185 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.446106 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.448174 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.446548 10034 raft_consensus.cc:2468] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:59.448740 10109 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:18:59.460896 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.460701 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.465246 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.466071 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.466226 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.466892 10183 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.468679 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.469738 10108 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 21: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:18:59.471625 10081 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.470475 10709 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:59.360579 17007 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.450450 10037 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:18:59.474367 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:59.471622 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:59.449620 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:18:59.478442 10155 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.476959 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.478394 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.429832 16924 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.504683 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:59.505613 10712 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 21: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:18:59.506493 10081 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.508608 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.509451 10711 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:59.502647 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.499200 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.514343 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.513677 10682 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.521034 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2826) took 1950 ms. Trace:
I20260709 13:18:59.521492 10112 rpcz_store.cc:276] 0709 13:18:57.570648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.012298 (+1441650us) service_pool.cc:224] Handling call
0709 13:18:59.030774 (+ 18476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.054619 (+ 23845us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:18:59.064882 (+ 10263us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.298134 (+233252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.298187 (+    53us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:18:59.298241 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.520759 (+222518us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b540017e154. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:18:59.520817 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.520962 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24056,"prepare.queue_time_us":15568,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":222,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6378,"spinlock_wait_cycles":54266240,"thread_start_us":232681,"threads_started":1}
I20260709 13:18:59.450645 17051 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:18:59.464460 17029 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:59.564723 10114 raft_consensus.cc:2410] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:59.565825 16981 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.566771 10109 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 24.
I20260709 13:18:59.567920 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.570137 16985 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.572152 16997 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.572698 16985 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.574956 16739 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.454171 17031 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:59.539691 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 90145.2us
I20260709 13:18:59.480512 16975 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:59.540549 10036 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:59.500599 16969 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:59.470561 16930 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.542599 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.545142 16913 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.547801 16902 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:59.549270 17056 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:59.557678 16903 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.507529 16762 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.517779 16860 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.517438 16835 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:59.513446 16920 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.504076 17025 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.475044 16868 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:18:59.488256 16854 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.576313 17023 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:59.540197 16786 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:59.673418 16769 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:59.674209 16769 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.578653 17051 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:59.676865 16769 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:18:59.677663 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 65247us
I20260709 13:18:59.537889 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.588456 10107 raft_consensus.cc:1240] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:59.513432 16994 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:59.596344 10079 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.596145 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.683645 10110 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:18:59.615608 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.620749 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.617305 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:18:59.616300 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33512 (request call id 2839) took 1032 ms. Trace:
I20260709 13:18:59.685511 10114 rpcz_store.cc:276] 0709 13:18:58.583632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.861923 (+278291us) service_pool.cc:224] Handling call
0709 13:18:59.616104 (+754181us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b540013a1d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:59.616242 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596499840}
W20260709 13:18:59.686688 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 90442us
I20260709 13:18:59.686856 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.604110 16945 consensus_queue.cc:1059] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:59.692770 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.693498 10187 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:59.635913 16981 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.632447 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.559329 17002 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.634541 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:59.633208 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:18:59.638523 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.593397 17003 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.718077 10115 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:18:59.721585 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.633520 16985 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 13:18:59.589732 17031 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:18:59.650290 10188 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:59.736244 17031 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:59.601734 16739 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.653857 10713 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:59.617596 16902 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:59.737671 16902 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:59.738096 10182 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:59.739281 17002 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:59.658208 10108 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:18:59.656129 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.740144 17003 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:18:59.740550 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 84485.6us
I20260709 13:18:59.741890 16983 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:59.742408 17003 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:59.742591 16983 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:59.742952 16983 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:59.743292 16983 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.680503 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1524) took 3044 ms. Trace:
I20260709 13:18:59.626428 10183 raft_consensus.cc:2468] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:18:59.685511 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.696920 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:18:59.698166 16868 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:59.705857 16976 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.644819 16916 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:18:59.707170 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:18:59.708312 17057 log.cc:927] Time spent T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:18:59.709367 16773 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.694931 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:18:59.753562 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58734.6us
I20260709 13:18:59.754269 10679 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:18:59.603176 17010 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.728775 17016 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:18:59.720088 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 124037us
I20260709 13:18:59.584455 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:18:59.775180 10112 raft_consensus.cc:2376] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18. Re-sending same reply.
I20260709 13:18:59.722954 10189 raft_consensus.cc:2468] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 13.
I20260709 13:18:59.644724 10185 raft_consensus.cc:2468] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:18:59.655946 17023 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:18:59.651525 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:18:59.787966 17023 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:59.788427 10111 raft_consensus.cc:2410] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:59.789934 10111 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 3 to 12, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:59.796902 17023 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.805377 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:18:59.749264 16868 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:18:59.808573 16868 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:18:59.810237 10183 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:59.764736 16993 raft_consensus.cc:2804] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:59.764981 16925 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:59.812319 16925 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.812693 16925 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:59.737552 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 99138.5us
I20260709 13:18:59.748752 10109 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:59.751317 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 54482.8us
I20260709 13:18:59.816745 10003 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.645742 17022 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:18:59.658784 10106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10bea19d11e44342889595040e4d97bd"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:18:59.746556 10107 rpcz_store.cc:276] 0709 13:18:56.636244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.807190 (+170946us) service_pool.cc:224] Handling call
0709 13:18:58.900265 (+2093075us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:59.406950 (+506685us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3e9c 00007f3c6c3c3a5b 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:59.580724 (+173774us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3eee 0000000000375939 00007f3c744371e0 00007f3c745000c4 00007f3c74500131 00007f3c744c1fc0 00007f3c744ac929 00007f3c744ac3d2 00007f3c6da23bd4
0709 13:18:59.580926 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.680227 (+ 99301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.680442 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247631104}
I20260709 13:18:59.821005 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.714354 10079 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.769196 10184 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:59.744935 16730 raft_consensus.cc:3055] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:59.777742 10112 raft_consensus.cc:1275] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:59.824270 10107 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:18:59.823311 10707 raft_consensus.cc:2368] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
I20260709 13:18:59.823557 16972 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.761837 16966 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:59.824368 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1537) took 1487 ms. Trace:
I20260709 13:18:59.824924 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3831) took 1268 ms. Trace:
I20260709 13:18:59.826021 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.827669 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:18:59.840126 10112 rpcz_store.cc:276] 0709 13:18:58.337278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.777026 (+1439748us) service_pool.cc:224] Handling call
0709 13:18:59.777371 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.824083 (+ 46712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.824299 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.840143 10107 rpcz_store.cc:276] 0709 13:18:58.556884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.823596 (+1266712us) service_pool.cc:224] Handling call
0709 13:18:59.823999 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.824675 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.824872 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.828661 10186 raft_consensus.cc:1240] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:59.865680 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3834) took 1306 ms. Trace:
I20260709 13:18:59.867861 10107 rpcz_store.cc:276] 0709 13:18:58.559545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.841630 (+1282085us) service_pool.cc:224] Handling call
0709 13:18:59.865123 (+ 23493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.865333 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.865359 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.865403 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:59.865443 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.865498 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.865610 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.823969 16730 raft_consensus.cc:740] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:18:59.832211 16685 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.845355 16966 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:18:59.867168 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:18:59.881259 10109 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:18:59.888479 10107 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:59.877473 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 163180us
I20260709 13:18:59.883610 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:18:59.856681 16950 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:59.889580 10109 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:59.890726 10037 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:59.874219 10180 raft_consensus.cc:2955] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 3 to 12, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:59.891180 10003 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.894163 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2840) took 1091 ms. Trace:
I20260709 13:18:59.895669 10109 rpcz_store.cc:276] 0709 13:18:58.803069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.889155 (+1086086us) service_pool.cc:224] Handling call
0709 13:18:59.889416 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.893038 (+  3622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.894105 (+  1067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.833078 16914 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:18:59.898098 10181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.038s	sys 0.039s
I20260709 13:18:59.891991 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:18:59.874310 16945 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:59.906965 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.881675 17025 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.912041  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 302) took 5816 ms. Trace:
I20260709 13:18:59.891630 16966 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.909808 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:18:59.875384 17031 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:59.916230 10039 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.018s	sys 0.022s
W20260709 13:18:59.918239 10039 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.020s	sys 0.023s
I20260709 13:18:59.898546 16739 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:59.897666 16769 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:18:59.910169 16685 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:59.910356 16913 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:59.920980  9933 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 18 to 19, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 19 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:18:59.897835 16926 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:18:59.930138 16902 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:18:59.918900 16730 consensus_queue.cc:260] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:18:59.932317 17060 log.cc:927] Time spent T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:18:59.907935 16979 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:59.910851 16950 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:59.908838 16945 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:18:59.943785 17058 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:18:59.962769 10036 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:59.964397 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1542) took 1257 ms. Trace:
I20260709 13:18:59.955276 17010 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:18:59.964813 10107 rpcz_store.cc:276] 0709 13:18:58.706896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.869278 (+1162382us) service_pool.cc:224] Handling call
0709 13:18:59.888309 (+ 19031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.890333 (+  2024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.964216 (+ 73883us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b5400420c50. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:59.964337 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13924608}
I20260709 13:18:59.965919 16730 raft_consensus.cc:3060] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.967278 10113 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:59.968721 10113 raft_consensus.cc:1275] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:59.969854 10113 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.970616 17031 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:18:59.970902 10113 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:59.973421 10004 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:18:59.974149 10110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53672 (request call id 1543) took 1095 ms. Trace:
I20260709 13:18:59.974507 10110 rpcz_store.cc:276] 0709 13:18:58.878402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.916530 (+ 38128us) service_pool.cc:224] Handling call
0709 13:18:59.405299 (+488769us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3b71 00007f3c6c3c3a22 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:18:59.478234 (+ 72935us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b5800182a98. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c3c3e9c 00007f3c6c3c3a5b 00007f3c752dcc09 00007f3c74436ee0 00007f3c745000ab 00007f3c74500131 00007f3c744ae0a0 00007f3c744ad984 00007f3c6da286d4 00007f3c6da28662
0709 13:18:59.973973 (+495739us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540017d754. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:18:59.974093 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462212480}
I20260709 13:18:59.989897 10110 raft_consensus.cc:1240] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.990200 10107 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:59.914014  9934 rpcz_store.cc:276] 0709 13:18:54.065498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.065652 (+   154us) service_pool.cc:224] Handling call
0709 13:18:59.878202 (+5812550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:54.840113 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:54.841881 (+  1768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:54.841916 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:54.841931 (+    15us) tablet.cc:662] Decoding operations
0709 13:18:54.842880 (+   949us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:54.842937 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:54.842962 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:18:54.843655 (+   693us) tablet.cc:701] Row locks acquired
0709 13:18:54.843674 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:54.843865 (+   191us) write_op.cc:270] Start()
0709 13:18:54.843987 (+   122us) write_op.cc:276] Timestamp: P: 1783603134843813 usec, L: 0
0709 13:18:54.844010 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:54.844623 (+   613us) log.cc:844] Serialized 3637 byte log entry
0709 13:18:54.846526 (+  1903us) op_driver.cc:464] REPLICATION: finished
0709 13:18:54.846837 (+   311us) write_op.cc:301] APPLY: starting
0709 13:18:55.058380 (+211543us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:55.224333 (+165953us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:55.255625 (+ 31292us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:55.864415 (+608790us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:55.864712 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:18:55.864772 (+    60us) write_op.cc:312] APPLY: finished
0709 13:18:55.865288 (+   516us) log.cc:844] Serialized 89 byte log entry
0709 13:18:56.087963 (+222675us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:56.211871 (+123908us) write_op.cc:454] Released schema lock
0709 13:18:56.214070 (+  2199us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:56.295999 (+ 81929us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:56.296032 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6408,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":37018,"apply.run_wall_time_us":1409462,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37566,"num_ops":9,"prepare.queue_time_us":641412,"prepare.run_cpu_time_us":3609,"prepare.run_wall_time_us":13904,"replication_time_us":2405,"thread_start_us":213222,"threads_started":1,"wal-append.queue_time_us":367785,"wal-append.run_cpu_time_us":1425,"wal-append.run_wall_time_us":1106638}]]}
I20260709 13:18:59.944777 16762 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:18:59.952791 16945 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:00.029820 10038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.009s	sys 0.029s
W20260709 13:19:00.030252 10038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.009s	sys 0.029s
I20260709 13:18:59.964426 16902 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:00.036458 10110 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:00.040514 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.041263 10113 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.040023 17031 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.045384 10036 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:00.019097 16979 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.049113 17031 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.041767 17027 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.081113 10113 raft_consensus.cc:2468] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:19:00.076586 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:19:00.111071 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.112398 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.113683 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:00.141561 10111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1539) took 1716 ms. Trace:
I20260709 13:19:00.142264 10680 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:00.144443 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 245623us
I20260709 13:19:00.064098 16979 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:00.109691 17064 log.cc:927] Time spent T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:19:00.073318 16863 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
W20260709 13:19:00.143473 17007 consensus_meta.cc:287] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.010s
I20260709 13:19:00.066880 16997 consensus_queue.cc:1059] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:19:00.077258 17026 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 13:19:00.076409 17027 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.144748 17010 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:00.116429 16993 raft_consensus.cc:697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.141105 17003 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:00.149668 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 339302us
I20260709 13:19:00.108526 16837 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:19:00.161612 10038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 3215) took 1027 ms. Trace:
I20260709 13:19:00.162348 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.149617 16924 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:00.166133 10679 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:00.174825 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.169003 10038 rpcz_store.cc:276] 0709 13:18:59.133950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.367049 (+233099us) service_pool.cc:224] Handling call
0709 13:18:59.367315 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.367531 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:00.030576 (+663045us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.161240 (+130664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.161294 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:00.161346 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.161413 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.161549 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2273,"prepare.queue_time_us":696039,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":792986,"threads_started":2}
I20260709 13:19:00.175591 10185 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:00.163115 16769 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.181159 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.166330 17010 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:00.170105 17007 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:00.178128 16920 consensus_meta.cc:287] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.003s
I20260709 13:19:00.190675 10185 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:00.195276 10039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 3214) took 1061 ms. Trace:
I20260709 13:19:00.186435 17010 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.196866 10113 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:19:00.198788 16993 consensus_queue.cc:237] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.199846 10713 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:00.185515 16997 raft_consensus.cc:2804] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:00.180943 16987 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:19:00.206840 17072 raft_consensus.cc:3055] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:00.207304 17072 raft_consensus.cc:740] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.208616 10110 raft_consensus.cc:1275] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:00.208212 17072 consensus_queue.cc:260] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.209836 17072 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:00.210270 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.185187 16924 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:00.185670 16769 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.212034 16924 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.213771 16769 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:00.218369 16926 consensus_queue.cc:1059] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:00.159631 16739 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.219975 16739 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:00.201025 10113 pending_rounds.cc:85] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 13
I20260709 13:19:00.225962 10113 pending_rounds.cc:107] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:19:00.226312 10113 raft_consensus.cc:2889] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:00.227649 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:00.202064 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.221103 10679 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:00.170961 17071 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:19:00.229763 16926 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:19:00.234198 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:00.234956 10108 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:00.224962 16945 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.241047 17073 raft_consensus.cc:2804] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:00.241756 17073 raft_consensus.cc:697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.241587 17010 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.242810 17073 consensus_queue.cc:237] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.200786 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:00.177999 16983 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.195791 10039 rpcz_store.cc:276] 0709 13:18:59.133691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.366248 (+232557us) service_pool.cc:224] Handling call
0709 13:18:59.366517 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.366721 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:59.922122 (+555401us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.194821 (+272699us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.194873 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:00.195039 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.195107 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.195219 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":681057,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":1792,"thread_start_us":827372,"threads_started":2}
I20260709 13:19:00.192121 16920 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:00.252702 17069 log.cc:927] Time spent T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:00.227334 16925 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.249275 16730 raft_consensus.cc:3055] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:00.270663 17068 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:00.284509 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:00.285157 10716 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
W20260709 13:19:00.288390 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 315048us
I20260709 13:19:00.289283 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.294065 16913 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:00.294698 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:00.265619 17074 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:00.298581 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.299043 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:00.266160 17010 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:00.272358 17031 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:00.271948 16730 raft_consensus.cc:740] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.282148 16949 raft_consensus.cc:2804] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:00.280675 17022 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.297523 17051 consensus_meta.cc:287] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.003s
I20260709 13:19:00.312852 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.313807 10113 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.296886 17002 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:00.310464 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 79263.8us
W20260709 13:19:00.304646 17065 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:19:00.300163 17074 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.302261 17080 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:00.300468 16975 consensus_queue.cc:1048] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
W20260709 13:19:00.347854 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.302969 16837 consensus_queue.cc:1243] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:00.326633 17031 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:00.350451 10113 raft_consensus.cc:2468] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:19:00.328159 17002 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.326273 17079 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:00.327029 16949 raft_consensus.cc:697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.355443 10184 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:00.337393 16945 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:00.353389 10680 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:00.321337 17022 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.364045 17022 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.320863 17051 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.365111 10711 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:00.366237 17051 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.366930 17051 raft_consensus.cc:2804] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:00.367416 17051 raft_consensus.cc:697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.341701 16966 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.370846 16949 consensus_queue.cc:237] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.355021 16979 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:00.356027 17002 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:00.379210 10184 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:00.379724 16837 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:00.349398 17027 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.401147 17085 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:00.402463 17075 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:00.407186 17007 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.412894 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:00.414582 10182 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.416448 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.417901 10712 raft_consensus.cc:1240] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:00.417971 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:19:00.418581 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 103203us
I20260709 13:19:00.420624 10033 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:00.421054 10110 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:19:00.438895 10186 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:00.439363 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.424252 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.425488 10709 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:19:00.401175 17079 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.352329 17031 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.430014 10708 raft_consensus.cc:3055] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:00.434955 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.437971 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.448983 10112 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:00.451113 10182 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.448921 10708 raft_consensus.cc:740] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.443277 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.446003 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.420395 16685 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:00.472381 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 2693) took 1330 ms. Trace:
I20260709 13:19:00.475452 10181 rpcz_store.cc:276] 0709 13:18:59.141702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.373633 (+231931us) service_pool.cc:224] Handling call
0709 13:18:59.373921 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.374154 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.374178 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.374692 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.898716 (+524024us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:59.898755 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.898819 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.472177 (+573358us) raft_consensus.cc:1685] finished
0709 13:19:00.472197 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.472318 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":523608,"threads_started":1,"wal-append.queue_time_us":663607}
I20260709 13:19:00.473155 16875 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:00.426731 16837 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.475805 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:00.481380 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.483501 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:00.482095 10183 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:00.481123 16685 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:00.485901 17089 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:00.486182 10032 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.359323 17080 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:19:00.461604 17031 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:00.498107 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:00.359457 16730 consensus_queue.cc:260] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.509748 10004 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.510718 10036 raft_consensus.cc:1240] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:00.428386 16930 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:19:00.448400 17010 consensus_queue.cc:1048] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:19:00.476472 16916 consensus_queue.cc:1048] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:19:00.528072 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.523028 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:00.525274 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.531997 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.496798 16781 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:00.508808 16925 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.530570 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.536430 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.533862 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:00.488768 17007 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:19:00.481415 16914 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:19:00.523896 16983 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.515295 17085 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:00.482514 16932 consensus_queue.cc:1059] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:19:00.471308 17026 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:19:00.543293 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:00.519361 16972 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:00.515471 17094 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:00.549054 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 107020us
I20260709 13:19:00.538405 10181 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 24: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:00.487171 17086 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:19:00.558218 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:00.507740 17073 consensus_queue.cc:1059] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:19:00.589387 10715 raft_consensus.cc:1240] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:00.530999 17077 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.553826 10712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:00.540304 16730 raft_consensus.cc:3060] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.564916 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.558564 17085 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:00.571834 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.592094 16781 raft_consensus.cc:3055] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:00.592690 16994 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:00.594528 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.596266 16685 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.560539 17007 consensus_queue.cc:1243] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:00.597414 10032 raft_consensus.cc:1240] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.467114 17074 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:00.569800 17083 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:19:00.569137 17094 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:00.608875 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:00.673803 10183 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:00.610101 17080 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:00.604770 17085 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:00.672214 17084 log.cc:927] Time spent T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.433s	user 0.003s	sys 0.001s
I20260709 13:19:00.586304 17072 consensus_queue.cc:1059] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
W20260709 13:19:00.668630 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 96926.4us
I20260709 13:19:00.558240 16837 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.667992 16966 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.609876 16781 raft_consensus.cc:740] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:00.611061 16994 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:00.694233 16781 consensus_queue.cc:260] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.694618 16994 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.696002 16994 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:00.696520 10114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1532) took 2745 ms. Trace:
I20260709 13:19:00.696964 10114 rpcz_store.cc:276] 0709 13:18:57.951501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.757043 (+1805542us) service_pool.cc:224] Handling call
0709 13:19:00.049940 (+292897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.050138 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.050178 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.050223 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:00.050254 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.050309 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.696278 (+645969us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54000b27d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:00.696436 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672814464}
I20260709 13:19:00.699414 16925 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:19:00.659821 17102 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:00.555522 17079 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.699940 16925 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:00.700986 16925 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.603047 17077 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.702695 10034 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:00.702960 17021 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:00.703436 17021 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:00.552521 17051 consensus_queue.cc:237] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.677217 17094 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.679953 16762 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:00.704792 16762 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.704427 17021 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.705677 16762 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.706229 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.707197 16762 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:00.707872 16913 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:00.708019 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:00.709106 16913 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:00.711198 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:00.142154 10111 rpcz_store.cc:276] 0709 13:18:58.425519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.789270 (+1363751us) service_pool.cc:224] Handling call
0709 13:18:59.789605 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.789813 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:59.803734 (+ 13921us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.141169 (+337435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.141234 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:00.141291 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.141363 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.141497 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":837,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3226,"thread_start_us":336139,"threads_started":1}
I20260709 13:19:00.681363 17011 raft_consensus.cc:3055] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:00.714190 17011 raft_consensus.cc:740] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.715130 10040 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:00.723100 16903 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:00.723165 17099 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:19:00.723196 17027 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:00.726790 17027 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:00.730204 17023 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:00.727563 10107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33512 (request call id 2842) took 1568 ms. Trace:
W20260709 13:19:00.731544 17104 log.cc:927] Time spent T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:19:00.734071 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.689059 17072 consensus_queue.cc:1243] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer fd3903ba079e4f47aaf0aa4432382c23 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:00.667613 17101 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:00.731094 10107 rpcz_store.cc:276] 0709 13:18:59.159619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.965741 (+806122us) service_pool.cc:224] Handling call
0709 13:18:59.979018 (+ 13277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.990565 (+ 11547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.727351 (+736786us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540017d750. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:00.727502 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29739264}
I20260709 13:19:00.611579 16763 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:19:00.715519 10040 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:00.657770 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:00.751403 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:00.740760 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.746814 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:00.754180 16763 consensus_queue.cc:1243] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:19:00.758340 17098 log.cc:927] Time spent T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:19:00.759922 16914 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:00.760238 10040 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.737897 16781 raft_consensus.cc:3060] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:00.761466 10040 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:00.760624 16976 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:00.763549 10109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3838) took 1604 ms. Trace:
I20260709 13:19:00.763998 10109 rpcz_store.cc:276] 0709 13:18:59.158810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.906746 (+747936us) service_pool.cc:224] Handling call
0709 13:19:00.056361 (+149615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.056584 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.056611 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.056658 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:00.056699 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.056755 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.763359 (+706604us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000497d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:00.763489 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343437056}
I20260709 13:19:00.773821 10711 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 1094) took 1152 ms. Trace:
I20260709 13:19:00.774276 10711 rpcz_store.cc:276] 0709 13:18:59.621704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.637189 (+ 15485us) service_pool.cc:224] Handling call
0709 13:18:59.657447 (+ 20258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.365511 (+708064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.773539 (+408028us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540049cd54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:00.773750 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627096448}
I20260709 13:19:00.775220 10040 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:00.733739 16868 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:00.775813 16902 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:19:00.779175 10180 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:19:00.705770 17021 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:00.748354 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:00.792207 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 24.
I20260709 13:19:00.703804 17077 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:00.801331 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 311420us
I20260709 13:19:00.803596 10187 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 25. Current term is 26. Ops: []
W20260709 13:19:00.807045 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.819928 10709 raft_consensus.cc:1240] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:00.828801 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:00.832388 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.832780 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:00.727640 17027 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:00.839279 16924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.001s	sys 0.019s
W20260709 13:19:00.845542 16924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.001s	sys 0.019s
I20260709 13:19:00.848757 17094 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.849210 10109 raft_consensus.cc:2468] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:19:00.851609 17094 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:00.852319 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:00.820686 16930 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:19:00.861847 10188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 3194) took 1764 ms. Trace:
I20260709 13:19:00.862351 10188 rpcz_store.cc:276] 0709 13:18:59.097034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.277800 (+180766us) service_pool.cc:224] Handling call
0709 13:18:59.296103 (+ 18303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.736405 (+440302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.861568 (+1125163us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400100254. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:00.861773 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804551552}
I20260709 13:19:00.824359 16914 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:19:00.840186 16970 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:00.888249 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.873080 16762 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:00.872769 17027 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:00.870476 17077 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:00.892980 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 64258.9us
I20260709 13:19:00.884883 16970 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.899629 10035 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:00.899645 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 65916.8us
I20260709 13:19:00.905158 17077 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:00.903807 10680 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:00.909183 10115 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.895107 17100 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.893874 17078 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:00.902776 16970 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.898923 16762 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.919183 16920 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:00.920835 16925 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:00.949554 10707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42422 (request call id 1091) took 1516 ms. Trace:
I20260709 13:19:00.950027 10707 rpcz_store.cc:276] 0709 13:18:59.432850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.433009 (+   159us) service_pool.cc:224] Handling call
0709 13:19:00.949300 (+1516291us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54006ad6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:00.949485 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724682624}
I20260709 13:19:00.911801 17088 raft_consensus.cc:2804] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:00.955107 10708 consensus_queue.cc:260] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.980460 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:00.958173 17011 consensus_queue.cc:260] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:00.963812 17026 raft_consensus.cc:3055] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:00.965884 10003 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:00.973547 10108 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:19:00.974221 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:00.976457 17091 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.619s	user 0.003s	sys 0.001s
I20260709 13:19:00.978552 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:00.980610 10708 raft_consensus.cc:3060] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:00.957531 10031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 3229) took 1044 ms. Trace:
W20260709 13:19:01.024109 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 45645.3us
I20260709 13:19:00.990618 10031 rpcz_store.cc:276] 0709 13:18:59.912997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.913151 (+   154us) service_pool.cc:224] Handling call
0709 13:18:59.913426 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.164516 (+251090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.164550 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.164595 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:00.164638 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.957259 (+792621us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540031d8d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:00.957305 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.957462 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55136,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":576673664}
I20260709 13:19:01.028292 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:19:01.028661 10679 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.029171 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.031076 10107 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:01.034976 17002 consensus_meta.cc:287] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.001s
I20260709 13:19:00.931612 17078 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.044188 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:00.946367 17079 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.053558 10031 raft_consensus.cc:1240] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:01.056525 17079 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.923534 17100 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:00.988880 17026 raft_consensus.cc:740] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.023767 16983 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:01.024329 17088 raft_consensus.cc:697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.047281 17077 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.068889 10110 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:19:01.035439 17002 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.040699 16763 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:01.052842 16875 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:01.058516 16916 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:19:01.046082 16924 consensus_queue.cc:1059] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:19:01.039306 16976 consensus_queue.cc:1059] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:19:01.030040 17101 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:19:01.096529 10708 raft_consensus.cc:1275] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:19:01.053040 16739 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:01.041491 17019 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 13:19:01.074083 17031 consensus_meta.cc:287] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.004s
I20260709 13:19:01.101425 10708 pending_rounds.cc:85] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 14
I20260709 13:19:01.110965 10708 pending_rounds.cc:107] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:19:01.111301 10708 raft_consensus.cc:2889] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:01.102990 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58898.4us
I20260709 13:19:01.103619 10189 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:01.039386 17085 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:01.098672 16997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.020s	sys 0.018s
I20260709 13:19:01.157455 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.098577 17077 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:01.082299 16913 consensus_queue.cc:1059] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 13:19:01.160825 16997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.020s	sys 0.018s
I20260709 13:19:01.173262 16997 raft_consensus.cc:697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.174384 16997 consensus_queue.cc:237] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.160604 16979 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:19:01.159993 16863 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:19:01.098383 16875 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.181564 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:01.181982 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.184772 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:01.185568 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.159293 16739 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 24 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:19:01.183161 10003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.170390 16983 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.200822 16983 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.177932 16979 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.191282 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.190136 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.160485 17031 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.183444 17077 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:01.204450 17111 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 13:19:01.192322 17118 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:19:01.227666 10106 raft_consensus.cc:606] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.228358 10181 raft_consensus.cc:1240] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:19:01.229357 17100 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:01.232601 17079 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.216970 17077 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.233655 16970 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:01.234418 17119 log.cc:927] Time spent T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:19:01.165737 17026 consensus_queue.cc:260] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.250690 17026 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.251549 17085 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.248649 17071 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:01.252435 17071 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.253300 17071 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.235085 16739 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.254535 17071 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.218420 17088 consensus_queue.cc:237] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.248488 17077 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.239040 10106 raft_consensus.cc:614] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:01.241621 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51616.9us
I20260709 13:19:01.185060 16685 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:01.235112 16875 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:01.236146 17124 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:19:01.262605 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.265815 10185 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 26: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:01.262374 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:01.266773 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.262895 10189 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:01.261229 17021 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.245281 16762 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.268285 16762 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:01.268546 16685 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:01.269047 16685 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.269454 16762 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:01.269843 16762 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.269173 17021 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.270771 16685 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.270975 16762 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:01.272181 16685 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.248121 16972 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:01.277904 16730 consensus_meta.cc:287] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 13:19:01.249495 17031 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.281519 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.283691 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.284559 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.290251 10031 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:19:01.285490 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:01.286618 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:01.292026 10032 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.281028 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.300474 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.304768 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.297124 17085 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:01.312268 17085 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.314553 17074 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:01.303108 16925 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:01.316022 16762 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.317382 17078 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.318801 10112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33510 (request call id 3833) took 2760 ms. Trace:
I20260709 13:19:01.319183 10112 rpcz_store.cc:276] 0709 13:18:58.558554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.841597 (+1283043us) service_pool.cc:224] Handling call
0709 13:18:59.841950 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.449373 (+607423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.318560 (+869187us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400189554. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:01.318741 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395571456}
I20260709 13:19:01.320101 16875 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:01.320663 16875 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.321377 16763 raft_consensus.cc:3055] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:01.321813 16763 raft_consensus.cc:740] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.322786 16875 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.326246 10185 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:01.327772 10187 raft_consensus.cc:1240] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: [20.17-21.18]
I20260709 13:19:01.332556 10184 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:01.306500 16970 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.322692 17100 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.307516 17016 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:01.348282 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:01.351477 10184 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.332551 17114 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:19:01.360286 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.367705 10112 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:19:01.305521 17125 consensus_queue.cc:1175] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 23 status { last_received { term: 23 index: 16 } last_committed_idx: 16 last_received_current_leader { term: 23 index: 16 } }
I20260709 13:19:01.370121 17125 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:01.373015 10708 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:01.374075 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:01.343091 17002 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:01.272682 16979 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.381150 10032 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:01.384061 10184 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:01.310081 17023 consensus_queue.cc:1059] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:19:01.387173 10107 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:01.388362 16685 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.340122 16925 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:19:01.393558 16685 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.340401 16854 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:01.344615 17010 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:19:01.397348 16685 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.344218 16994 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:19:01.353996 17100 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.398628 16979 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:01.409511 16685 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.410187 16685 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.412250 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.406188 16868 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 13:19:01.400511 17130 consensus_queue.cc:1175] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f145536c6dbe456fb8565950244bc2a5" responder_term: 19 status { last_received { term: 19 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 19 index: 11 } }
I20260709 13:19:01.417840 17085 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.418193 17100 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:01.419170 16994 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:01.419303 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:01.420415 10081 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:01.420663 17021 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.421304 17021 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:01.422808 17128 raft_consensus.cc:3055] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:01.423215 17128 raft_consensus.cc:740] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:01.424093 17128 consensus_queue.cc:260] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.425350 17128 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.426249 10707 raft_consensus.cc:2410] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 22 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:19:01.428375 10038 raft_consensus.cc:1275] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:01.430217 10036 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:01.431680 10031 raft_consensus.cc:1240] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:01.453044 16685 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.456280 17088 consensus_queue.cc:1048] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:01.457149 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.457774 10040 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:01.458878 10004 leader_election.cc:400] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17.
I20260709 13:19:01.462218 10107 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:01.462469 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.463089 10108 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 26.
I20260709 13:19:01.463291 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.463476 10115 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:19:01.463866 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:01.464028 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.464749 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:01.467985 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.471031 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:01.475802 10713 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:01.475898 17078 consensus_queue.cc:1059] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:01.476652 17078 consensus_queue.cc:1243] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer 2f672b54d4754c5aa62b5b919597a14e log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:01.477154 17094 raft_consensus.cc:3055] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:01.477234 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:01.477542 17094 raft_consensus.cc:740] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.478312 17094 consensus_queue.cc:260] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.479460 17094 raft_consensus.cc:3060] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.468798 16685 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:01.481190 16685 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:01.481506 16685 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:01.479964 16863 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:19:01.460017 17006 consensus_queue.cc:1048] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:19:01.446869 16914 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:01.489979 16902 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:01.478336 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.482237 16685 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.501940 16685 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.468336 16966 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.490527 16902 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.507642 16966 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.525588 16902 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.526018 16966 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.504254 16914 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:01.500975 17088 consensus_queue.cc:1059] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:01.482272 17077 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.547268 16860 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:01.547904 16860 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.550247 16860 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.552219 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.554203 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.554765 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.554769 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.556524 16685 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:01.557397 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.558312 16685 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:01.559962 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.541805 17113 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:01.561515 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.562707 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.563283 10036 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:01.563807 10037 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:01.564483 16685 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:01.564817 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:01.565289 16685 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.565716 16685 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:01.564476 10081 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:01.565821 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.555150 17071 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.553226 16983 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.568199 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.568323 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.571074 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.573743 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.568773 16902 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:01.636372 10036 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:19:01.633813 10155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.634125 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.570482 17113 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.638134 16685 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.572103 17006 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:01.571954 17074 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:01.646234 16926 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.646790 16926 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.647558 10109 raft_consensus.cc:1217] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.13->[16.14-16.14]   Dedup: 16.14->[]
I20260709 13:19:01.648064 10109 raft_consensus.cc:1240] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:19:01.574882 16914 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.650990 17051 raft_consensus.cc:3055] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:01.651425 17051 raft_consensus.cc:740] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.652386 17051 consensus_queue.cc:260] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.653213 10038 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:01.653650 17051 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.574478 16983 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.576254 17078 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.660828 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:01.664989 16983 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.667394 17010 raft_consensus.cc:3055] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:01.667824 17010 raft_consensus.cc:740] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.668702 17010 consensus_queue.cc:260] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.670542 17010 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:01.673597 10187 raft_consensus.cc:1275] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:01.571086 17085 consensus_queue.cc:1059] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:19:01.677376 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:01.677764 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.679111 10709 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 20: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:01.640691 17113 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.640563 17006 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.572371 17071 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.677824 16924 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:01.684015 17011 raft_consensus.cc:3060] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.684032 10033 raft_consensus.cc:1240] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:19:01.690963 17006 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:01.676833 16903 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.678267 17100 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:19:01.728328 17146 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:01.720765 16972 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:01.692446 17026 consensus_queue.cc:1048] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:19:01.708033 16854 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.690160 17022 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:01.706633 16924 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:01.676203 16975 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 13:19:01.734308 16997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.027s	sys 0.066s
I20260709 13:19:01.737721 17100 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.749090 17100 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.752049 10715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:01.752111 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:01.753535 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.754088 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.755664 10715 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:01.754122 10107 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:19:01.755829 10108 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:01.757179 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.757680 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:01.758121 10109 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.755625 10708 raft_consensus.cc:1240] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:01.759660 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:01.760890 16926 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.759644 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:01.762780 17101 raft_consensus.cc:3055] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:01.763176 17101 raft_consensus.cc:740] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:01.764300 10035 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:19:01.763973 17101 consensus_queue.cc:260] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.744182 16924 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:01.718516 16903 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.771721 17004 consensus_queue.cc:1059] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:01.772822 17071 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:01.773284 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.773579 17077 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.774129 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:01.774979 10109 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
W20260709 13:19:01.755010 16997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.028s	sys 0.067s
I20260709 13:19:01.777587 17087 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.771812 17145 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:19:01.781054 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:01.787364 10032 raft_consensus.cc:1275] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:01.776736 17101 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.749830 16740 raft_consensus.cc:3055] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:01.788463 10081 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.789462 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.790462 10714 raft_consensus.cc:1240] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:01.800673 10181 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:01.744335 16854 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.802153 16966 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:01.745522 17022 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.802359 16997 consensus_queue.cc:1048] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:01.802907 10106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38954 (request call id 15) took 2466 ms. Trace:
I20260709 13:19:01.803297 10106 rpcz_store.cc:276] 0709 13:18:59.337054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.650651 (+313597us) service_pool.cc:224] Handling call
0709 13:19:01.802712 (+2152061us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000b3bd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e2853 00007f3c744b060a 00007f3c6da367d4 00007f3c6da36762 00007f3c6da36691 00007f3c6da3660c 00007f3c6da358c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:01.802818 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237268736}
I20260709 13:19:01.770406 16855 consensus_queue.cc:1059] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:19:01.806644 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:01.813195 10037 raft_consensus.cc:1813] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Handling vote request from an unknown peer fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.813807 10037 raft_consensus.cc:2410] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:19:01.811115 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:01.811656 10682 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.815032 10679 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:01.805253 17128 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:01.798570 16740 raft_consensus.cc:740] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:01.823029 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:01.826694 10709 raft_consensus.cc:1813] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Handling vote request from an unknown peer fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:01.825623 10681 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.821470 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:01.828727 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.831225 10709 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:01.833112 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:01.818768 17004 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:01.812206 17022 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.799665 17087 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.819593 17132 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:01.807091 16914 consensus_queue.cc:1059] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:19:01.837823 17068 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:01.880908 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:01.881608 10113 raft_consensus.cc:606] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:01.882021 10113 raft_consensus.cc:614] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:01.836999 10153 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:01.838001 16920 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:01.860414 16853 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:01.824973 16970 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.830874 17128 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.887243 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50329.2us
I20260709 13:19:01.863472 17132 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:01.841193 16966 raft_consensus.cc:3055] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:01.922573 16966 raft_consensus.cc:740] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:01.923018 17132 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:01.923401 16966 consensus_queue.cc:260] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.924332 17132 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.924906 16966 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.836663 17010 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:01.928006 17010 raft_consensus.cc:493] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.928380 17010 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:01.887571 17029 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:01.895591 10035 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:01.897080 16903 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:01.900197 10680 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.900876 17087 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.902184 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.934049 10181 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:01.903559 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.904304 16920 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:01.935685 16920 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.939231 16903 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:01.906072 10106 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:01.841009 17002 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:01.940959 17002 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.908269 10034 raft_consensus.cc:1275] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:01.910605 16837 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:01.948817 17029 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:01.911396 16854 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.916568 16853 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:01.921442 16740 consensus_queue.cc:260] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.943526 17002 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.961918 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:01.962085 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.963080 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.964390 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.964576 16763 consensus_queue.cc:260] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.965974 10034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 1454) took 1239 ms. Trace:
I20260709 13:19:01.949853 17128 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:01.966388 10034 rpcz_store.cc:276] 0709 13:19:00.718583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.718744 (+   161us) service_pool.cc:224] Handling call
0709 13:19:00.719075 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.943977 (+1224902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.957948 (+ 13971us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400238cd4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:01.958128 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2734073088}
I20260709 13:19:01.985802 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.949386 17029 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.994845 17010 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:01.996644 10679 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:02.000118 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.000627 17125 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:02.001029 17125 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.001362 17125 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.001960 17029 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:01.991590 16763 raft_consensus.cc:3060] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:02.001500 17010 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:01.991994 17023 consensus_queue.cc:1048] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:19:02.004900 10714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 1102) took 1448 ms. Trace:
I20260709 13:19:02.005280 10714 rpcz_store.cc:276] 0709 13:19:00.556696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.556841 (+   145us) service_pool.cc:224] Handling call
0709 13:19:00.949465 (+392624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.800682 (+851217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.004086 (+203404us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54006ad6d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:02.004732 (+   646us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54006ad6d0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e78ad 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:02.004842 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835896960}
I20260709 13:19:02.008009 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.001991 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:01.950019 16970 raft_consensus.cc:515] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:02.000298 17149 log.cc:927] Time spent T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:01.998180 16853 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.012717 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:01.958570 17113 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.016362 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.020239 10184 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:02.025193 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.025923 10106 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:19:02.032636 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.033619 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.036371 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.038673 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.042569 10106 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 24: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:02.046348 10184 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:02.047443 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.049587 10679 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:02.050473 17023 raft_consensus.cc:2804] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:02.051002 17023 raft_consensus.cc:697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:02.051910 17023 consensus_queue.cc:237] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.063246 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.065361 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:02.109025 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 43755.1us
I20260709 13:19:02.111914 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.112681 10111 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:19:02.119907 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.120605 10113 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:02.121627 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.122306 10109 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:02.104854 16781 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:02.105881 17100 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:02.125535 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 142092us
I20260709 13:19:02.111608 17002 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:02.068240 17006 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.135443 10106 raft_consensus.cc:1275] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:02.142625 16983 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.145367 16983 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.128981 17100 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.148917 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.151682 10184 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:02.152530 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.154824 10112 raft_consensus.cc:1240] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:02.156803 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.157500 10113 raft_consensus.cc:3060] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:02.147759 16983 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.129839 16781 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.154330 17100 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.189170 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:02.167886 16855 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:02.175333 17087 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:02.197965 10079 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:19:02.200027 17156 log.cc:927] Time spent T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:19:02.202531 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.204742 17152 log.cc:927] Time spent T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.373s	user 0.004s	sys 0.000s
I20260709 13:19:02.206836 16740 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.214725 17087 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.236398 17087 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.246896 10713 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:19:02.247668 17071 consensus_queue.cc:1048] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:02.217583 17006 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.253580 16970 leader_election.cc:290] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.227474 16685 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.230944 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:02.223608 10113 raft_consensus.cc:2468] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:02.256299 10031 pending_rounds.cc:85] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 12
I20260709 13:19:02.260042 10031 pending_rounds.cc:107] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:19:02.260347 10031 raft_consensus.cc:2889] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:02.267540 10187 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 26: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:02.247587 17010 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.285388 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.283089 17101 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.288132 17101 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.290458 17101 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.294113 16854 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.294703 16854 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.295058 17133 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:02.295584 17133 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.296878 16854 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:02.297564 17133 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:02.286226 16837 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.300295 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.220081 16914 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.224766 17113 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.211733 16924 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.232429 16932 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:02.225670 16781 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.313134 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.313153 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.255503 17132 consensus_queue.cc:1059] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:19:02.214937 16855 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.218979 17125 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.316015  9935 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 17 to 18, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.312213 17113 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.317030 17101 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:02.286834 17010 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.352952 10714 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:02.340216 17132 raft_consensus.cc:3055] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:02.356024 17132 raft_consensus.cc:740] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:02.356981 17132 consensus_queue.cc:260] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.358255 17132 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.350301 17101 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:02.360440 17101 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:02.314446 16837 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.366910 16837 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.350155 17113 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.368404 17128 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.369596 17113 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:02.370412 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.371356 10713 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:02.347730 16924 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:02.377009 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.377547 10184 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:19:02.383375 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:02.394327 10185 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:02.383042 17128 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:02.386035 17071 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:02.403901 17087 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.408866 17128 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:02.409494 17128 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.410063 17125 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.403240 17071 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.411468 17071 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.411887 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.412462 10111 raft_consensus.cc:3060] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.413964 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.415091 16972 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:02.415831 17162 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:02.411342 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.417572 10106 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.417603 16855 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:02.421799 17150 log.cc:927] Time spent T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.631s	user 0.003s	sys 0.008s
I20260709 13:19:02.424649 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:02.425485 17128 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.431495 17100 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.433043 10184 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 22: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:02.435222 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:02.439494 16972 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:02.440352 16972 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.441031 17087 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.442619 16972 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:02.443214 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 222673us
I20260709 13:19:02.447081 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.448026 10711 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:02.451713 16763 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.452090 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.415179 10003 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.453774 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.454316 16983 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.455003 16983 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:02.456200 17167 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:19:02.457945 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.459142 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.459899 16763 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:02.461305 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.461912 10040 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:02.459486 17130 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:02.462669 17130 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.465370 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.465775 17130 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.462082 10114 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:02.469206 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.469898 10036 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:02.469475 17101 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.469280 10114 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:02.470293 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.471112 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.471733 10110 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:02.472126 10036 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 26.
I20260709 13:19:02.473086 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.473795 10040 raft_consensus.cc:2393] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:02.475216 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:02.475325 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.475926 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:02.476109 10115 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:02.477358 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:02.473866 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.479349 17130 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:02.479852 17130 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.480245 17130 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:02.480679 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.482916 17010 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.483932 10110 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:02.485975 10039 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:02.486732 16972 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:02.487941 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:02.488535 10034 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.459543 17100 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.490715 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.492105 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:02.493381 17071 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.495002 10035 raft_consensus.cc:1240] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:02.497828 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.498433 10185 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:19:02.499398 10187 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:19:02.501829 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.501106 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:02.502607 10107 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22.
I20260709 13:19:02.501842 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.500991 10182 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:02.504606 10180 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:02.505607 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.506263 10109 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:02.507050  9935 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 21 to 22, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 22 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.508716  9935 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 11 to 12, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 12 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.510506 10114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:02.510196  9935 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 15 to 16, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 16 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.511128 10114 raft_consensus.cc:606] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:19:02.512550 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.513186 10107 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 24.
I20260709 13:19:02.501402 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.501011 17114 raft_consensus.cc:3055] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:02.514750 17114 raft_consensus.cc:740] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:02.515560 17114 consensus_queue.cc:260] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.516829 17114 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.517020  9933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 200) took 7501 ms. Trace:
I20260709 13:19:02.519573 10680 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.522814 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.447081 10111 raft_consensus.cc:2468] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:19:02.524530 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.511689  9935 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 18 to 19, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 19 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.529194 10106 raft_consensus.cc:2468] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:19:02.532037 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
W20260709 13:19:02.529927 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 73511.5us
I20260709 13:19:02.532295 10035 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:02.535171 10110 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:19:02.532122 10040 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:02.537919 10034 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:19:02.533977 10680 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:02.535612 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:02.538272 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.539021 10111 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 24: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:02.540534 10714 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:02.527163  9935 catalog_manager.cc:5697] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 19 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:02.543870  9935 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 13 to 14, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 14 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:02.545642 10035 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.546613 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.547902 10034 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:02.548386 10108 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 26.
W20260709 13:19:02.551563 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50710.8us
I20260709 13:19:02.551930 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.552551 10716 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
W20260709 13:19:02.553574 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62924.4us
I20260709 13:19:02.554353 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.553524 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:02.555212 10033 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:19:02.496587 17101 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.556670 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:02.560400 10106 raft_consensus.cc:2393] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:02.562148 10680 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:02.562615 10709 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:19:02.559248 16685 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:02.557482 10153 leader_election.cc:400] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22.
I20260709 13:19:02.559681 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.564114 10181 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 24.
I20260709 13:19:02.564437 16685 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:02.462016 16763 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.566438 10153 leader_election.cc:403] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:02.568161 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.548704 17021 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.568536 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.570847 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5cf83b6b34444eb97230c9c7106ca4" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.573372 10189 raft_consensus.cc:2393] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 23: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:02.573863 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.577869 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.555941 17088 raft_consensus.cc:2804] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:02.578691 10185 raft_consensus.cc:2393] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 15: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:02.576445 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:02.574544 10180 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:02.566187 16739 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:19:02.609939 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:02.610287 10182 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:19:02.563571 16730 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:02.557627 16932 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.580408 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:02.618857 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.558288 16983 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:02.577698 17101 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:19:02.624511 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62451.4us
I20260709 13:19:02.628386 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.577558 16769 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:02.625077 17051 raft_consensus.cc:2804] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:02.565971 17087 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.621430 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:02.566310 17010 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:02.612139 17133 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:02.632695 10182 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:02.621522 17002 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:19:02.694835 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 73477.9us
I20260709 13:19:02.715817 16993 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:02.634204 16769 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.716956 16769 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:02.633674 17088 raft_consensus.cc:697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:02.720808 17088 consensus_queue.cc:237] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.721767 16855 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:02.722216 16855 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:02.722581 16855 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:02.724026 10153 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.726897 17100 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.699128 17087 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.634073 16739 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:02.726212 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:02.630409 16983 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:02.579947 17021 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.632093 17163 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:19:02.700986 17131 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:02.697343 17051 raft_consensus.cc:697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:02.696923 17133 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:02.737174 16983 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.732203 16739 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:02.734776 17002 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:02.750110 17004 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:02.754412 17131 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:02.773006 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 212672us
I20260709 13:19:02.777871 10004 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:02.791534 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.760635 17133 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.771344 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:02.802178 17131 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.839401 10031 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.803174 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:02.848781 17131 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.849877 10707 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 18. (term mismatch)
I20260709 13:19:02.850332 10707 pending_rounds.cc:85] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Aborting all ops after (but not including) 17
I20260709 13:19:02.850549 10707 pending_rounds.cc:107] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Aborting uncommitted NO_OP operation due to leader change: 21.18
I20260709 13:19:02.850795 10707 raft_consensus.cc:2889] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:02.851975 17131 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:02.852170 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:02.854068 10716 raft_consensus.cc:2368] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:02.856069 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:02.856842 10716 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:02.868451 10031 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:02.877554 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:02.878520 10182 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 21: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:02.801532 17128 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.836995 16730 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.837303 17004 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:19:02.891057 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 267781us
I20260709 13:19:02.869975 17071 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:02.837062 16763 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:19:02.886982 17100 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.897119 10035 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:02.901309 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.889277 16740 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:02.913738 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.901762 17101 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22.
I20260709 13:19:02.903839 16972 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:02.904479 17182 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:02.893934 17128 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.912194 17006 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:19:02.939345 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 311014us
I20260709 13:19:02.920181 16863 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:02.944535 10078 leader_election.cc:304] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:02.906538 17002 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.905527 17100 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:02.900650 17051 consensus_queue.cc:237] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.956015 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:02.915397 16740 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:02.984748 10112 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:02.958122 10109 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:02.934769 17117 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:02.956728 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:02.966696 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:02.976289 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 113899us
I20260709 13:19:02.983134 10184 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:19:03.009588 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:03.010355 10707 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:19:02.517607  9933 rpcz_store.cc:276] 0709 13:18:55.088647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.115091 (+ 26444us) service_pool.cc:224] Handling call
0709 13:19:02.516912 (+7401821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:00.356870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:00.357594 (+   724us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:00.357640 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:19:00.357657 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:00.358270 (+   613us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:00.434814 (+ 76544us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:00.443313 (+  8499us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:00.566398 (+123085us) tablet.cc:701] Row locks acquired
0709 13:19:00.595636 (+ 29238us) write_op.cc:260] PREPARE: finished
0709 13:19:00.595835 (+   199us) write_op.cc:270] Start()
0709 13:19:00.596007 (+   172us) write_op.cc:276] Timestamp: P: 1783603140595767 usec, L: 0
0709 13:19:00.596028 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:00.669436 (+ 73408us) log.cc:844] Serialized 1302 byte log entry
0709 13:19:01.196210 (+526774us) op_driver.cc:464] REPLICATION: finished
0709 13:19:01.341698 (+145488us) write_op.cc:301] APPLY: starting
0709 13:19:01.343866 (+  2168us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:01.480625 (+136759us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:01.480726 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:01.482467 (+  1741us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:01.482652 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:19:01.482694 (+    42us) write_op.cc:312] APPLY: finished
0709 13:19:01.482883 (+   189us) log.cc:844] Serialized 41 byte log entry
0709 13:19:01.483040 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.483129 (+    89us) write_op.cc:454] Released schema lock
0709 13:19:01.483173 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:01.483604 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.483631 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3222887,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":71558,"apply.run_cpu_time_us":6495,"apply.run_wall_time_us":158785,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":325337,"prepare.run_cpu_time_us":30660,"prepare.run_wall_time_us":474370,"raft.queue_time_us":265497,"raft.run_cpu_time_us":8772,"raft.run_wall_time_us":86308,"replication_time_us":581535,"thread_start_us":673984,"threads_started":4,"wal-append.queue_time_us":214318,"wal-append.run_cpu_time_us":45068,"wal-append.run_wall_time_us":1596801}]]}
I20260709 13:19:03.030907 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:02.947036 17006 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:02.945544 17004 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.008991 17117 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:02.984351 17021 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:03.092684 10112 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:02.955874 16863 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.035607 17186 raft_consensus.cc:2749] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:02.984314 16763 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.102s
I20260709 13:19:02.958778 17087 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.075343 17187 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:03.091656 17117 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:03.115010 10004 leader_election.cc:400] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:03.121507 10004 leader_election.cc:403] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:03.128887 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 162199us
W20260709 13:19:03.125471 17181 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:19:03.121417 17187 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.126272 17199 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.137810 17199 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.130585 16781 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:03.141662 17199 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.223342 17199 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.223986 17199 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:03.226068 16769 consensus_meta.cc:287] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:19:03.226251 17199 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.226572 16769 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.228953 16920 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.229513 16920 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.230815 17198 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.231333 17198 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:03.232307 17184 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:19:03.233493 17198 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.233357 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.231639 16920 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.234023 17100 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:03.234598 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.246411 10180 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:03.234881 17128 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:03.240130 10680 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.186.254:36577, user_credentials={real_user=slave}} blocked reactor thread for 91480.8us
W20260709 13:19:03.223515 16855 consensus_meta.cc:287] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:19:03.129734 17197 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:03.258926 10180 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:03.256771 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.247896 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:03.258706 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.262223 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:03.260780 10186 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:19:03.152997 17187 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:03.270911 17182 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:19:03.258569 17180 log.cc:927] Time spent T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:19:03.126552 17006 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.270612 17199 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:03.316044 16740 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:03.316397 17202 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:03.322501 16739 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.323808 17203 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.326478 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:03.328413 17087 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.340438 10106 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:03.330885 17125 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:03.278421 17088 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:03.343220 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:03.258823 16855 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:03.331720 17130 consensus_meta.cc:287] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.001s
I20260709 13:19:03.365274 17130 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.366576 17117 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.351332 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:03.352240 16994 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:03.352367 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:03.332360 17198 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.335863 16769 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:03.273033 17071 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:19:03.333878 17199 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.356151 17022 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.395661 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:03.398267 10185 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:03.363125 16983 consensus_meta.cc:287] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.002s
I20260709 13:19:03.331872 17201 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.359515 17114 consensus_meta.cc:287] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.000s
I20260709 13:19:03.373082 10033 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:19:03.352895 16855 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.369585 16739 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:03.419426 10111 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:19:03.421572 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:03.429960 10185 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 24.
I20260709 13:19:03.398381 17199 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:03.438376 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:03.437606 10003 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:03.439812 10111 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:19:03.375465 17026 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.414525 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:03.395093 17130 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.397759 17088 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:03.439919 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:03.449064 10108 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.443310 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:03.450013 10112 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:19:03.348779 17087 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.455164 17200 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:03.405161 16983 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.466686 16983 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.470110 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:03.470952 10112 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 15: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
W20260709 13:19:03.471628 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.473856 10679 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:03.478341 17194 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:03.478824 17194 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.479189 17194 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.345942 17203 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.396173 16994 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.437158 16863 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.496539 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:03.496114 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:03.503427 10035 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:19:03.505031 10108 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 24.
I20260709 13:19:03.505689 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:03.409240 16997 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 13:19:03.510738 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:03.398720 17198 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.509529 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.516425 17100 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:03.520576 17128 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:03.522765 17101 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.522972 17187 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.523617 10155 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:03.525060 16994 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.525892 10110 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:03.407694 17201 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.404225 17022 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.527529 17131 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.454206 17026 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:03.529282 17211 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:03.535777 17210 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:03.519479 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:03.516482 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.523413 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:03.519636 10037 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:19:03.628093 10037 pending_rounds.cc:85] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 9
I20260709 13:19:03.452077 17196 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.562530 10034 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:19:03.570453 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:03.535633 17133 consensus_meta.cc:287] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
I20260709 13:19:03.502710 17197 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.628367 10037 pending_rounds.cc:107] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.10
I20260709 13:19:03.516417 16975 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.629495 10186 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 19: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:03.628311 10033 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:03.636130 10037 raft_consensus.cc:2917] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Aborting config change with OpId 16.10: Aborted: Op aborted by new leader
W20260709 13:19:03.628289 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 104716us
I20260709 13:19:03.565729 17128 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:03.435784 17182 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.636649 10037 raft_consensus.cc:2889] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.586825 17131 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.644181 10112 raft_consensus.cc:1275] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:03.646173 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:03.701656 10106 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:03.568313 17100 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:03.743438 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.579973 17101 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.824911 10037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58318 (request call id 2) took 11558 ms. Trace:
I20260709 13:19:03.646461 17087 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.646768 17117 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.634112 17196 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.639350 17068 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:03.653301 17128 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:03.879827 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 309454us
I20260709 13:19:03.638449 17187 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:03.826506 17206 log.cc:927] Time spent T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:19:03.640677 17026 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:03.869324 10037 rpcz_store.cc:276] 0709 13:18:52.266213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.270158 (+  3945us) service_pool.cc:224] Handling call
0709 13:18:52.487189 (+217031us) log.cc:844] Serialized 506 byte log entry
0709 13:18:52.749746 (+262557us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18003abfa0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:52.763919 (+ 14173us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18003abfa0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3c92a6 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f461142 00007f3c6f441eaa 00007f3c6f448d53
0709 13:18:52.785090 (+ 21171us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18003abfa0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb522 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:18:52.813050 (+ 27960us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b5400018c20. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f461142 00007f3c6f441eaa 00007f3c6f448d53 00007f3c6f448cd9 00007f3c6f448c69 00007f3c6f448c31 00007f3c6f447dfd 000000000038f354 000000000038f199 00007f3c6c3fb475
0709 13:19:03.824749 (+11011699us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19216,"raft.queue_time_us":28754,"raft.run_cpu_time_us":4983,"raft.run_wall_time_us":199717,"spinlock_wait_cycles":29925120,"thread_start_us":108569,"threads_started":1,"wal-append.queue_time_us":209171,"wal-append.run_cpu_time_us":2041,"wal-append.run_wall_time_us":1071590}
I20260709 13:19:03.824970 16972 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.927958 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:03.705205 17189 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.825261 16983 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:19:03.933023 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 294164us
I20260709 13:19:03.933840 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:03.844837 17200 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 24 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:03.845579 17226 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:03.903590 17068 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.958632 10037 pending_rounds.cc:107] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:19:03.964074 10037 raft_consensus.cc:2889] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:03.935330 17193 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:19:03.960899 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.651757 17197 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.638494 17133 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.702481 16975 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.975548 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.637014 17210 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.980232 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:03.629508 17088 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:03.956598 17026 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:03.964001 17195 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:03.970377 17068 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:03.955873 16972 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:03.983435 17225 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.036337 10186 raft_consensus.cc:2410] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
W20260709 13:19:03.991673 16739 consensus_meta.cc:287] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.006s
I20260709 13:19:03.962178 16983 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.001679 17195 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.068236  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 6e77e3a0687c460f8d3f29e5194c49e9: Aborted: Op aborted by new leader
I20260709 13:19:04.040943 17225 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.070319 16975 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.072104 17203 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:03.960284 17189 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:04.087810 17219 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:19:04.088146 17101 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.088521 17203 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.089135 17203 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.090332 17189 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.091208 17203 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.092829 17225 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:04.094583 17222 log.cc:927] Time spent T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:19:04.098748 10184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39164 (request call id 2773) took 1527 ms (client timeout 1933 ms). Trace:
I20260709 13:19:04.101264 10189 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 LEADER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:19:04.104591 17100 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.105958 17196 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.080749 17200 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.080755 16994 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.106951 16994 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.109241 16994 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.109999 17201 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.111601 17133 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.113512 17210 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:03.970714 17226 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.115866 17226 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.118039 17197 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.119258 10185 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 17.
I20260709 13:19:04.002291 17026 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.122097 17026 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:04.099242 10184 rpcz_store.cc:269] 0709 13:19:02.571354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.571490 (+   136us) service_pool.cc:224] Handling call
0709 13:19:04.098537 (+1527047us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54002dbed4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:04.098674 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749428992}
I20260709 13:19:04.079807 17195 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.125067 16994 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.125597 17203 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.122892 17198 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.127878 17215 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.127722 17022 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.186828 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:04.185066 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:04.126840 17223 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:04.194707 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.217790 10714 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:19:04.197930 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.177145 17010 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.221994 10680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.007s
W20260709 13:19:04.222517 10680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.008s
I20260709 13:19:04.221313 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.227887 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.212252 17131 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.225703 10108 raft_consensus.cc:1275] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:04.231012 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.221418 17210 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:04.231490 10107 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 10.
I20260709 13:19:04.127593 17068 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.221203 17197 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.236078 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.219542 17130 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.236183 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:04.237005 17217 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.006s	sys 0.008s
W20260709 13:19:04.240542 17217 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.006s	sys 0.008s
I20260709 13:19:04.238735 17197 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:04.242069 17197 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.228653 17082 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:04.182534 16994 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.224632 17010 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:04.223881 17026 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.243481 10112 raft_consensus.cc:2410] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:19:04.186640 17203 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.306301 17026 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.214567 17215 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.308668 17026 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.309419 17215 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.238751 17210 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.238827 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:04.313519 17027 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.314847 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 76109.8us
I20260709 13:19:04.269011 16972 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.269698 16983 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.246069 17082 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.245124 17130 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.341903 17203 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.274243 17128 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.342594 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:19:04.277735 17199 consensus_meta.cc:287] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.000s
I20260709 13:19:04.344034 17199 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.346143 17199 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:04.255645 17194 consensus_meta.cc:287] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.776s	user 0.000s	sys 0.010s
I20260709 13:19:04.279901 17068 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.316112 17210 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.347290 10031 raft_consensus.cc:2393] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 23: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:04.347584 17215 consensus_queue.cc:1048] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:04.348268 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.285495 16994 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.288933 10036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55698 (request call id 1482) took 1555 ms. Trace:
I20260709 13:19:04.292536 17201 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:04.349375 17023 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:04.350710 17023 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.349140 10036 rpcz_store.cc:276] 0709 13:19:02.733163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.733291 (+   128us) service_pool.cc:224] Handling call
0709 13:19:02.733578 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.733781 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:02.906174 (+172393us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.288453 (+1382279us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180039a180. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6f0904bc 00007f3c6c3de48b 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287
0709 13:19:04.288560 (+   107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.288609 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:04.288663 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.288743 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.288862 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179,"prepare.queue_time_us":293909,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":194137,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5768,"spinlock_wait_cycles":25551616,"thread_start_us":323204,"threads_started":2}
W20260709 13:19:04.347452 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.352145 17210 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:04.350086  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 050435abbd194f2ea45db6d7a8974831: Illegal state: Replica fd3903ba079e4f47aaf0aa4432382c23 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 26 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:19:04.302099 17177 log.cc:927] Time spent T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 1.693s	user 0.000s	sys 0.026s
I20260709 13:19:04.354470 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.331243 16837 consensus_queue.cc:1048] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:04.332878 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.364002 10111 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:04.324003 17027 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.314409 17026 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:04.375994 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.376740 10037 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:04.377355 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.377970 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.378494 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.378968 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.380030 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.318964 10680 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.217289 17223 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.351073 17023 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:04.355509 10040 raft_consensus.cc:2368] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:19:04.352653 17210 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.354276 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.396327 17245 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.300711 17195 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.397169 17245 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.398828 17232 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:04.360581 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.399348 17232 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:04.398729 17195 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.399601 17245 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.400077 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.400718 10037 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:19:04.356496 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.402233 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.402416 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.374536 10113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53672 (request call id 1574) took 2111 ms. Trace:
I20260709 13:19:04.404009 10113 rpcz_store.cc:276] 0709 13:19:02.263053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.265694 (+  2641us) service_pool.cc:224] Handling call
0709 13:19:02.316068 (+ 50374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.321521 (+  5453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.321551 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.322155 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:19:02.384886 (+ 62731us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:02.384921 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.384973 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.301463 (+1916490us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:19:04.355695 (+ 54232us) raft_consensus.cc:1685] finished
0709 13:19:04.355718 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.374455 (+ 18737us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5065,"raft.queue_time_us":5178,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":22537,"spinlock_wait_cycles":7448448,"thread_start_us":24826,"threads_started":1,"wal-append.queue_time_us":182406}
I20260709 13:19:04.375149 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.405462 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:04.381227 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 64668.2us
I20260709 13:19:04.367676 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.408787 17226 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.409353 17226 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.410159 17232 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.411137 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.411900 17133 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:04.412509 17133 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.408453 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:04.414216 10709 raft_consensus.cc:2393] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:04.414721 17133 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.342545 17130 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.396394 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.400957 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.436335 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.408236 17068 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.394407 17163 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.415618 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.395197 16920 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:04.416311 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.416590 10034 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 17: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:04.417024 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.340963 17082 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:04.416054 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 482273us
W20260709 13:19:04.382624 10004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.354321 17203 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.419677 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.421025 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.420816 17226 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.424973 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.478127 10187 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.425662 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.479913 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.480618 10185 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:04.481546 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.425876 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.426066 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.424598 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.428138 17010 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.430251 17223 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.492376 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.381615 17199 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:04.495572 17226 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.424497 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.496126 17226 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.433709 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.497936 10036 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 11.
I20260709 13:19:04.434419 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.420812 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 3253) took 1181 ms. Trace:
I20260709 13:19:04.436407 10108 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:04.437050 10188 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:04.393638 10040 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:04.366577 16863 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.415383 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.502553 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.438230 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.391215 17188 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.504204 10180 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:04.504590 17188 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.394665 16994 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.505201 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.395387 16983 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:04.505968 16983 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.346894 17194 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:04.506390 10078 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.186.195:39091 timed out after 1.933s (SENT) [suppressed 12 similar messages]
I20260709 13:19:04.349674 17201 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.446419 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.450937 10111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:04.453639 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:04.507694 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44999.8us
I20260709 13:19:04.508008 10111 raft_consensus.cc:606] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:04.423970 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:04.508767 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55498us
I20260709 13:19:04.507957 10716 raft_consensus.cc:2368] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:04.506451 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.500272 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.510221 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.510450 10180 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:04.474211 10184 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:19:04.461509 10183 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:04.512709 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.486063 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.486450 10037 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:19:04.487371 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.442126 16920 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.492239 17004 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.496527 10112 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 10.
I20260709 13:19:04.376410 17026 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.523537 17026 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.524055 17248 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:19:04.525547 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.505610 16994 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.527805 17004 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.528753 17101 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:04.529181 17101 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.529515 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 43534.8us
I20260709 13:19:04.529712 17227 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:04.530288 16994 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.517148 16920 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.529531 17101 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.531810 10106 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:04.532734 16763 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.533270 16763 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.535388 16763 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.530616 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:04.492472 17246 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.536464 17246 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.537848 17023 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.538610 17246 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.539173 17246 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:04.539914 17182 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.540277 10110 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:04.540693 16740 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:04.541378 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:04.540421 17182 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.542627 10081 leader_election.cc:400] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:19:04.542912 10081 leader_election.cc:403] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:04.543817 17100 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.544198 17182 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.544663 17239 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:04.443089 17068 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.571139 10110 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 27.
I20260709 13:19:04.499307 10187 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:04.499333 10181 rpcz_store.cc:276] 0709 13:19:03.239492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.239636 (+   144us) service_pool.cc:224] Handling call
0709 13:19:03.239939 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.240129 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:19:03.575292 (+335163us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.921241 (+345949us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.353540 (+432299us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b180041c140. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f4e0060 00007f3c6f4f2716 00007f3c6f503287 00007f3c6f503208
0709 13:19:04.404145 (+ 50605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.404200 (+    55us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:19:04.404246 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.404311 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.420756 (+ 16445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":686,"prepare.queue_time_us":410980,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":544276,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"spinlock_wait_cycles":4816768,"thread_start_us":698448,"threads_started":3}
I20260709 13:19:04.502216 10713 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 25: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:04.580557 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.580775 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.513628 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.513998 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.516374 10004 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.519280 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.544859 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.582201 10037 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.500316 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.546541 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.582334 10184 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:04.583283 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 76926.4us
I20260709 13:19:04.544376 10115 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:19:04.548729 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:04.584275 10714 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:04.549019 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.581450 10187 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:04.546777 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.548802 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.501387 10033 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:19:04.557359 16964 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.558137 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.517658 16739 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.477034 17203 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.507622 17245 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.561141 17101 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:04.599395 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 52694.1us
I20260709 13:19:04.600332 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:04.518250 17130 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:04.587196 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 73292.4us
I20260709 13:19:04.587604 10682 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.603770 10185 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:04.530107 17004 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.590512 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.605857 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.606956 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.590924 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.509203 17128 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.591476 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.557268 17117 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:04.518007 17223 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:04.609226 17001 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.447242 17163 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.496029 17199 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.610523 17245 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.634274 17199 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.530243 17227 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.634981 17227 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:04.637460 17068 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.616329 17223 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.639091 17203 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.640532 17223 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:04.610100 17200 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:04.644927 10032 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:04.545599 17239 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:04.600966 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.585676 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:04.602108 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85806.9us
I20260709 13:19:04.595157 17246 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:04.563350 16920 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.608897 10153 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:04.595316 16972 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:04.606253 10113 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:04.607544 10188 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:19:04.660174 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.613230 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.661057 10112 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:19:04.544359 17100 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.614866 10109 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:04.609598 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.544603 17027 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.617923 10037 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:04.653578 17239 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:04.667078 17239 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.668130 17239 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.668843 17100 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.619092 17233 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:04.620780 10183 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 27: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:04.671025 16920 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.620023 17023 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.672256 10707 raft_consensus.cc:2393] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 12: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:04.665601 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.604898 17132 consensus_queue.cc:1059] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:19:04.609982 16860 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:04.626708 17101 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.628007 17010 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 25 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.603989 17130 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.616797 16930 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:19:04.612756 17117 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.648312 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:04.644384 17200 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.723870 17200 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:04.619482 17226 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.652532 10182 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:04.728446 17188 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.719878 17130 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:04.729175 17194 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.654610 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.597473 10184 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:04.657909 10153 leader_election.cc:403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:19:04.658928 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:19:04.731920 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 129545us
I20260709 13:19:04.732489 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.733100 10107 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:19:04.663789 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54223us
I20260709 13:19:04.665505 17082 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.736140 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.737258 10003 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.737762 17082 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.739163 17117 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:04.646505 17243 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:04.740988 16685 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:04.731442 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 76904.7us
I20260709 13:19:04.741466 16685 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:04.741591 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.664635 10114 raft_consensus.cc:2393] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 25: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:04.673267 10034 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.626164 16983 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.674063 10187 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:04.677001 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.750458 10036 raft_consensus.cc:3060] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:04.632579 17210 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.634567 17245 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:04.674000 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 58368.8us
I20260709 13:19:04.678094 16860 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.760835 16860 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:04.763171 10034 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:04.631372 17026 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.748870 17226 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:04.663193 16972 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.722800 10186 raft_consensus.cc:2376] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22. Re-sending same reply.
I20260709 13:19:04.770499 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.742170 10110 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.743180 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.744206 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.777724 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.778241 10184 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:04.778771 10714 raft_consensus.cc:2410] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:19:04.735409 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:04.779978 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44640.3us
I20260709 13:19:04.745043 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.748454 16685 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:04.748720 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 131538us
I20260709 13:19:04.743321 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.780838 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.749619 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.781890 10114 raft_consensus.cc:2393] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:04.719249 17163 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.765144 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:04.785130 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.789268 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.790020 10709 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:19:04.790831 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.740942 17182 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.786299 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.796214 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.797045 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.796595 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.783377 10081 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:04.794572 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.798079 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.795121 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.787528 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:04.793936 10036 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:19:04.824746 10110 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:19:04.765144 17199 raft_consensus.cc:2764] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:19:04.798193 10114 raft_consensus.cc:2368] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20.
I20260709 13:19:04.779552 16972 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:04.823998 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.752605 17132 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:19:04.783763 16739 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:04.876550 16739 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.878904 16739 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.879426 16739 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:04.846280 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:04.839720 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52271.1us
I20260709 13:19:04.844436 10107 raft_consensus.cc:2468] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 12.
I20260709 13:19:04.919325 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.852140 10680 leader_election.cc:400] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20.
I20260709 13:19:04.920435 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.920734 10680 leader_election.cc:403] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:19:04.921125 10107 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:04.833280 10186 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:04.839201 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:04.921895 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 81690.5us
I20260709 13:19:04.827584 17163 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:04.851584 17213 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:04.858070 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:19:04.860060 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:04.846982 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.929234 10031 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:04.930208 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.831705 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.859675 17223 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.927991 16837 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:04.931576 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.932679 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.862968 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.936442 10033 raft_consensus.cc:1240] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:19:04.868896 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.937254 17223 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.937988 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.859706 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.939618 10709 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:04.870152 10711 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:04.839255 17100 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:04.940598 17100 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:04.941634 17100 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.846814 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.871479 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.872141 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:04.944777 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 72743.8us
I20260709 13:19:04.945791 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:04.875553 17200 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.946141 17199 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.879927 10038 raft_consensus.cc:2468] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:04.917989 16739 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.949250 17200 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.949251 16739 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:04.951349 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93370.7us
I20260709 13:19:04.952534 10682 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:19:04.952728 17130 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.953557 10682 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:19:04.954592 10682 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:19:04.954953 17087 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:04.949550 10114 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 25.
I20260709 13:19:04.889183 16964 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23.
I20260709 13:19:04.955403 17087 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:04.893335 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.946882 16685 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:04.955845 17087 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.957615 10109 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:04.946017 10110 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:19:04.959443 17072 raft_consensus.cc:2804] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:04.959973 17212 raft_consensus.cc:2804] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:04.960006 17072 raft_consensus.cc:697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:04.960515 17212 raft_consensus.cc:697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:04.961470 17072 consensus_queue.cc:237] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.961411 17212 consensus_queue.cc:237] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.884848 17026 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.896270 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.958295 10031 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:04.969085 10033 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:04.974601 10036 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:04.979264 16685 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:04.979969 16685 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.830179 17234 raft_consensus.cc:2764] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:04.905862 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.978242 17087 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:04.985275 10111 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:19:04.984889 16972 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.906601 17117 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:04.908473 10716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42408 (request call id 1371) took 1407 ms (client timeout 1630 ms). Trace:
W20260709 13:19:04.831540 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 46513.4us
I20260709 13:19:04.795887 17226 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:04.836942 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50735.4us
I20260709 13:19:04.845794 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:04.827122 17245 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.920284 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:04.922335 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:04.854013 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:05.003834 10032 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:04.924521 16860 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.927042 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:04.998170 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:19:05.007903 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.947347 10003 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:19:05.008981 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 61707.6us
I20260709 13:19:05.009797 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:04.951447 17240 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:04.891325 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:04.894869 17227 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:04.884238 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:05.013191 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 129032us
I20260709 13:19:05.013926 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.015594 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.016165 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:04.988749 10716 rpcz_store.cc:269] 0709 13:19:03.501621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.501768 (+   147us) service_pool.cc:224] Handling call
0709 13:19:04.908266 (+1406498us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54005dff54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:04.908409 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024666880}
I20260709 13:19:05.016968 10188 raft_consensus.cc:2368] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:04.989213 17087 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:04.990070 10108 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:04.997073 16685 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:04.999140 10153 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:05.018817 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.019483 10180 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:05.020453 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.022773 10181 raft_consensus.cc:2368] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:19:05.023324 16860 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:05.023813 17227 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:04.996313 17203 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:05.025118 17199 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:05.028813 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:19:05.029938 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.030149 16972 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:05.030711 17200 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:05.033022 17248 raft_consensus.cc:2804] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:05.033710 17248 raft_consensus.cc:697] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:05.034772 17248 consensus_queue.cc:237] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.012557 16739 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:04.999662 17130 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:05.036972 17130 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:05.037657 17130 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:04.997758 17226 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.031620 17223 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 13:19:05.039511 17223 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:05.041404 17223 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:05.041631 10035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39426 (request call id 3279) took 1512 ms. Trace:
I20260709 13:19:05.042227 17223 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.043629 16739 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:05.044210 17240 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:05.044623 16739 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.045219 17117 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.045744 17240 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.042023 10035 rpcz_store.cc:276] 0709 13:19:03.528806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.528988 (+   182us) service_pool.cc:224] Handling call
0709 13:19:03.529307 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.004297 (+474990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.004344 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.004396 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:04.004425 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.041383 (+1036958us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540031bad4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4e8e01 00007f3c6f4e783e 00007f3c744ac419 00007f3c6da23bd4 00007f3c6da23b62 00007f3c6da23a91 00007f3c6da23a0c 00007f3c6da22cc2 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:05.041435 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.041573 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091777408}
I20260709 13:19:05.045092 17216 raft_consensus.cc:493] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.037077 16763 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:05.048271 16763 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.048732 16763 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:05.052395 17216 raft_consensus.cc:515] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.055343 17133 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.056144 16983 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:05.056571 16983 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.056928 16983 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.022258 10153 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.060585 17245 raft_consensus.cc:3060] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.061311 10153 leader_election.cc:400] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:05.061679 10153 leader_election.cc:403] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.064111 10079 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.038237 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.066663 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:05.066955 10107 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:05.067400 10003 leader_election.cc:400] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:05.067705 10003 leader_election.cc:403] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:05.064217 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 136233us
I20260709 13:19:05.069435 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.070592 10183 raft_consensus.cc:1813] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Handling vote request from an unknown peer 9a67604b91f54791b1316fd327793337
I20260709 13:19:05.071236 10183 raft_consensus.cc:2410] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:19:05.077121 10711 raft_consensus.cc:1240] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:05.070217 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50833.4us
I20260709 13:19:05.051479 16837 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20.
I20260709 13:19:05.055225 17216 leader_election.cc:290] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:05.086447 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.080497 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:05.078316 10180 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:05.048156 17223 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:05.082056 16685 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:05.093194 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:05.093259 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:05.094667 10034 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:19:05.082296 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44164.3us
I20260709 13:19:05.105679 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.038384 17226 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.108309 10107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "9a67604b91f54791b1316fd327793337"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:05.110785 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.111853 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.113229 17163 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:19:05.114207 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 50182.1us
I20260709 13:19:05.068961 17189 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:05.114965 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:05.118108 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.112659 10107 raft_consensus.cc:606] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Received request to transfer leadership to TS 9a67604b91f54791b1316fd327793337
I20260709 13:19:05.068661 17239 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.084527 17204 raft_consensus.cc:3060] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:19:05.127439 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57800.1us
I20260709 13:19:05.014632 17198 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.092s
I20260709 13:19:05.080197 17130 raft_consensus.cc:3060] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:05.056083 17133 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.131958 10708 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:05.145839 10679 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.134608 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:05.147979 10113 raft_consensus.cc:2368] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:05.132778 10112 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:05.120515 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.148643 17068 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.150035 17027 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:05.151244 17201 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.151690 17101 raft_consensus.cc:3055] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:05.152195 16868 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:05.152607 16970 raft_consensus.cc:993] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:19:05.155069 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:05.137876 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:05.159343 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.160271 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:05.161789 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:05.207005 10114 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:05.162971 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:05.163199 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:05.164885 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:05.165472 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:05.210661 10113 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:05.123786 17131 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.129889 17021 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:05.171224 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:05.133383 17132 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.126657 10107 raft_consensus.cc:614] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:05.172052 17195 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:05.141036 17239 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.131986 17189 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:05.253034 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 93776.7us
I20260709 13:19:05.256577 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.202957 17101 raft_consensus.cc:740] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:05.212352 16868 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.203259 17027 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.252986 17198 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:05.253010 17263 log.cc:927] Time spent T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:19:05.247282 16970 raft_consensus.cc:1081] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:19:05.178845 17068 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.250134 17131 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:05.305850 17131 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.307590 17204 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:05.308065 17131 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.309528 17068 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:05.279064 17239 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:05.282557 17230 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:05.310909 17230 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:05.311779 17230 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.313406 17130 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:05.283028 17226 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.258612 17132 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.314424 17132 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.258807 17163 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.317674 17132 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:05.291989 17101 consensus_queue.cc:260] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:05.293483 17262 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:19:05.294829 17203 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.298352 17189 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.319294 17203 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:05.299578 17133 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.301339 17245 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:05.315600 17226 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:05.181659 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:05.127621 10003 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:19:05.353645 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 171916us
W20260709 13:19:05.180466 10079 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5f53253de3345159399b6816804e1e6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:05.360651 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 218953us
I20260709 13:19:05.361783 10081 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:05.364671 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 237020us
I20260709 13:19:05.365041 10081 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.371032 10032 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:05.381678 10110 raft_consensus.cc:1240] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:19:05.395608 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.397013 10183 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:05.397250 10185 raft_consensus.cc:2393] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 19: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:05.397656 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.399216 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.400863 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.404165 10106 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:05.404605 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:05.405205 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:05.419699 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:05.297236 17027 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.275123 17100 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:05.269045 16868 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:05.318970 17101 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:05.552553 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:05.574293 10716 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:05.574303 16860 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:19:05.577421 16685 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:05.580195 17117 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:05.581825 17188 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:05.582212 17117 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:05.584280 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 327630us
I20260709 13:19:05.585534 17189 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.586717 17001 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:05.586370 17189 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.587152 17001 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:05.580410 17187 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:05.607911 17198 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:05.610332 17198 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:05.610976 17212 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:05.609617 17187 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.612036 17187 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:05.592758 17189 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:05.579612 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 414145us
I20260709 13:19:05.602154 17068 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.602727 16964 raft_consensus.cc:493] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.603242 17226 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.604128 17133 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:05.574493 10186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.027s	sys 0.056s
I20260709 13:19:05.626713 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.639647 17226 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.643231 17226 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:05.630126 17133 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.636169 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.645283 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.632941 16685 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.649354 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:05.649945 17199 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:05.650496 16970 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:05.651827 17068 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.658139 16972 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.659320 17189 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:05.655215 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:05.661059 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 144701us
I20260709 13:19:05.643392 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.669165 10187 raft_consensus.cc:2468] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:05.630030 16964 raft_consensus.cc:515] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.701668 16685 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:05.686911 16739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.037s	sys 0.074s
I20260709 13:19:05.709719 17276 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:05.710217 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 65127.7us
I20260709 13:19:05.710839 10040 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:05.717756 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 62862us
I20260709 13:19:05.721180 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.721714 17001 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.722841 17182 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.723789 17182 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.727811 10181 raft_consensus.cc:1275] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:05.706797 16972 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:05.728577 10113 consensus_meta.cc:287] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.013s
I20260709 13:19:05.729069 10113 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:05.730542 16964 leader_election.cc:290] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.731295 16769 raft_consensus.cc:2764] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
W20260709 13:19:05.718441 16739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.037s	sys 0.075s
I20260709 13:19:05.736457 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.737421 17068 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.742450 17130 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:05.697419 17199 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:05.760835 17130 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:05.761231 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 600915us
W20260709 13:19:05.814067 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 103323us
I20260709 13:19:05.822747 17082 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.827345 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 89920.1us
I20260709 13:19:05.828100 17199 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.831568 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.848227 17082 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.850961 17082 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:05.851917 16983 consensus_meta.cc:287] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.783s	user 0.014s	sys 0.011s
I20260709 13:19:05.852428 16983 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.854593 16983 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:05.857643 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.858122 10111 raft_consensus.cc:1240] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:05.859052 16983 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:05.859210 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 114139us
I20260709 13:19:05.839884 17087 raft_consensus.cc:3055] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:05.860814 10034 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:05.863262 10112 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:19:05.861133 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.854658 17130 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:05.862361 17001 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:05.868479 17087 raft_consensus.cc:740] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:05.835570 17068 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:05.862111 17198 consensus_queue.cc:1059] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 13:19:05.902118 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 70717.1us
W20260709 13:19:05.908170 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.906850 10155 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
W20260709 13:19:05.915822 10005 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.920358 17275 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.921535 17198 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:05.925016 17087 consensus_queue.cc:260] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:05.926697 17087 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:05.927951 16763 consensus_meta.cc:287] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.859s	user 0.022s	sys 0.000s
W20260709 13:19:05.927882 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55698.9us
I20260709 13:19:05.933235 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.934286 17010 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:05.935659 10679 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:05.914793 17068 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:05.950100 10079 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:05.954022 17026 raft_consensus.cc:2749] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.954222 10038 raft_consensus.cc:1275] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:05.918785 17189 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:05.955631 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:05.960132 10034 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:05.943493 17133 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:05.928447 16763 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:05.965608 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 105588us
I20260709 13:19:05.953292 17198 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:05.951292 17212 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:05.974541 17277 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:05.974911 17278 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:19:05.976490 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.975605 17082 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:05.927990 17286 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.056s
I20260709 13:19:05.984195 17068 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:19:05.985532 17286 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:05.985822 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:05.928202 16993 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
W20260709 13:19:05.990756 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55327.2us
I20260709 13:19:05.990906 16837 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:05.994488 17217 consensus_queue.cc:1048] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:05.994982 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:05.995128 10189 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:05.996065 17189 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:05.996950 16972 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:05.999310 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.002039 10180 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:06.002836 17189 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.003315 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:05.985355 17082 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:06.005184 10182 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:06.005941 17082 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.009742 17217 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:06.011258 17217 consensus_queue.cc:1048] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:06.004278 16868 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.012663 10040 raft_consensus.cc:2468] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:19:05.986013 17286 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.985744 17212 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.019917 17212 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:06.020829 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 147939us
I20260709 13:19:06.021754 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.023207 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.029160 10180 raft_consensus.cc:1275] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:06.030632 17217 consensus_queue.cc:1048] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:06.034631 16868 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:06.037644 16763 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:06.037925 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:06.003221 17203 consensus_meta.cc:287] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.005s
I20260709 13:19:06.044569 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:06.039583 17286 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.056295 17133 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:06.057183 10708 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:05.971516 17187 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.048605 17117 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:19:06.068068 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44933.3us
I20260709 13:19:06.054409 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.049386 17276 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:06.071949  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:06.074188 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.067377 17117 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:06.067154 16983 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:06.075055 10039 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:06.080864  9935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 299) took 9445 ms. Trace:
I20260709 13:19:06.084975 10188 raft_consensus.cc:2410] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 13:19:06.085922 10003 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:06.088583 10714 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:06.089172 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.075666  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:05.989427 17198 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.103256 10111 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 23: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:06.074046 17187 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.079909 16763 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:06.117194 10039 raft_consensus.cc:1240] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:06.117869 17195 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:19:06.117242 17273 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:19:06.133244 17291 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
I20260709 13:19:06.067438 17217 raft_consensus.cc:493] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.144289 17217 raft_consensus.cc:515] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:06.148037 17285 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.090s	user 0.003s	sys 0.003s
I20260709 13:19:06.148416 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.155514 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:06.058080 17203 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.166579 10708 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:06.168156 10155 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.110248 17199 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:06.108474 16983 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:06.184065 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 198388us
I20260709 13:19:06.113199 16763 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.159457 17217 leader_election.cc:290] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.190124 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.171875 17199 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:06.209638 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:06.205200 16763 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:06.081277  9935 rpcz_store.cc:276] 0709 13:18:56.635345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.635545 (+   200us) service_pool.cc:224] Handling call
0709 13:19:06.080635 (+9445090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:02.879831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:02.955846 (+ 76015us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:02.959125 (+  3279us) write_op.cc:435] Acquired schema lock
0709 13:19:02.987042 (+ 27917us) tablet.cc:662] Decoding operations
0709 13:19:03.257142 (+270100us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:03.266608 (+  9466us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:03.272802 (+  6194us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:03.448452 (+175650us) tablet.cc:701] Row locks acquired
0709 13:19:03.452400 (+  3948us) write_op.cc:260] PREPARE: finished
0709 13:19:03.503504 (+ 51104us) write_op.cc:270] Start()
0709 13:19:03.536188 (+ 32684us) write_op.cc:276] Timestamp: P: 1783603143503428 usec, L: 0
0709 13:19:03.536246 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 13:19:03.635955 (+ 99709us) log.cc:844] Serialized 2860 byte log entry
0709 13:19:04.453786 (+817831us) op_driver.cc:464] REPLICATION: finished
0709 13:19:04.488916 (+ 35130us) write_op.cc:301] APPLY: starting
0709 13:19:04.489003 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:04.585435 (+ 96432us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:04.599807 (+ 14372us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:04.867625 (+267818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:04.867892 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:19:04.867941 (+    49us) write_op.cc:312] APPLY: finished
0709 13:19:04.868212 (+   271us) log.cc:844] Serialized 73 byte log entry
0709 13:19:04.868401 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.868527 (+   126us) write_op.cc:454] Released schema lock
0709 13:19:04.868578 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:04.872128 (+  3550us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.872163 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1031469,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":34896,"apply.run_cpu_time_us":20943,"apply.run_wall_time_us":383158,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":204024,"prepare.run_cpu_time_us":19880,"prepare.run_wall_time_us":1374294,"raft.queue_time_us":186360,"raft.run_cpu_time_us":31687,"raft.run_wall_time_us":35199,"replication_time_us":917383,"thread_start_us":874403,"threads_started":4,"wal-append.queue_time_us":614401,"wal-append.run_cpu_time_us":73408,"wal-append.run_wall_time_us":1626871}]]}
I20260709 13:19:06.226433 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.230356 10004 leader_election.cc:400] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:06.233070 10040 raft_consensus.cc:1813] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Handling vote request from an unknown peer fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.215260 17199 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.233620 10040 raft_consensus.cc:2393] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:19:06.234443 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 72845.2us
I20260709 13:19:06.224960 16972 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:06.225607 17276 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:06.245061 10037 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:06.224517 16769 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.248451 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.248119 17117 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.287173 17117 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.286949 16769 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.250586  9934 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.289598 16769 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.290629  9934 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:06.241689 16972 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.216648 16983 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.291316 10037 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:06.259838 17275 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:06.261471 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 59826.7us
I20260709 13:19:06.231668 17182 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.263219 10679 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.263865 17163 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.267767 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.276693 10182 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:06.277419 17101 consensus_queue.cc:1059] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:06.280588 10155 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.282619 17198 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.240551 10680 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.291957 16972 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:06.305616 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67215.7us
I20260709 13:19:06.302256 10033 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
W20260709 13:19:06.304414 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 192725us
I20260709 13:19:06.310014 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.312012 10004 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.309067 17217 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:06.308614 17087 raft_consensus.cc:2749] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:06.315081 17275 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.324558 16837 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:06.322494 17199 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:06.363983 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 83498.6us
I20260709 13:19:06.364972 10155 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:06.365260 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:06.347163 17294 log.cc:927] Time spent T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.235s	user 0.007s	sys 0.007s
I20260709 13:19:06.368673 10035 raft_consensus.cc:1240] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:06.369290 16993 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:06.369555 17284 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:19:06.370186 16993 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.371158 16983 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.372666 16993 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.373453 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:06.374364 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.376073 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:06.376252 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.376468 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:06.377454 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:06.377583 10716 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:06.380162 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.381701 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.376091 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:06.384148 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 78413.5us
I20260709 13:19:06.385033 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.386251 10113 raft_consensus.cc:1240] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:06.387145 10109 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:19:06.387316 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:06.388000 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 124939us
I20260709 13:19:06.386343 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.393638 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.394418 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.396178 10079 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:06.397629 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.399245 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.396185 17276 raft_consensus.cc:3055] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:06.400323 16769 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:06.400877 16769 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:06.401816 16769 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.393951 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.402956 10182 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:19:06.310133 17163 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.308281 17182 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.392592  9934 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: config changed from index 5 to 14, VOTER fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) evicted. New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:06.407537 10114 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:19:06.400267 17276 raft_consensus.cc:740] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:06.408411 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.407442 16685 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.356282 16837 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:06.368593 16739 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:06.408432 17226 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.408774 16983 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:06.421664 16685 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.426340 10183 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.414654 16837 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:06.419039 17275 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.455940 17201 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:06.460510 16685 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.468333 17163 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.469517  9934 catalog_manager.cc:5697] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 19 to 21, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:06.475867 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.479817 17296 log.cc:927] Time spent T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:19:06.479806 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 55176.1us
I20260709 13:19:06.481134 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.481652 17182 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.482264 16685 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.501852  9934 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:06.513980  9934 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 19 to 21, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.464596 17226 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.575901 17226 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:06.568527 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:06.582926 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.586722 10682 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:06.594188 10081 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:06.601239 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.598282 16983 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:06.605605 16983 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.606024 16983 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:06.599701 17130 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:06.616724 17229 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.620409 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.514484 17275 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.625726 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.464125 17276 consensus_queue.cc:260] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.582544 17101 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.621238 10180 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:19:06.631357 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:06.633235 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.605166 17195 consensus_queue.cc:1059] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:19:06.645750 10109 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:06.633955 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:06.646044 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:19:06.634490 17309 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:19:06.638702 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44626.4us
I20260709 13:19:06.647804 17188 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:06.648461 10081 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:06.648953 17188 consensus_queue.cc:1059] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:06.649793 17189 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:06.650199 17189 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:06.651238 17189 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.652562 17189 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.643036 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.649839 17001 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:06.654258 17299 log.cc:927] Time spent T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:06.640883 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:06.645906 17306 log.cc:927] Time spent T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.279s	user 0.010s	sys 0.000s
W20260709 13:19:06.661514 17310 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260709 13:19:06.662034 17101 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.664549 17101 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:06.655897 17001 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.666047 17001 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.643273 17312 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:06.669221 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:06.670572 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:06.673128 17130 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.673646 16972 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.673863 17130 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.675982 17130 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.676411 10031 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:06.676843 16763 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.677328 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.677604 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:06.678529 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.678992 16763 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.661791 10111 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:06.683596 10108 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 27.
I20260709 13:19:06.590646 17117 consensus_queue.cc:1059] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:19:06.683705 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.695765 17199 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:06.696172 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778034d202c94f46bfe767ecaf503d1e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.697314 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.697976 17277 consensus_queue.cc:1059] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:06.698309 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bb7b33f6c4f0da898f288eb770258" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.698689 16970 raft_consensus.cc:3055] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:06.699095 16970 raft_consensus.cc:740] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:06.699407 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.699867 17133 raft_consensus.cc:3055] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:06.700323 17133 raft_consensus.cc:740] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:06.699975 16970 consensus_queue.cc:260] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.700527 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133523a809584dd5b44a19acf589801d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.692626 17276 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:06.701988 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.702696 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:06.704030 10188 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:06.705837 16993 raft_consensus.cc:3055] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:06.706282 16993 raft_consensus.cc:740] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:06.707288 16993 consensus_queue.cc:260] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.707921 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.708587 10036 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:06.709054 16993 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.695784 17117 raft_consensus.cc:3055] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:06.712248 10003 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:06.686847 17275 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:06.687296 10716 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:19:06.689388 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.690629 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.691331 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:06.691869 17286 consensus_meta.cc:287] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.007s
I20260709 13:19:06.713716 17199 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:06.717959 17199 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.718351 17199 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.718773 17286 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.719962 10038 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 21: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:06.720382 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.721086 10188 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:06.722007 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.722172 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.723090 10003 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:06.686751 17203 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.723317 10188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39164
I20260709 13:19:06.692628 10185 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:06.701285 16970 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.727691 16949 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.728200 17082 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:19:06.712205 17117 raft_consensus.cc:740] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:06.723898 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:06.751897 17117 consensus_queue.cc:260] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:06.753057 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.729611 16837 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.701228 17133 consensus_queue.cc:260] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.692090 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.756470 10114 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:06.757560 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.760012 10188 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.723985 16763 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:06.751909 10714 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:19:06.761592 10078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.729166 17327 ts_tablet_manager.cc:933] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:06.741382 10153 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.765655 10188 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:06.748258 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 62872.9us
I20260709 13:19:06.788691 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.790015 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.790037 10183 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:06.792923 10186 raft_consensus.cc:1240] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 13:19:06.790999 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:06.794238 10106 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:19:06.753760 17117 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:06.799417 10038 raft_consensus.cc:2368] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23.
I20260709 13:19:06.742153 16972 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.736683 17240 raft_consensus.cc:493] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.809185 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:06.815116 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:06.816006 10114 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 23: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:06.766575 16763 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.818179 16763 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:06.818814 17317 log.cc:927] Time spent T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:06.803354 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.808197 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.699098 17277 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:19:06.820760 10185 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:06.808188 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.721083 17286 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.825484 10036 raft_consensus.cc:1240] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:19:06.812178 10109 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:06.800726 10003 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:06.821115 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.810705 10188 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.827099 10180 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:06.828267 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.828939 10188 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:06.829491 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:06.832067 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:06.837615 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.841847 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.842640 10106 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:06.843603 10189 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:06.843991 17312 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:06.846200 10037 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:06.836661 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.750813 16949 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.847661 10031 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:06.841982 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:06.853863 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 112575us
I20260709 13:19:06.810120 17275 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:06.814816 16837 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:06.786845 17101 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:19:06.863070 10181 raft_consensus.cc:2368] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
I20260709 13:19:06.865353 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:19:06.866890 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57794.9us
I20260709 13:19:06.867772 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.869521 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.870505 10189 raft_consensus.cc:1240] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:06.871434 17022 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:06.872017 17022 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.872457 17022 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:06.866570 10155 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.853444 17203 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:06.884797 10078 leader_election.cc:304] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:06.891784 17226 raft_consensus.cc:3055] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:06.852900 17240 raft_consensus.cc:515] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.859658 17133 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.897166 16949 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.898541 17001 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.913866 17001 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.903357 10185 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:06.914798 17240 leader_election.cc:290] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.915987 17199 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.921001 10031 raft_consensus.cc:1275] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:19:06.933940 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65167.4us
I20260709 13:19:06.936676 17327 tablet_copy_client.cc:323] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.194:35119
W20260709 13:19:06.940184 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 83084.1us
I20260709 13:19:06.942687 10003 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:19:06.945343 17330 log.cc:927] Time spent T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.053s	user 0.000s	sys 0.007s
I20260709 13:19:06.943490 17001 consensus_queue.cc:1059] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:19:06.904898 17226 raft_consensus.cc:740] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:19:06.947988 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 78549.1us
I20260709 13:19:06.951565 16685 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:06.954372 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:06.920503 17203 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:06.933337 17277 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:06.953408 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:06.899732 17312 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:19:06.943550 16972 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.979143 10037 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:06.979887 16769 raft_consensus.cc:2749] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:06.982774 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 98091.2us
I20260709 13:19:06.987211 10078 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:06.989265 10125 tablet_copy_service.cc:140] P fd3903ba079e4f47aaf0aa4432382c23: Received BeginTabletCopySession request for tablet f5f53253de3345159399b6816804e1e6 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:53672)
I20260709 13:19:06.982682 17226 consensus_queue.cc:260] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:06.984175 17329 log.cc:927] Time spent T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:19:06.983762 17203 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.001060 17199 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:06.980489 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:06.989825 16685 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:06.932783 16983 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:06.989903 10125 tablet_copy_service.cc:161] P fd3903ba079e4f47aaf0aa4432382c23: Beginning new tablet copy session on tablet f5f53253de3345159399b6816804e1e6 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:53672: session id = 2f672b54d4754c5aa62b5b919597a14e-f5f53253de3345159399b6816804e1e6
W20260709 13:19:06.994683 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.995954 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:07.010372 16983 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.012202 16685 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:06.996634 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:06.938052 17068 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:06.997692 17274 raft_consensus.cc:2804] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:06.963222 17284 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:06.976265 17189 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.017275 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:07.019141 10031 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.020597 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:07.023849 10037 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 13:19:07.024518 10037 pending_rounds.cc:85] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 17
I20260709 13:19:07.025625 10032 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:07.026015 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 69795us
I20260709 13:19:07.027657 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.032713 16685 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:07.024791 10037 pending_rounds.cc:107] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 13:19:07.035514 10037 raft_consensus.cc:2889] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.035326 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.044760 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e34dad81aac43a1aac71ca8c862321d" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.025359 17187 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.068614 17163 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:07.069043 17163 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:07.029613 17189 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.069974 17163 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.070976 17163 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:07.071313 17189 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:07.054795 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 58255.8us
I20260709 13:19:07.058815 10184 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:07.088971 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:07.088673 10031 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:19:07.090214 10036 raft_consensus.cc:1240] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:07.060230 17289 raft_consensus.cc:3055] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:07.092097 17289 raft_consensus.cc:740] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:07.092464 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.093086 17289 consensus_queue.cc:260] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.094355 17289 raft_consensus.cc:3060] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.097999 17026 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.061326 16763 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.100906 16763 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.101641 10034 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:07.062337 10154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.035220 17284 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:07.034965 17101 consensus_queue.cc:1059] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:19:07.109483 17101 raft_consensus.cc:3055] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:07.040741 17068 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.034061 17274 raft_consensus.cc:697] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:07.048991 17188 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.110770 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.110567 17284 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.111161 17188 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:07.066838 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 79743.4us
I20260709 13:19:07.110829 17274 consensus_queue.cc:237] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.113030 10078 leader_election.cc:304] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.020606 16972 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.002327 17275 consensus_queue.cc:1059] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:19:07.076259 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:07.076548 17333 log.cc:927] Time spent T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:07.077905 17001 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:19:07.049226 17273 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:07.107456 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.108500 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.064075 17117 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.063325 17022 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.121083 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.116379 10038 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 14.
I20260709 13:19:07.115649 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.140647 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:19:07.118631 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 65974.5us
I20260709 13:19:07.127075 17082 raft_consensus.cc:2749] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.127382 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.127672 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.128124 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:07.144091 10108 raft_consensus.cc:2393] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:07.129868 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.130240 16972 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:07.131584 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 90940.2us
W20260709 13:19:07.149052 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.134598 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.149325 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:07.148337 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:07.136309 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.136837 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.139011 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.142644 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:07.142606 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.144132 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:07.151672 16685 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.146126 10078 leader_election.cc:304] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.151358 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.143216 10679 leader_election.cc:304] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.145170 10031 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:19:07.153524 10032 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:19:07.154229 10038 raft_consensus.cc:2410] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:19:07.109871 17101 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:07.150097 10716 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 14.
I20260709 13:19:07.148542 17341 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:07.156524 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45833.2us
I20260709 13:19:07.159881 10155 leader_election.cc:400] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23.
I20260709 13:19:07.160853 10155 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.135888 17133 raft_consensus.cc:2764] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:19:07.168357 10682 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.163760 10036 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:07.169530 10110 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 23: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:07.171530 10004 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.178133 17276 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:07.170747 16970 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:19:07.178411 17188 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.181495 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.184962 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:07.186558 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.187665 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.164043 16972 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:07.198745 16685 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:07.199220 16685 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.161963 17341 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:07.199555 16685 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:07.146705 17117 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.203779 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.182368 17277 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.187779 17087 raft_consensus.cc:2749] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.209168 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:07.189335 17217 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:07.218474 10155 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.193703 17199 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.201596 17229 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:07.191685 16868 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:19:07.179555 16769 consensus_queue.cc:1059] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:07.201913 17341 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.212983 17133 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:07.226513 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68619.2us
I20260709 13:19:07.241247 17287 raft_consensus.cc:2749] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.241794 17276 consensus_queue.cc:1048] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:07.237331 17277 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:07.252061 17343 raft_consensus.cc:3055] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:07.252537 17343 raft_consensus.cc:740] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:07.253470 17226 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.253293 17343 consensus_queue.cc:260] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.254565 17343 raft_consensus.cc:3060] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.240847 17101 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.256610 17101 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.227988 17229 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:07.260322 17229 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:07.240196 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 52632.9us
I20260709 13:19:07.209504 17187 consensus_queue.cc:1059] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:19:07.228224 17189 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:07.213255 17130 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:07.227967 17217 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:19:07.271800 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 92479.4us
I20260709 13:19:07.264479 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:07.265627 10155 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:07.271301 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 72997.2us
I20260709 13:19:07.227537 17275 consensus_queue.cc:1059] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:19:07.284888 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.273258 16739 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:07.291421 17284 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:07.313074 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.269984 17277 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:19:07.273546 17203 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:19:07.276400 16769 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:19:07.331382 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51577.2us
I20260709 13:19:07.286612 17347 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.299973 17133 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:07.337183 10081 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:07.330386 17022 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.324409 16983 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.346213 10713 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:07.324102 17284 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:07.351471 17355 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:07.352072 17355 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:07.352438 17355 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:07.352535  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:07.365195 17341 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.376593 17341 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:07.381628 17344 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 13:19:07.368880 17217 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.388592 10037 raft_consensus.cc:1240] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:19:07.379590 17082 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:07.338769 17133 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:07.400988 17284 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.338438 16739 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.404572 17187 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:07.405403 17117 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.408444 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:07.409036 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:07.426352 10034 raft_consensus.cc:2410] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:19:07.383320 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 107335us
I20260709 13:19:07.416662 16685 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.414651 10004 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.414884 17082 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:07.425190 16739 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:07.431694 10078 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.420357 17133 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:07.425741 17187 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.436715 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.437057 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:07.439478 10713 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
W20260709 13:19:07.440335 17346 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:07.441776 17187 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:07.442718 17284 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.442999 17117 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:07.437090 16970 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.445060 10078 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.445838 16970 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.453111 17082 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.454738 17082 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.433574 17199 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:07.456594 17199 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:07.457666 17199 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.468415 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: 
I20260709 13:19:07.427125 17229 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.526762 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.524489 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:07.604700 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 136377us
I20260709 13:19:07.492391 10111 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:07.535308 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.468484 10078 leader_election.cc:400] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 15 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 15. Current term is 16.
W20260709 13:19:07.524931 10079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.521025 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.524901 16685 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 28 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:07.554298 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 266733us
I20260709 13:19:07.480521 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.613641 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.616747 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.618034 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:07.618340 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.619168 10107 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:07.622243 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.597361 16837 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.624054 10713 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:07.615306 17199 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:07.630695 17199 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:07.541399 17187 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.483274 17189 raft_consensus.cc:3055] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:07.621214 16983 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.626175 17273 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.631178 17199 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.636008 17305 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.563552 17275 consensus_queue.cc:1243] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 24.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:07.486503 17133 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.627640 17068 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:07.628146 17363 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.628358 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.630803 17341 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:19:07.632418 10155 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:07.632673 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.525965 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:07.626981 17229 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.634312 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.630717 17356 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.629060 16685 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:19:07.663890 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 195552us
I20260709 13:19:07.668761 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.665947 10113 raft_consensus.cc:2368] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:07.636559 17189 raft_consensus.cc:740] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:07.673386 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:07.674814 17312 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:07.675208 17312 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:07.675482 17001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55800 (request call id 3) took 3242 ms. Trace:
I20260709 13:19:07.675952 17001 rpcz_store.cc:276] 0709 13:19:04.432894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.503461 (+ 70567us) service_pool.cc:224] Handling call
0709 13:19:04.683164 (+179703us) log.cc:844] Serialized 506 byte log entry
0709 13:19:05.040563 (+357399us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b18003143e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c375c0a 00007f3c75ab5219 00007f3c6c3fda40 00007f3c6c3f84e4 00007f3c6c3f8455 00007f3c6f441b0b 00007f3c6f4c6b63 00007f3c6f4ee752 00007f3c744aed29
0709 13:19:07.675380 (+2634817us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220661,"raft.queue_time_us":213638,"raft.run_cpu_time_us":1786,"raft.run_wall_time_us":1788,"spinlock_wait_cycles":146370944,"thread_start_us":75997,"threads_started":1,"wal-append.queue_time_us":205508,"wal-append.run_cpu_time_us":2015,"wal-append.run_wall_time_us":1026683}
I20260709 13:19:07.631065 16837 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.478127 17355 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.686829 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.688679 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.671394 17275 raft_consensus.cc:2804] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:07.670343 16983 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:07.675571 17312 raft_consensus.cc:3060] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.675956 16972 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:07.693881 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.695541 10189 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:19:07.696867 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.698386 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.680928 17356 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.662536 17305 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.700519 10187 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:19:07.715343 10187 pending_rounds.cc:85] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 13
I20260709 13:19:07.715592 10187 pending_rounds.cc:107] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:19:07.715843 10187 raft_consensus.cc:2889] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.701089 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.672195 17273 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:19:07.718153 10032 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:07.718539 10183 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:07.713714 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:07.722151 10037 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:07.692787 17274 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.692706 17357 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:19:07.714815 10036 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:07.703315 10125 tablet_copy_source_session.cc:215] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:07.718230 10181 raft_consensus.cc:2393] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 23: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:07.694366 16739 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.719923 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.710454 10110 raft_consensus.cc:2468] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 14.
I20260709 13:19:07.708601 10184 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:07.724378 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:07.725389 10115 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:07.709403 17275 raft_consensus.cc:697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:07.729889 10189 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:07.732851 10034 raft_consensus.cc:2393] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:07.781427 17305 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.782444 16837 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.783308 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:07.775441 16970 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.733049 10108 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:07.774132 10033 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 13:19:07.774978 17189 consensus_queue.cc:260] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.792877 17189 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.796900 17187 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.797988 17133 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:07.733978 17274 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.800992 17355 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:07.802028 17274 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:07.802671 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:07.803553 10716 raft_consensus.cc:2393] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 18: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
W20260709 13:19:07.806977 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 87136.2us
W20260709 13:19:07.776453 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 50992.8us
I20260709 13:19:07.807821 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.807838 10115 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:07.734272 10110 raft_consensus.cc:1275] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:19:07.810645 10110 pending_rounds.cc:85] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 9
I20260709 13:19:07.810910 10110 pending_rounds.cc:107] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:19:07.812732 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:07.813956 10110 raft_consensus.cc:2889] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.819224 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.819643 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:07.821175 10716 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:19:07.818820 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:07.819506 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:07.819900 10184 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:19:07.822525 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.823340 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:07.823696 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.824536 10109 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:19:07.829350 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.816763 10182 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:19:07.819109 17273 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:19:07.832166 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.832835 10184 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:07.833065 17273 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:07.833465 17273 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:07.834575 17273 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.818671 17359 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.818733 17133 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:07.831487 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:07.811718 17274 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:07.828135 17068 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:07.827946 17343 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.845204 17217 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:07.848599 17068 raft_consensus.cc:493] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.857106 17068 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:07.820773 17187 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:19:07.869529 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.870878 10153 leader_election.cc:400] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:07.871219 10153 leader_election.cc:403] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:07.839715 17273 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:07.823163 17163 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:19:07.855458 10184 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:07.855212 17217 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.874782 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:07.854023 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:07.879678 10153 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:19:07.903182 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49272.9us
I20260709 13:19:07.904546 16685 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:07.875260 17217 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:07.912130  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 3c6c3346fb334d2cbbcdfc623a3e64dc: Illegal state: Replica 9a67604b91f54791b1316fd327793337 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:07.916621 17312 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:07.918967 17312 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:07.897615 17287 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:07.882735 17274 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:07.932813 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:07.897446 16739 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:19:07.958997 17356 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:07.901851 17199 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.978521 10182 raft_consensus.cc:2468] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:07.980096 10078 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:07.980877 17087 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:07.981523 17087 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.935885 17287 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:19:07.985999 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.939222 17101 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:19:07.974506 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 94944.5us
I20260709 13:19:07.999552 10110 raft_consensus.cc:1240] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:07.995716 17026 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.009495 17026 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.987305 17312 raft_consensus.cc:2804] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:07.907776 17275 consensus_queue.cc:237] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.014592 17101 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:08.013178 17347 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.097364 17203 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.121155 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:07.995545 17274 consensus_queue.cc:1048] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
W20260709 13:19:08.113176 17368 log.cc:927] Time spent T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:19:08.113497 17312 raft_consensus.cc:697] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:08.112666 17026 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.119927 17087 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.122072 17203 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.146144 17305 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.126784 17347 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:07.907233 17357 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.256s
I20260709 13:19:08.171104 17383 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.171898 17383 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:08.172741 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 62648.2us
I20260709 13:19:08.174525 17383 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.177126 17101 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.181164 17203 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.152777 17378 consensus_queue.cc:1059] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:19:08.178821 17312 consensus_queue.cc:237] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.187064 17347 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.134583 17287 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.177842 17305 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.176229 16983 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.205873 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:08.206736 10107 raft_consensus.cc:2393] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 21: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:08.206596 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.200116 17068 raft_consensus.cc:515] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.212826 17068 leader_election.cc:290] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.223976 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.216998 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.229840 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:08.230499 10115 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:08.232434 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.233211 10713 raft_consensus.cc:2393] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 22: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.227692 17358 raft_consensus.cc:3055] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:08.235291 17358 raft_consensus.cc:740] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:08.236203 17358 consensus_queue.cc:260] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.237672 17358 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:08.238621 10115 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 26.
I20260709 13:19:08.287202 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e127deec1bdf4a7883aec8a35942fb23" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:08.287921 10713 raft_consensus.cc:3060] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:08.240530 17384 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.291898 17384 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.293592 16769 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:08.294166 16769 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.296507 16769 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.303246 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.308128 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.317520 17217 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.332844 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:08.333520 10187 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:08.337379 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.338213 10184 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 26.
I20260709 13:19:08.341147 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:08.342176 17217 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.343786 17385 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.344401 17385 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.347242 17385 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.347817 17385 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.348405 10187 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:08.348307 17385 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.351421 17385 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.351843 17305 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.209676 16983 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.355424 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.290295 10153 leader_election.cc:304] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:08.368686 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 78480.5us
I20260709 13:19:08.369761 10153 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:08.343657 16769 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:08.387105 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.387960 10110 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:19:08.294229 17384 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.380766 17377 raft_consensus.cc:2804] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:08.381013 17163 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.388235 17385 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:08.380307 16769 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:08.415360 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.416827 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:08.452914 10713 raft_consensus.cc:2468] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 26.
W20260709 13:19:08.464373 17388 log.cc:927] Time spent T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:19:08.477394 10081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.456173 16769 raft_consensus.cc:3060] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:08.455931 17377 raft_consensus.cc:697] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 26 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:08.461748 17273 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:08.459167 17203 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:08.453203 17163 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.486389 17273 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.501889 17273 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:08.504448 16983 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.461652 17384 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:19:08.507838 17203 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.509894 10714 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:08.510164 17203 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.511942 10679 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:08.514976 17229 raft_consensus.cc:2804] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:08.514775 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.522691 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:08.525908 10110 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:08.527153 10711 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:19:08.530400 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.531092 10108 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 18.
I20260709 13:19:08.533876 17343 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:08.534299 17377 consensus_queue.cc:237] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.535979 17163 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.527174 17082 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.540035 17082 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.542189 17082 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.531230 17229 raft_consensus.cc:697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:08.544061 17229 consensus_queue.cc:237] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.553632 17203 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.554384 17203 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:08.559011 17203 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.563482 17199 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.564487 17385 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.577653 16685 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.579353 16685 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.579643 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:08.580281 10038 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:08.581632 16739 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.582180 16739 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.583297 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.584210 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.584009 17384 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.585108 10040 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:19:08.584100 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.586048 10035 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:19:08.585111 17384 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.587390 17199 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.587962 17199 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.588467 10037 raft_consensus.cc:2410] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:19:08.588975 17384 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.590158 17199 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.590622 17117 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.590703 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.591516 10032 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 26: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.591198 17117 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.593410 17117 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.594137 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.594826 10185 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:08.595868 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.596521 10187 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:08.597180 17327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53253de3345159399b6816804e1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.598217 10180 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:08.604822 10181 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:08.605867 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:08.606755 10036 raft_consensus.cc:2393] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.607956 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.608788 10031 raft_consensus.cc:1240] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:08.609586 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.610736 17376 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:08.611372 17376 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.612738 17363 raft_consensus.cc:3055] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:08.613197 17363 raft_consensus.cc:740] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:08.613677 17376 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.614089 17363 consensus_queue.cc:260] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:08.615834 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 97941.3us
I20260709 13:19:08.622502 10038 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:08.626472 16769 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.633670 10003 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.608942 10189 raft_consensus.cc:2410] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:19:08.597440 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.657693 10182 raft_consensus.cc:2368] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:08.635368 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:08.639933 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.641338 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.661268 10181 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:08.641644 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.643375 16739 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.615517 17363 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:08.644495 16685 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.664294 16685 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:08.664706 16685 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.665033 16685 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:08.668912 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:08.656109 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:08.665355 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:08.672752 10031 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.673763 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.674324 10038 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:08.570932 17273 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.681187 10003 leader_election.cc:400] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:08.678879 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:08.682868 10003 leader_election.cc:403] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.685235 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.672878 17101 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:08.678194 16739 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:08.702385 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.715574 16769 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.677760 17203 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:08.719970 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.723160 10708 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:08.731006 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.732522 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.696475 17395 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:08.736697 16763 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:08.739076 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.699208 16983 raft_consensus.cc:3060] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:08.683386 17284 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:19:08.698542 17101 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.744910 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.745831 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.746510 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.746706 17385 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:08.750174 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:08.702183 16739 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.756002 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.759613 16685 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.760794 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.762681 10033 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 24: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.760133 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:08.764369 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 241758us
I20260709 13:19:08.769243 16763 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:08.770269 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:08.770714 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:08.741956 17395 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.777446 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.765890 17101 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:08.786633 16685 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.771552 16739 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:08.790184 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.790733 10182 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:08.793608 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.794256 10713 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 14.
I20260709 13:19:08.795864 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:08.797823 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.802798 16685 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.805248 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.805284 16685 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.808517 16685 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.777880 17395 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:08.811414 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.812089 10113 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 15.
I20260709 13:19:08.817049 10183 raft_consensus.cc:2468] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 26.
I20260709 13:19:08.818874 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.803553 17133 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:08.818480 16685 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:08.821172 16685 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.825192 16685 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:08.825914 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.836738 17338 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:08.847958 17338 raft_consensus.cc:493] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.848392 17338 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:08.841558 17385 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.851508 17385 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.852245 10038 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:08.854379 10708 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
W20260709 13:19:08.855955 17398 log.cc:927] Time spent T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.148s	user 0.002s	sys 0.001s
I20260709 13:19:08.859549 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:08.842976 10115 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:08.843889 16739 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.861826 10031 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:08.787799 17356 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:19:08.868299 16739 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.868788 10037 raft_consensus.cc:1240] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:08.852065 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:08.882354 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 56507.9us
I20260709 13:19:08.885418 10034 raft_consensus.cc:2393] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 15: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.869786 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:08.887044 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.892961 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:08.899076 10078 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:08.889693 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
W20260709 13:19:08.899386 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45047.2us
I20260709 13:19:08.901299 10032 raft_consensus.cc:2393] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 26: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:08.901386 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:08.902262 16763 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:08.902760 17273 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.902964 16763 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:08.809371 17312 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:19:08.903364 17277 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:08.903957 17277 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.906191 17277 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.910180 17305 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:08.913908 16769 raft_consensus.cc:2804] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:08.800519 16972 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.082s
I20260709 13:19:08.916193 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:08.919076 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:08.923259 16763 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.923898 16763 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.888747 17199 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:08.931957 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.937126 10081 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:08.948280 16763 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:08.936188 16769 raft_consensus.cc:697] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 26 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:08.964815 16769 consensus_queue.cc:237] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:08.949723 17163 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:08.966630 17163 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.967007 17163 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:08.971941 16868 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.962551 17385 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:08.976568 17312 consensus_queue.cc:1059] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:08.977643 17312 raft_consensus.cc:3055] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:08.978014 17312 raft_consensus.cc:740] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:08.978582 16983 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:08.983537 17338 raft_consensus.cc:515] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:08.984767 10708 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:08.986526 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:08.995137 17385 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:08.996124 10040 raft_consensus.cc:2468] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
W20260709 13:19:08.997155 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 65297.3us
I20260709 13:19:08.999179 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:08.998452 10079 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:08.998116 10004 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:09.000576 16685 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:09.000979 16763 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.004643 16763 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.005053 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.005726 10184 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 24.
I20260709 13:19:09.006378 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:09.007062 16763 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.007530 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:09.008121 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.008831 10186 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:19:09.008097 16763 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:09.010278 16763 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:08.927057 17305 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 13:19:09.014093 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.015370 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.021754 10038 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:19:09.002844 10003 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:09.017447 10180 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:09.018934 10155 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:09.021718 10036 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:19:09.026623 16685 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.028057 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.029233 10155 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.030026 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.036221 10033 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 13:19:08.978797 17163 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.038754 10039 raft_consensus.cc:2393] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 24: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:09.022259 16763 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.042384 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.041285 17363 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:09.044471 17363 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:09.044870 17363 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:09.041486 17358 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:09.048254 17356 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:09.049161 17408 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:09.048277 17358 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.050163 17358 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.043692 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.051568 16739 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:09.051972 16739 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.052297 16739 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:09.048559 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49484.2us
I20260709 13:19:09.052960 10038 raft_consensus.cc:1275] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:09.012538 17187 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:09.013468 17217 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.054659 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.054311 10036 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:09.048874 17356 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.044124 16685 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:09.058377 16685 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.058725 16685 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:08.995889 17385 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.049624 17408 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:09.077396 16739 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.009830 17101 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.050733 17117 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.978842 17312 consensus_queue.cc:260] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.093899 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:09.092826 16739 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.097949 10183 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.107527 10183 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:09.079334 17408 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.112604 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.115823 10113 raft_consensus.cc:1275] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:09.116817 10108 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:09.081442 17226 consensus_queue.cc:1059] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:19:09.118032 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:09.119504 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 61749us
W20260709 13:19:09.122105 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 103792us
I20260709 13:19:09.123814 17413 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:09.119103 10110 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:19:09.127374 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.093945 17117 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.145552 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:19:09.145938 17404 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:19:09.147414 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.148077 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.148593 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.149211 10114 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 16.
I20260709 13:19:09.150346 17338 leader_election.cc:290] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.151823 17385 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:09.097402 17217 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:19:09.153360 17101 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:09.153764 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.157586 17395 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.158344 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.158972 10035 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:09.160069 10112 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:09.148613 17163 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:09.174593 16983 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.175221 16983 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.180766 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:09.180867 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:09.181766 16739 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:09.202535 10035 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:19:09.204314 16685 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.136574 17312 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:09.231779 17406 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:19:09.237496 10115 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
W20260709 13:19:09.230513 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51633.9us
I20260709 13:19:09.239595 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.239650 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.276392 10111 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:09.276693 10034 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:19:09.242458 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 57590.1us
I20260709 13:19:09.244522 17376 consensus_queue.cc:1059] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:09.231055 17404 log.cc:927] Time spent T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:09.253018 17117 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.277531 16685 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.282547 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:09.287529 10189 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:09.282883 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.166728 17363 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.292728 10035 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:19:09.287001 17418 log.cc:927] Time spent T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:19:09.303874 17277 consensus_queue.cc:1048] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:09.305789 17287 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.322911 17287 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.314079 10081 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:09.324627 10111 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
W20260709 13:19:09.316911 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 188640us
I20260709 13:19:09.315224 17414 consensus_queue.cc:1048] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:09.318336 10180 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:09.318135 17117 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:19:09.319182 17395 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.337448 10680 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:09.341749 17356 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.343336 17203 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.344074 16983 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:09.343933 17203 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:09.344933 17327 consensus_meta.cc:287] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
I20260709 13:19:09.345907 17408 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.329227 17396 raft_consensus.cc:2804] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:09.346292 17327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42392 (request call id 1473) took 2899 ms. Trace:
I20260709 13:19:09.348495 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:09.348728 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.367244 10187 raft_consensus.cc:2410] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 13:19:09.347312 17287 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.363296 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:09.372798 10180 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:09.376210 10713 raft_consensus.cc:3060] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:09.363483 17203 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.366513 17327 rpcz_store.cc:276] 0709 13:19:06.456838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.458254 (+  1416us) service_pool.cc:224] Handling call
0709 13:19:06.791981 (+333727us) ts_tablet_manager.cc:934] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
0709 13:19:08.595873 (+1803892us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:08.772414 (+176541us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:08.772569 (+   155us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:09.345418 (+572849us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:09.345743 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:09.346119 (+   376us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:09.346181 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3033,"tablet-copy.queue_time_us":195841,"thread_start_us":243939,"threads_started":2}
I20260709 13:19:09.407778 17327 tablet_copy_client.cc:806] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:09.408484 17327 tablet_copy_client.cc:670] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:09.391813 17358 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.408633 17363 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:09.410599 17358 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:09.366575 17217 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:09.419258 17408 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:09.426443 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.427378 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.427179 10040 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:19:09.428252 10039 raft_consensus.cc:2393] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 28: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:09.428923 16972 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.429463 16972 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.438241 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.440594 10081 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:09.444621 10189 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 25.
I20260709 13:19:09.446620 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.405416 10713 raft_consensus.cc:2468] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 16.
I20260709 13:19:09.383013 17396 raft_consensus.cc:697] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:09.448196 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.450197 17203 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:09.450798 17203 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 25 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:09.450875 17396 consensus_queue.cc:237] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.452055 17203 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.469091 10189 raft_consensus.cc:1275] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:09.514240 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:09.516791 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.517407 10032 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.492883 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:09.470263 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 79727.5us
I20260709 13:19:09.518667 10188 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:19:09.495715 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:09.496029 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.494621 10037 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:09.502688 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.500177 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.521611 10036 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:09.495421 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.513767 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.522987 10187 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 15.
I20260709 13:19:09.521986 10038 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
W20260709 13:19:09.470818 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 105417us
I20260709 13:19:09.525862 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:09.449777 17312 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:09.532148 10181 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:09.449230 16972 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.528700 10714 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:19:09.528947 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.512748 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.479206  9938 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 21 to 22, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 22 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:09.530395 10108 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:09.530956 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.532687 10033 raft_consensus.cc:2368] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:19:09.531877 10113 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:19:09.533015 10038 raft_consensus.cc:1240] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 13:19:09.529799 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.552621 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.553557 10106 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:09.552624 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:09.555464 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.468109 17378 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:09.537289 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:09.558557 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.552723  9938 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.565834 10713 raft_consensus.cc:1275] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:19:09.568104 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d1d6b12e0b4e5b9006189784101119" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.568675 10113 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.569258 10106 raft_consensus.cc:2368] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:19:09.535238 10110 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:09.560727 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:09.559669 10111 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:09.556173 10115 raft_consensus.cc:2368] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:09.566624  9938 catalog_manager.cc:5697] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 22, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 22 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.517117 17277 raft_consensus.cc:2764] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 13:19:09.586246 17101 raft_consensus.cc:3055] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:09.586763 17101 raft_consensus.cc:740] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:09.590600 10113 raft_consensus.cc:2468] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
I20260709 13:19:09.591506 17347 raft_consensus.cc:3055] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:19:09.591929 17347 raft_consensus.cc:740] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:09.592705 17363 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:09.593394  9938 catalog_manager.cc:5697] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.595309  9938 catalog_manager.cc:5697] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 18 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.531876 16983 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:09.570011 10108 raft_consensus.cc:3060] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.575270 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
W20260709 13:19:09.580453 17424 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.342s	user 0.000s	sys 0.003s
W20260709 13:19:09.597186 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 77757.3us
I20260709 13:19:09.534322 17312 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.604621  9938 catalog_manager.cc:5697] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 16 to 17, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.621502  9938 catalog_manager.cc:5697] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.610334 17277 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.555733 17384 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:09.607667 10110 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 25.
I20260709 13:19:09.564553 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:19:09.624018 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 86810.4us
I20260709 13:19:09.629918 10078 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:09.623204  9938 catalog_manager.cc:5697] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 18 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:09.631163  9938 catalog_manager.cc:5697] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 22, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 22 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.625690 17277 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.536355 17340 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.087s
I20260709 13:19:09.605804 10032 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
W20260709 13:19:09.634914 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 70438.7us
I20260709 13:19:09.633795  9938 catalog_manager.cc:5697] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 17, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.637526  9938 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 20, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 20 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.639251  9938 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:09.643704 16763 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.645598 10110 raft_consensus.cc:1240] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:19:09.645787  9938 catalog_manager.cc:5697] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 12 to 13, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 13 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.644218 16763 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.647640  9938 catalog_manager.cc:5697] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 3 to 12, VOTER 9a67604b91f54791b1316fd327793337 (127.8.186.193) evicted. New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.650656 16763 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:09.650278  9938 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.653249 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:09.654316 17189 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:09.651858  9938 catalog_manager.cc:5697] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 20, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 20 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.656082  9938 catalog_manager.cc:5697] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 17, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 17 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.659199 16868 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.659703 16868 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.661834 16868 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.631865 17312 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:09.665009 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.665630 10032 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:09.668777 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.669045 10081 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:09.630223 17287 consensus_queue.cc:1059] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:19:09.670576 17117 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:09.671013 17409 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:19:09.671813 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 141325us
I20260709 13:19:09.628772 17163 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:09.673147 10185 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:09.673538 16763 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:19:09.672394 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47967.6us
I20260709 13:19:09.694288 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:09.703797 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:09.704617 10031 raft_consensus.cc:2368] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16.
I20260709 13:19:09.641744 16983 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:09.692787 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 59088.1us
I20260709 13:19:09.707499 10108 raft_consensus.cc:2468] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 22.
I20260709 13:19:09.710067 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:09.739480 10187 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 15.
I20260709 13:19:09.671416 17409 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:09.670955 17117 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:09.707990 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 66863.3us
I20260709 13:19:09.745268 16739 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:09.745788 16739 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.732399  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 298) took 9493 ms. Trace:
I20260709 13:19:09.587589 17101 consensus_queue.cc:260] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.642554 17384 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:09.573633 17378 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.735756 16763 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } attrs { replace: true } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.592808 17347 consensus_queue.cc:260] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.692497 17163 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.752094 10153 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:09.770105 10153 leader_election.cc:403] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.761005 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:09.732641 17355 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.669407 17428 consensus_queue.cc:1048] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.098s
I20260709 13:19:09.746724  9934 rpcz_store.cc:276] 0709 13:19:00.212035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.212197 (+   162us) service_pool.cc:224] Handling call
0709 13:19:09.705582 (+9493385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:06.818588 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:06.819275 (+   687us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:06.819336 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:19:06.819354 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:06.842579 (+ 23225us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:06.842702 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:06.842737 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:19:06.843443 (+   706us) tablet.cc:701] Row locks acquired
0709 13:19:06.843494 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:19:06.843676 (+   182us) write_op.cc:270] Start()
0709 13:19:06.882641 (+ 38965us) write_op.cc:276] Timestamp: P: 1783603146843601 usec, L: 0
0709 13:19:06.904518 (+ 21877us) op_driver.cc:348] REPLICATION: starting
0709 13:19:07.044091 (+139573us) log.cc:844] Serialized 2462 byte log entry
0709 13:19:07.574913 (+530822us) op_driver.cc:464] REPLICATION: finished
0709 13:19:07.714414 (+139501us) write_op.cc:301] APPLY: starting
0709 13:19:07.714527 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:07.783994 (+ 69467us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:07.784248 (+   254us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:07.788131 (+  3883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:07.788500 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:19:07.788564 (+    64us) write_op.cc:312] APPLY: finished
0709 13:19:07.788973 (+   409us) log.cc:844] Serialized 65 byte log entry
0709 13:19:07.793786 (+  4813us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:07.793928 (+   142us) write_op.cc:454] Released schema lock
0709 13:19:07.794000 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:07.794471 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:07.794508 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11720,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":137109,"apply.run_cpu_time_us":11501,"apply.run_wall_time_us":82108,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":238839,"prepare.run_cpu_time_us":50221,"prepare.run_wall_time_us":384590,"raft.queue_time_us":189836,"raft.run_cpu_time_us":15398,"raft.run_wall_time_us":91440,"replication_time_us":670203,"thread_start_us":484414,"threads_started":4,"wal-append.queue_time_us":179533,"wal-append.run_cpu_time_us":20837,"wal-append.run_wall_time_us":1550990}]]}
I20260709 13:19:09.750558 17343 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:09.774871 17163 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.776064 16685 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.748934 17117 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:09.774652 10153 leader_election.cc:400] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:19:09.786631 10153 leader_election.cc:403] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.781780 10682 leader_election.cc:400] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16.
I20260709 13:19:09.782380 10680 leader_election.cc:304] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:09.787132 10682 leader_election.cc:403] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.770267 17101 raft_consensus.cc:3060] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.792735 16739 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.779224 17274 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:09.779685 17347 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:09.802469 10153 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:09.765422 17426 consensus_queue.cc:1048] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.047s
W20260709 13:19:09.806170 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.797683 17273 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:19:09.779989 17355 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.804780 17203 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:09.796998 17338 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for earlier term 15. Current term is 16.
I20260709 13:19:09.803530 17327 tablet_copy_client.cc:538] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:09.800894 17421 raft_consensus.cc:2804] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:09.838047 10097 tablet_service.cc:1558] Processing DeleteTablet for tablet f1fa3c9e8a7a496eaa49ec78b5a92103 with delete_type TABLET_DATA_TOMBSTONED (TS fd3903ba079e4f47aaf0aa4432382c23 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:55796
W20260709 13:19:09.769481 17377 consensus_queue.cc:1175] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2f672b54d4754c5aa62b5b919597a14e" responder_term: 19 status { last_received { term: 17 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19. Ops: [18.14-18.14]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:09.839555 17434 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:19:09.852734 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 112903us
I20260709 13:19:09.825237 17427 raft_consensus.cc:2804] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:09.888563 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:19:09.898886 10152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.903345 17433 log.cc:927] Time spent T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:19:09.851177 17384 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.822927 17409 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:09.908051 17378 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:09.908550 17409 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.921007 17355 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:09.922132 17355 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:09.897154 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:09.922502 17355 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:09.922899 17355 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:09.849701 17203 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.921025 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:09.937906 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:09.945304 16763 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:09.950925 16763 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:09.951334 16763 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.951632 16763 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.956355 17443 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:09.925001 17421 raft_consensus.cc:697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:09.934325 17203 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:09.961257 10155 leader_election.cc:400] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 18. Current term is 19.
I20260709 13:19:09.879829 16983 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
W20260709 13:19:09.967526 10153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.961472 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.996706 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:09.932358 17427 raft_consensus.cc:697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:09.944494 17383 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:09.994375 10155 leader_election.cc:400] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
W20260709 13:19:09.989893 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68966.2us
I20260709 13:19:10.035151 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:19:10.065544 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 71297.3us
I20260709 13:19:10.035785 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:10.038431 10708 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:10.041054 10714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:10.042107 17421 consensus_queue.cc:237] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:09.971199 17277 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.050750 17427 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.051342 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:10.051609 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:10.051944 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:10.043269 16983 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:10.021487 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 63695us
I20260709 13:19:10.043246 17312 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.077263 10112 raft_consensus.cc:2368] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:19:10.078776 17312 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:10.069655 16763 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.065927 10711 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:19:10.080654 16763 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:10.082623 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:10.083235 10114 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:10.091148 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69197.4us
W20260709 13:19:10.094187 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 333265us
I20260709 13:19:10.096509 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:10.100256 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:10.100817 10155 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:10.097110 10181 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:10.114912 10040 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:19:10.116415 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:10.117048 10114 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:10.039600 17163 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.149484 17101 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:10.094728 17274 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.153581 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:10.164999 10189 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.154637 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:10.135174 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:10.167922 10039 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:10.150537 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 50494.1us
I20260709 13:19:10.169462 10004 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:10.121652 17378 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:10.166368 16685 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:10.166307 10153 leader_election.cc:400] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
I20260709 13:19:10.175299 10153 leader_election.cc:403] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:10.159610 17407 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:10.173871 10113 raft_consensus.cc:2368] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:10.197575 10189 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:10.199381 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:10.170408 17275 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:10.206584 10004 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:10.213145 17396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.027s
I20260709 13:19:10.168295 17101 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.239893 10003 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:10.171763 17274 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.248641 16685 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:10.249046 16685 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:10.249359 16685 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:10.199011 17277 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17.
W20260709 13:19:10.242544 17396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.012s	sys 0.028s
I20260709 13:19:10.217412 17275 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:10.265460 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 107279us
I20260709 13:19:10.259997 16685 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.265702 10188 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.213483 17449 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:10.242784 17384 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:10.288663 10188 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:10.228334 17355 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.270033 17275 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:10.335851 10181 raft_consensus.cc:2410] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 13:19:10.298986 17343 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:10.329293 17438 log.cc:927] Time spent T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:19:10.339706 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 71612us
I20260709 13:19:10.326740 17384 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:10.348655 17452 tablet_replica.cc:333] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:10.345046 17163 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:10.388330 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:10.397236 10182 raft_consensus.cc:1275] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:19:10.399199 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:10.399890 10183 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.403838 10039 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
I20260709 13:19:10.416699 17355 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.411460 10183 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
W20260709 13:19:10.418859 17409 consensus_meta.cc:287] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.002s
I20260709 13:19:10.419968 16685 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:10.420085 17101 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:10.424168 17384 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.428103 10115 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:19:10.429170 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:10.430006 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:10.436784 17203 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.439872 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:10.440618 10114 raft_consensus.cc:2368] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23.
I20260709 13:19:10.442942 17462 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:10.443589 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:10.446763 10035 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:10.412732 17396 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:10.447819 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:10.442183 17117 consensus_meta.cc:287] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.003s
I20260709 13:19:10.455912 17396 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:10.463969 17117 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:10.464601 17458 log.cc:927] Time spent T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.117s	user 0.002s	sys 0.001s
I20260709 13:19:10.466588 17117 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:10.467391 10078 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:10.470736 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:10.471102 17327 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
I20260709 13:19:10.466208 17396 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.474373 10182 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:10.471534 17287 raft_consensus.cc:2804] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:19:10.640903 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 145888us
I20260709 13:19:10.659451 17312 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:19:10.667073 17450 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.251s	user 0.000s	sys 0.007s
I20260709 13:19:10.669312 17274 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.670213 10713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42408 (request call id 1413) took 1073 ms. Trace:
I20260709 13:19:10.670603 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:10.670604 10713 rpcz_store.cc:276] 0709 13:19:09.597113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.624971 (+ 27858us) service_pool.cc:224] Handling call
0709 13:19:09.625364 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:09.693197 (+ 67833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.693228 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:09.693833 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.073430 (+379597us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:10.073486 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.073558 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.645683 (+572125us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:19:10.669879 (+ 24196us) raft_consensus.cc:1685] finished
0709 13:19:10.669900 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.670138 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74727,"raft.queue_time_us":71678,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5353,"spinlock_wait_cycles":47489792,"thread_start_us":319119,"threads_started":1,"wal-append.queue_time_us":617617}
I20260709 13:19:10.673166 17275 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.675486 17275 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.678954 17203 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.683859 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:10.687291 10713 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:10.694546 10182 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
W20260709 13:19:10.646118 17467 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:19:10.696233 10078 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:10.643322 17101 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:10.719874 17395 raft_consensus.cc:2804] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:10.719655 17101 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.660362 17312 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.681005 17287 raft_consensus.cc:697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:10.726657 10713 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 16.
I20260709 13:19:10.732175 17101 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.734145 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:10.736307 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:10.739799 17287 consensus_queue.cc:237] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.738389 17312 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:10.720499 17395 raft_consensus.cc:697] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:10.750208 17395 consensus_queue.cc:237] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.771220 17101 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:10.772059 17101 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.774446 17101 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:10.775384 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 472252us
I20260709 13:19:10.806329 16769 consensus_queue.cc:1048] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:10.806970 16769 consensus_queue.cc:1243] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer 9a67604b91f54791b1316fd327793337 log is divergent from this leader: its last log entry 24.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:10.809067 10040 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:10.809675 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:10.809995 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:10.810598 10036 raft_consensus.cc:3060] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.811072 10038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:10.811225 10031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:10.811648 10038 raft_consensus.cc:3060] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:10.804325 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:10.813205 17452 raft_consensus.cc:2243] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.815779 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:10.817760 17452 raft_consensus.cc:2272] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.820910 17274 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:10.851081 17456 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.510s	user 0.009s	sys 0.000s
I20260709 13:19:10.876108 17443 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:10.872592 10038 raft_consensus.cc:2468] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:10.882072 17274 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:10.877817 17443 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.928445 17443 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:10.939435 10153 leader_election.cc:400] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23.
I20260709 13:19:10.939896 10153 leader_election.cc:403] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:10.922317 17423 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:10.930368 17408 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:10.958242 16739 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:10.958834 16739 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:10.945276 17101 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 22. Current term is 23.
I20260709 13:19:10.982734 17452 ts_tablet_manager.cc:1916] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:10.984071 17277 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.955775 17274 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.952000 17423 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:10.955596 17408 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.000813 10036 raft_consensus.cc:2468] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
W20260709 13:19:10.943385 17356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.046s	sys 0.053s
I20260709 13:19:11.017097 16739 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.035408 16739 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:11.036098 16763 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:11.037042 16763 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.036085 16739 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.170374 16739 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.172133 16763 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.173105 17101 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:19:11.023963 17356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.046s	sys 0.053s
I20260709 13:19:11.206214 16763 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:19:11.212811 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 267238us
I20260709 13:19:11.206924 16763 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.011790 17277 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.218532 10153 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:11.177420 17363 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.010s	sys 0.052s
I20260709 13:19:11.221850 16769 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.222399 16769 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.173691 17117 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:19:11.228623 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 251672us
W20260709 13:19:11.224313 17363 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.010s	sys 0.053s
I20260709 13:19:11.242887 16769 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.244786 16763 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:11.226977 17394 raft_consensus.cc:2749] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:11.205881 17101 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:11.264727 17481 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:19:11.271582 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 81609.4us
I20260709 13:19:11.238454 17117 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.280401 10185 pending_rounds.cc:85] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 13
I20260709 13:19:11.280784 10185 pending_rounds.cc:107] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:19:11.281085 10185 raft_consensus.cc:2889] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.281644 17101 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:11.280817 17423 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.285830 17408 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.288580 17117 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.291071 17494 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:11.297961 17277 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.305135 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.308719 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.321760 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:11.322096 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.325318 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:11.326535 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.327175 10108 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 28.
I20260709 13:19:11.332805 17490 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.333436 17490 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.338514 17452 ts_tablet_manager.cc:1929] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:19:11.342355 17452 log.cc:1199] T f1fa3c9e8a7a496eaa49ec78b5a92103 P fd3903ba079e4f47aaf0aa4432382c23: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/wals/f1fa3c9e8a7a496eaa49ec78b5a92103
W20260709 13:19:11.339318 17468 log.cc:927] Time spent T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.912s	user 0.005s	sys 0.022s
I20260709 13:19:11.335646 17490 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.358796 10716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42422 (request call id 1166) took 1115 ms. Trace:
I20260709 13:19:11.359336 17452 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55796 (request call id 4) took 1665 ms. Trace:
I20260709 13:19:11.374442 17452 rpcz_store.cc:276] 0709 13:19:09.732223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.791054 (+ 58831us) service_pool.cc:224] Handling call
0709 13:19:10.303561 (+512507us) ts_tablet_manager.cc:1151] Deleting tablet f1fa3c9e8a7a496eaa49ec78b5a92103
0709 13:19:10.334296 (+ 30735us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:11.263655 (+929359us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:11.338346 (+ 74691us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:11.359214 (+ 20868us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":366942,"tablet-delete.queue_time_us":371094,"thread_start_us":263189,"threads_started":1}
I20260709 13:19:11.359233 10716 rpcz_store.cc:276] 0709 13:19:10.243213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.243367 (+   154us) service_pool.cc:224] Handling call
0709 13:19:10.256438 (+ 13071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.264119 (+  7681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.264150 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.271261 (+  7111us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.345614 (+ 74353us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:10.345657 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.345725 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.338755 (+993030us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:19:11.358495 (+ 19740us) raft_consensus.cc:1685] finished
0709 13:19:11.358518 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.358725 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7298,"raft.queue_time_us":7485,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7425,"spinlock_wait_cycles":17511296,"thread_start_us":74065,"threads_started":1,"wal-append.queue_time_us":155475}
I20260709 13:19:11.362463 17491 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:11.376221 17491 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:11.377139 17491 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.378338 17491 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:11.369956 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.370285 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.370656 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.371299 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.369812 10108 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:11.373734 17451 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 1.034s	user 0.000s	sys 0.018s
I20260709 13:19:11.409484 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.417635 10113 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:11.415138 17487 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:11.380756 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:11.411315 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:11.423589 10187 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:19:11.426831 16739 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:19:11.428048 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 47428.1us
I20260709 13:19:11.430117 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:11.430928 10189 raft_consensus.cc:2368] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:11.432112 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:11.436892 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:11.438133 10187 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:11.442852 10708 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 16: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:19:11.445469 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 100050us
I20260709 13:19:11.446640 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:11.462991 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:11.465967 10187 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:19:11.469415 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58207.4us
I20260709 13:19:11.489487 10680 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:11.474737 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:11.496974 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:11.472563 17490 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 13:19:11.504560 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 75201.1us
I20260709 13:19:11.505336 10004 leader_election.cc:400] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:11.505805 10187 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:11.498131 17472 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:11.503077 17427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.013s	sys 0.031s
I20260709 13:19:11.498049 17487 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:11.528228 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.499220 17490 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.501137 17277 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:11.528374 17427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.013s	sys 0.031s
I20260709 13:19:11.530611 17490 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:11.523229 17503 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:11.539561 17502 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:11.546526 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.531800 17487 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.547648 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.531774 17277 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.548816 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.556967 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
W20260709 13:19:11.556293 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 50644.7us
I20260709 13:19:11.561375  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:11.560055 17277 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:11.657051 17274 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:11.696789 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 146905us
I20260709 13:19:11.684032 17363 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.687028 17496 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:11.713714 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 156647us
I20260709 13:19:11.696151 17275 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:11.715965 10181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 3367) took 1595 ms. Trace:
I20260709 13:19:11.692864  9923 catalog_manager.cc:5028] TS fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): tablet f1fa3c9e8a7a496eaa49ec78b5a92103 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
W20260709 13:19:11.719183  9923 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 222739us
I20260709 13:19:11.718602 10181 rpcz_store.cc:276] 0709 13:19:10.116068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.116193 (+   125us) service_pool.cc:224] Handling call
0709 13:19:11.708243 (+1592050us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400097c54. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f451571 00007f3c6f4ec2fa 00007f3c744adb17 00007f3c6da286d4 00007f3c6da28662 00007f3c6da28591 00007f3c6da2850c 00007f3c6da277c2 00007f3c6d82348c 00007f3c6d8228c6 00007f3c6d82226f
0709 13:19:11.711605 (+  3362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496513792}
I20260709 13:19:11.727329 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:11.714071 17498 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.732808 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:11.733637 10036 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 16: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:11.713671 17449 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:19:11.734684 17514 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.735285 17498 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.769155 17514 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.771087 17498 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.771278 17514 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.774788 17487 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.727386 17275 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.737957 17515 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.720271 17510 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:11.734740 17506 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.715811 17496 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.738031 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
W20260709 13:19:11.740543 17478 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.809s	user 0.006s	sys 0.013s
I20260709 13:19:11.756304 17101 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.757134 17358 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.704002 17274 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.795995 17506 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.803988 17506 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.804100 17274 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.793802 17515 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:11.715078 17363 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.805874 17496 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.806339 17515 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.807096 17363 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:11.764864 17500 log.cc:927] Time spent T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:11.765477 17217 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.808934 17217 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.811019 17217 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:11.766989 17499 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:11.774637 17494 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:11.813098 17494 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.815397 17494 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:11.799047 10035 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:11.789989 17498 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:11.815706 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.816869 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:11.816874 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:11.801620 17358 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.826943 17358 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.830260 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:11.823724 17275 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:11.817293 17498 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.833739 17498 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.816977 17101 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:11.843922 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 350148us
I20260709 13:19:11.850445 17473 raft_consensus.cc:493] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:11.854674 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.858667 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.860137 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.861364 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.862547 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.863166 10114 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:19:11.864073 17454 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:11.864675 17454 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.866884 17454 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:11.867664 17358 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.868237 17358 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.870530 17358 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.859464 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.884936 10111 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:11.851099 17473 raft_consensus.cc:515] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:11.902175 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.905270 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:11.911896 10108 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:11.902983 10111 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:19:11.810072 17277 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:11.920498 17277 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:11.928480 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:11.929193 10110 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:19:11.931337 10153 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:11.933326 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 225522us
I20260709 13:19:11.936847 10003 leader_election.cc:400] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:11.939486 10003 leader_election.cc:403] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:19:11.940099 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:11.935581 10081 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:11.947166 17163 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:11.948222 17473 leader_election.cc:290] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:11.913170 17358 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:11.960536 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:11.961323 10036 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 28.
I20260709 13:19:11.945341 17273 raft_consensus.cc:2749] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:11.964484 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:11.974289 10680 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:11.974778 10036 raft_consensus.cc:2393] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 19: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:11.951081 17284 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 22. Current term is 23.
I20260709 13:19:11.992650 10036 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:11.993485 10110 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:11.980356 16763 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:11.988507 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:12.006994 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.009265 10180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39164 (request call id 2916) took 1539 ms. Trace:
I20260709 13:19:12.011483 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.013248 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:19:12.014730 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 74694.9us
I20260709 13:19:12.009683 10180 rpcz_store.cc:276] 0709 13:19:10.470029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.472026 (+  1997us) service_pool.cc:224] Handling call
0709 13:19:10.472378 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.472737 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.472766 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.473218 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.710275 (+1237057us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b180015b0e0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3dde07 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b 00007f3c6f087d23 00007f3c6f0880d1 00007f3c6f4a3a0f
0709 13:19:11.795773 (+ 85498us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:11.795817 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.795888 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.008974 (+213086us) raft_consensus.cc:1685] finished
0709 13:19:12.008996 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.009179 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351,"raft.queue_time_us":87,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":163524,"spinlock_wait_cycles":7667072,"thread_start_us":82096,"threads_started":1,"wal-append.queue_time_us":1458904}
I20260709 13:19:11.949736 17358 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.020678 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.022650 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.022869 10106 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:12.023100 10111 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:12.015573 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:11.981686 17430 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:11.962577 17275 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.011127 17163 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:12.026543 17273 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:12.034981 10003 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:11.981869 17199 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:19:12.030869 17277 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:12.028973 17101 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.032786 17506 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.049814 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.045499 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.040599 17449 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:12.046260 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.031373 17275 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.040035 17273 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.061622 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.046624 10035 pending_rounds.cc:85] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting all ops after (but not including) 12
I20260709 13:19:12.065433 10003 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:12.071167 10155 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:12.044286 17277 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.068223 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.054827 10115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f89d2cf222427f9747123276de473f"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:12.091575 10032 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:12.088295 10004 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.111065 10035 pending_rounds.cc:107] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: Aborting uncommitted NO_OP operation due to leader change: 24.13
W20260709 13:19:12.061381 17490 consensus_meta.cc:287] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.001s
W20260709 13:19:12.115165 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67860.5us
W20260709 13:19:12.065541 17421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.394s	user 0.014s	sys 0.052s
I20260709 13:19:12.044615 17163 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:12.112087 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 46754.1us
I20260709 13:19:12.116173 10035 raft_consensus.cc:2889] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:12.115517 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44449us
I20260709 13:19:12.116703 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.132545 10003 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:12.135915 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47712.4us
I20260709 13:19:12.136831 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.112398 17277 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.085932 17396 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.117884 17327 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:12.118021 17487 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:12.127493 17421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.473s	user 0.014s	sys 0.053s
I20260709 13:19:12.111547 17274 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.157384 10682 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.061604 17506 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.117565 17516 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.055579 17363 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:19:12.111158 17273 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:12.164446 10112 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:12.151882 17519 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:12.139667 17427 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:12.180404 17427 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:12.180862 17427 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:12.170704 17515 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.171492 17101 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:12.184907 17101 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.185269 17101 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:12.127853 17413 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:19:12.152633 17511 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:12.127627 17490 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.205623 17163 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.206076 17490 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.193537 17275 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.164163 17396 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.208122 17358 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.209079 17396 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.165169 17487 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:12.209878 17487 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.207103 17273 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.212096 17273 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.171937 17274 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.209614 17427 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.215070 17427 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.189296 17423 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:12.201747 17506 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.168699 17520 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:12.228117 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.229523 10032 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:12.231077 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.215092 17274 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.251235 17413 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:12.256321 17101 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.259516 17487 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:12.284894 17274 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:12.308156 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 191527us
I20260709 13:19:12.329160 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.343465 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:12.348002 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.368177 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:12.369103 10111 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:12.371815 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.380607 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:12.382773 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:12.384394 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 47088.7us
I20260709 13:19:12.331423 16983 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.399206 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 59686.1us
I20260709 13:19:12.399894 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:12.330236 17520 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.413475 10111 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 29.
I20260709 13:19:12.345721 17510 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:12.381045 17430 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.345237 17506 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.343389 17444 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:19:12.391635 17327 log.cc:927] Time spent T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.002s
I20260709 13:19:12.406677 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:12.420562 17409 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.427331 10115 raft_consensus.cc:606] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.429731 10115 raft_consensus.cc:614] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:12.431404 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 297155us
I20260709 13:19:12.434425 10155 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.356375 17274 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:12.444748 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 282359us
I20260709 13:19:12.450937 10155 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:12.454794 10034 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:12.442633 10153 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.425774 17444 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:12.415549 16983 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.424898 17520 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.437826 17496 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.448582 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.469123 17274 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:12.470458 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.470933 17487 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:12.471719 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:12.431110 17430 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:12.474356 17430 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.450954 17394 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:19:12.475979 17528 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:12.476617 17528 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:12.478667 17528 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:12.478984 17444 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:12.454463 17427 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:12.438270 17277 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.484407 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.429951 17506 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.485643 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.498008 10034 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 16.
I20260709 13:19:12.486356 10112 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:12.500106 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:12.500946 10708 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:19:12.501964 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:12.451512 17511 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:19:12.479231 17449 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:12.481961 17490 raft_consensus.cc:2804] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:19:12.480465 17101 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:12.489810 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 357445us
I20260709 13:19:12.520519 10003 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.523957 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.513305 17449 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.525103 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.550107 10003 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.580030 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:12.580976 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.545533 17518 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:12.586611 16739 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.587175 16739 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.592725 10188 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:12.593830 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.595347 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.596158 10180 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 23.
I20260709 13:19:12.597299 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.598667 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.599344 10183 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:12.594518 10187 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:19:12.510787 17454 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:19:12.608105 10181 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:19:12.613977 10180 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:19:12.513662 17531 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:19:12.542315 17490 raft_consensus.cc:697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 29 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:12.556970 17515 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:12.619163 10185 raft_consensus.cc:1240] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:19:12.578114 17449 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.647894 17514 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:12.603447 17199 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:12.626279 10186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:12.661988 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 198135us
I20260709 13:19:12.606069 17163 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:12.652223 17506 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.635251 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:12.637359 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:12.621817 17532 log.cc:927] Time spent T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:12.655931 17490 consensus_queue.cc:237] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.644747 17277 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:12.650974 16983 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.664829 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.661798 10186 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 22.
I20260709 13:19:12.676046 10181 raft_consensus.cc:1275] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:12.666112 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:12.667420 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 142392us
I20260709 13:19:12.670058 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8111eefbfbe3442e98fd2c9b054ee1a5" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.677134 10189 raft_consensus.cc:2393] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 25: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:12.678604 10187 raft_consensus.cc:2393] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:12.670763 10184 raft_consensus.cc:1275] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:12.647694 17520 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.659653 17515 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:12.681679 10181 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:12.700479 17515 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:12.678397 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.687114 17327 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:12.668292 17163 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:12.710475 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.711697 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.678987 17506 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:12.715986 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:12.720527 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.719851 17506 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.723481 17506 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.722882 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.728355 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.715085 17163 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.715766 17511 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:12.733142 17511 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.733556 17511 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:12.750927 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.751844 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.752046 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.752619 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:12.753579 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 242433us
I20260709 13:19:12.751674 10032 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:12.755389 17497 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:12.755872 17497 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.756222 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.756263 17497 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:12.755900 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.769836 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.770129 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.771675 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.772034 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.772418 10034 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
I20260709 13:19:12.731429 17487 consensus_queue.cc:1059] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:19:12.741329 17535 consensus_queue.cc:1059] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:19:12.782963 17327 tablet_bootstrap.cc:492] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:19:12.783946 17327 ts_tablet_manager.cc:1403] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 2.313s	user 0.051s	sys 0.067s
I20260709 13:19:12.786834 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:12.790416 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:12.791222 10040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:12.791813 10040 raft_consensus.cc:3060] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:19:12.795344 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 78752.2us
I20260709 13:19:12.740604 17534 consensus_queue.cc:1059] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:19:12.795028 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:12.798071 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.803155 10078 leader_election.cc:304] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.805009 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:12.813063 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:12.814635 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.822754 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.823757 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.827436 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:12.831159 10003 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.832495 10003 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:12.833423 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:12.834105 10040 raft_consensus.cc:2468] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 29.
I20260709 13:19:12.812119 17544 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:12.827862 17514 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:12.835202 17552 raft_consensus.cc:3055] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:12.889161 10034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:12.830472 17528 raft_consensus.cc:2749] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:12.829051 17274 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:12.882372 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 79291.4us
I20260709 13:19:12.837281 17518 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:12.893168 10078 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.851696 17534 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:12.892323 17525 log.cc:927] Time spent T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:12.852622 17544 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:12.858019 17514 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:12.942167 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.888289 17552 raft_consensus.cc:740] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:12.921569 17409 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:12.949429 16739 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:12.948238 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 119927us
I20260709 13:19:12.951494 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:12.896811 17453 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:12.949735 17544 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:12.957684 17554 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:12.959204 17552 consensus_queue.cc:260] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.960566 17552 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.963027 17449 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.944150 17514 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.967855 17453 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.949497 17561 consensus_queue.cc:1048] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:19:12.969146 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.989583 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:12.969632 17473 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:12.973225 17163 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:12.973527 17515 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.975499 17449 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:12.978663 17506 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:12.921913 17497 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:12.969069 17549 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.984901 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:12.996712 17553 log.cc:927] Time spent T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:19:12.996115 17356 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.955789 17444 consensus_queue.cc:1048] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:19:13.006098 17527 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:13.042951 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.044255 10155 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:13.047501 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:13.049866 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.050493 10109 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.051429 17449 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.051970 17449 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.053704 17427 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:13.054121 17427 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:13.054540 17427 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.054052 17449 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.060495 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.061693 10155 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.062397 17453 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.063292 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.063962 17363 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.064479 17274 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:13.064934 17275 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.077383 17277 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:13.077800 17277 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:13.078164 17277 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.086272 10033 raft_consensus.cc:1240] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:13.090569 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.091372 10032 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 24: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:13.092108 10037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.096460 17511 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:13.098752 17511 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.036510 17488 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:13.099648 17488 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.100201 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.101192 17275 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:13.101833 17488 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.102596 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.102813 10031 raft_consensus.cc:1240] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:13.102998 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:13.104590 17497 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.109092 17515 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.110252 17514 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.110702 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:13.111466 10035 raft_consensus.cc:2368] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20.
I20260709 13:19:13.112547 17277 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.069620 17327 raft_consensus.cc:359] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:13.071671 17506 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.072504 17519 raft_consensus.cc:3055] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:13.073029 17163 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:13.116153 17490 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:13.117182 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:13.070196 17550 log.cc:927] Time spent T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.232s	user 0.000s	sys 0.003s
I20260709 13:19:13.125464 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.115610 10034 raft_consensus.cc:1240] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:13.128574 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:13.174343 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 57251.6us
I20260709 13:19:13.130559 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:13.134799 10109 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:19:13.177945 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:13.175172 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.179522 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.181021 10039 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 24: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:13.185798 17199 raft_consensus.cc:3055] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:13.187909 17199 raft_consensus.cc:740] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:13.188728 17199 consensus_queue.cc:260] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.189182 17277 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:13.147890 17409 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:13.190645 17284 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:13.191459 10004 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:13.189756 17199 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:13.192194 17521 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:13.191461 17427 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.194635 17284 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:13.195365 17284 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:13.196022 17413 consensus_queue.cc:1059] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:13.196342 17284 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.197069 10109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:13.197690 10109 raft_consensus.cc:606] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.194689 17427 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:13.192458 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.199873 16763 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.202793 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:13.204814 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.206614 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.144435 17327 raft_consensus.cc:740] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:19:13.207993 10081 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:13.187232 10155 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.209221 17277 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:13.210067 10109 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:13.198653 17413 raft_consensus.cc:3055] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:13.210966 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.211086 17413 raft_consensus.cc:740] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.211802 17277 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.212170 17413 consensus_queue.cc:260] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.213442 17413 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:13.208415 17327 consensus_queue.cc:260] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:13.209858 17473 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:13.178547 17516 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:13.209494 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.216837 10106 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:13.218540 17327 ts_tablet_manager.cc:1434] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.434s	user 0.007s	sys 0.007s
I20260709 13:19:13.217935 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.220611 10125 tablet_copy_service.cc:342] P fd3903ba079e4f47aaf0aa4432382c23: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-f5f53253de3345159399b6816804e1e6 received from {username='slave'} at 127.0.0.1:53672
I20260709 13:19:13.221117 10125 tablet_copy_service.cc:434] P fd3903ba079e4f47aaf0aa4432382c23: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-f5f53253de3345159399b6816804e1e6 on tablet f5f53253de3345159399b6816804e1e6 with peer 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:13.220810 17552 consensus_queue.cc:1059] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:19:13.222252 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:13.222886 10187 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:13.223321 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:13.223588 10035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "2f672b54d4754c5aa62b5b919597a14e"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:19:13.223356 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:13.224644 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:13.154136 17511 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:13.229540 17511 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.175541 17549 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.232640 10039 raft_consensus.cc:1240] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting Update request from peer 2f672b54d4754c5aa62b5b919597a14e for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:13.236528 10182 raft_consensus.cc:1240] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:19:13.233757 10003 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.239243 10032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:13.235865 10035 raft_consensus.cc:606] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Received request to transfer leadership to TS 2f672b54d4754c5aa62b5b919597a14e
I20260709 13:19:13.240772 10035 raft_consensus.cc:614] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.247195 10106 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:13.254076 10155 leader_election.cc:400] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20.
I20260709 13:19:13.231716 17511 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:13.245544 10039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.147070 17519 raft_consensus.cc:740] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:13.259205 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.265528 17518 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.278965 17514 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.276440 10004 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:13.296334 17519 consensus_queue.cc:260] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.297528 17519 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.298379 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:13.299834 17531 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.300328 17531 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.302338 17531 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:13.302505 17355 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:13.302930 17355 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:13.303294 17355 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:13.315984 10713 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:13.322172 10185 raft_consensus.cc:1240] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:13.319022 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:13.330297 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.320199 10106 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:13.334296 17356 consensus_queue.cc:1059] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:13.334903 10106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.336061 10111 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 29 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 13:19:13.342801 17521 consensus_queue.cc:1059] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:13.344206 17569 consensus_queue.cc:1059] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:13.345829 17569 raft_consensus.cc:3055] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:13.344030 17531 raft_consensus.cc:3055] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:13.346235 17569 raft_consensus.cc:740] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.346451 17531 raft_consensus.cc:740] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:13.347383 17531 consensus_queue.cc:260] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.348877 17394 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:19:13.356478 17356 raft_consensus.cc:3055] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:13.357010 17356 raft_consensus.cc:740] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.357995 17356 consensus_queue.cc:260] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:13.359228 17356 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:13.362787 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:13.364675 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 88358.1us
I20260709 13:19:13.327610 10711 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:19:13.366642 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:13.368573 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:13.370455 17549 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:13.373659 17549 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.377317 16983 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:13.377907 16983 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:13.378787 16983 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.381558 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:13.383031 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:13.385206 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.392171 10035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103"
dest_uuid: "9a67604b91f54791b1316fd327793337"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:42670
I20260709 13:19:13.392881 10035 raft_consensus.cc:606] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.393205 10035 raft_consensus.cc:614] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.396114 10182 raft_consensus.cc:1240] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:13.383355 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.414234 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.419159 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.419473 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.420243 10155 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.423954 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.424582 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.367908 17520 raft_consensus.cc:3055] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:13.347203 17569 consensus_queue.cc:260] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.411777 17549 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.434708 17394 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:13.436877 17483 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:13.416750 17488 consensus_queue.cc:1059] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:19:13.430794 17520 raft_consensus.cc:740] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:13.441766 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:13.454259 10110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1"
dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
mode: GRACEFUL
new_leader_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:19:13.422580 17199 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:13.429171 17273 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.456076 10110 raft_consensus.cc:606] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Received request to transfer leadership to TS f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.460964 10110 raft_consensus.cc:614] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.432168 17363 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.431921 17503 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:13.483104 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 205331us
I20260709 13:19:13.488077 10003 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.489892 17561 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:13.490563 17561 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.491906 17274 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:13.491550 17561 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.493666 17535 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:13.498450  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:13.509085 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.505146 17520 consensus_queue.cc:260] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.515442 17520 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:13.520612 17396 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.521414 17396 consensus_queue.cc:1059] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:13.522414 17396 raft_consensus.cc:3055] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.522673 17549 consensus_queue.cc:1059] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:13.506671 17355 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.530448 17355 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:13.541280 17453 raft_consensus.cc:3055] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.541791 17453 raft_consensus.cc:740] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.542666 17453 consensus_queue.cc:260] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.543893 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:13.547930 10711 raft_consensus.cc:1240] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:19:13.559908 17217 raft_consensus.cc:3055] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.560451 17217 raft_consensus.cc:740] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:13.561399 17217 consensus_queue.cc:260] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.562800 17217 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.584429 17275 consensus_queue.cc:1059] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:13.587816 17531 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:13.588076 10080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.522768 17396 raft_consensus.cc:740] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.553727 17453 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:13.613090 17576 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
W20260709 13:19:13.614104 10006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.615861 17574 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
W20260709 13:19:13.616217 17578 log.cc:927] Time spent T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.083s	user 0.012s	sys 0.006s
W20260709 13:19:13.616715 17575 log.cc:927] Time spent T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.098s	user 0.018s	sys 0.000s
I20260709 13:19:13.504609 10003 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.621212  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:13.630762 17396 consensus_queue.cc:260] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.631433 10036 raft_consensus.cc:1240] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:13.641763 17581 log.cc:927] Time spent T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:19:13.647877 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 143366us
I20260709 13:19:13.659793 10033 raft_consensus.cc:1240] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:13.664541 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:13.665329 10181 raft_consensus.cc:1240] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:13.666035 10185 raft_consensus.cc:1240] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:19:13.646754 17544 raft_consensus.cc:3055] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:13.698770 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:13.653995 17355 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:13.703724 16983 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.704360 16983 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.659464 17305 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:13.716228 17305 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.718442 17305 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:13.694564 17574 log.cc:927] Time spent T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:13.726212 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:13.732748 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:13.733875 10003 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.725340 17569 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.736474 10003 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.738879 17515 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:13.734733 16739 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:19:13.743548 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 223362us
I20260709 13:19:13.676292 17544 raft_consensus.cc:740] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:13.720409 17396 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.744381 17549 consensus_queue.cc:1059] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:19:13.760010 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:13.760602 17413 raft_consensus.cc:3055] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:13.760812 17548 raft_consensus.cc:993] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: : Instructing follower f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:19:13.761070 17413 raft_consensus.cc:740] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.766351 17544 consensus_queue.cc:260] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:13.767387 17583 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:13.767849 17544 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.766513 17548 raft_consensus.cc:1081] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Signalling peer f145536c6dbe456fb8565950244bc2a5 to start an election
I20260709 13:19:13.773236 10181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8"
dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
 from {username='slave'} at 127.0.0.1:39164
I20260709 13:19:13.773921 10181 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:13.774384 10181 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.779534 10078 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:13.783411 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:13.783816 10034 raft_consensus.cc:1275] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 13:19:13.785162 10035 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:13.794678 17549 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.794287 10181 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.802111 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.803911 17497 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.805136 10180 raft_consensus.cc:1240] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:13.810844 17189 consensus_queue.cc:1059] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:13.813038 17409 raft_consensus.cc:3055] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:13.813515 17409 raft_consensus.cc:740] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:13.814440 17409 consensus_queue.cc:260] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:13.816179 10711 raft_consensus.cc:1217] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:19:13.820711 10184 raft_consensus.cc:3055] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.821491 10184 raft_consensus.cc:740] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:13.822885 10110 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:13.823276 10184 consensus_queue.cc:260] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.824536 10184 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.831091 17409 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:13.825829 17427 consensus_queue.cc:1175] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a67604b91f54791b1316fd327793337" responder_term: 20 status { last_received { term: 20 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:13.825604 17101 consensus_queue.cc:1048] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 13:19:13.857965 16983 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:13.865891 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:13.866641 10711 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 24.
I20260709 13:19:13.872766 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:13.867569 17413 consensus_queue.cc:260] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:13.875787 17413 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:13.878664 17449 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:13.879142 17449 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.879482 17449 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.837306 17506 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:19:13.953585 10184 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:19:13.954075 10184 pending_rounds.cc:85] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Aborting all ops after (but not including) 12
I20260709 13:19:13.954298 10184 pending_rounds.cc:107] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:19:13.954520 10184 raft_consensus.cc:2889] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.967780  9933 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 14 to 17, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 17 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.968822 10024 tablet_service.cc:1558] Processing DeleteTablet for tablet 8111eefbfbe3442e98fd2c9b054ee1a5 with delete_type TABLET_DATA_TOMBSTONED (TS 9a67604b91f54791b1316fd327793337 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:39406
I20260709 13:19:13.970842  9938 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 201) took 7847 ms. Trace:
I20260709 13:19:13.971378  9938 rpcz_store.cc:276] 0709 13:19:06.124111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.124423 (+   312us) service_pool.cc:224] Handling call
0709 13:19:13.970740 (+7846317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.252090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:10.400780 (+148690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:10.407333 (+  6553us) write_op.cc:435] Acquired schema lock
0709 13:19:10.412500 (+  5167us) tablet.cc:662] Decoding operations
0709 13:19:10.421201 (+  8701us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:10.421294 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:10.421323 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:19:10.422483 (+  1160us) tablet.cc:701] Row locks acquired
0709 13:19:10.422503 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:10.422659 (+   156us) write_op.cc:270] Start()
0709 13:19:10.422778 (+   119us) write_op.cc:276] Timestamp: P: 1783603150422610 usec, L: 0
0709 13:19:10.422802 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:19:10.423533 (+   731us) log.cc:844] Serialized 6665 byte log entry
0709 13:19:10.803156 (+379623us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6c3de0ac 00007f3c75238ab9 00007f3c6c3fa69b 00007f3c6c3f893f 00007f3c6c3fac02 00007f3c6f08220b
0709 13:19:11.739001 (+935845us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6c283db1 00007f3c6c321c85 00007f3c6c3226a2 00007f3c6f0941db 00007f3c6f08faaf 00007f3c6f08386e 00007f3c6f082bb6 00007f3c6f0827d8 00007f3c6f08c221 00007f3c6f08c1d9 00007f3c6f08c169
0709 13:19:12.180195 (+441194us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.628748 (+448553us) write_op.cc:301] APPLY: starting
0709 13:19:12.641579 (+ 12831us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:12.725491 (+ 83912us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:12.725519 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:12.946014 (+220495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.024778 (+ 78764us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:19:13.028062 (+  3284us) write_op.cc:312] APPLY: finished
0709 13:19:13.228705 (+200643us) log.cc:844] Serialized 156 byte log entry
0709 13:19:13.276278 (+ 47573us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.314387 (+ 38109us) write_op.cc:454] Released schema lock
0709 13:19:13.372955 (+ 58568us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:13.428268 (+ 55313us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.428306 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22025,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":410531,"apply.run_cpu_time_us":41068,"apply.run_wall_time_us":811321,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75085,"num_ops":17,"prepare.queue_time_us":427971,"prepare.run_cpu_time_us":18921,"prepare.run_wall_time_us":633952,"raft.queue_time_us":315350,"raft.run_cpu_time_us":43052,"raft.run_wall_time_us":352493,"replication_time_us":1746637,"spinlock_wait_cycles":60029440,"thread_start_us":1361342,"threads_started":5,"wal-append.queue_time_us":596230,"wal-append.run_cpu_time_us":51277,"wal-append.run_wall_time_us":2260119}]]}
I20260709 13:19:13.970927 10181 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:13.975137  9933 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 20 to 21, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.990900  9933 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 16 to 18, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 18 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.982872 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:13.993021 10716 raft_consensus.cc:3060] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.993660  9933 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 18 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:14.004220 17589 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:14.012523 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 55633.2us
I20260709 13:19:13.887504 17449 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:14.026247 17449 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:14.029666 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62c17c1a96045a9a7d8729d053776f8" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:14.030377 10108 raft_consensus.cc:1240] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Rejecting Update request from peer f145536c6dbe456fb8565950244bc2a5 for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:14.039909 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 84211us
W20260709 13:19:14.038149 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 80339.5us
I20260709 13:19:14.051940 10115 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:19:14.059451 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:14.063244 10711 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.065186 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:14.057461 10716 raft_consensus.cc:2468] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 15.
I20260709 13:19:14.068826 10153 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.084118 10115 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:14.053386 17511 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:19:14.107973 17356 raft_consensus.cc:1064] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:19:14.081717 17584 raft_consensus.cc:2804] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:14.141645 10034 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Rejecting Update request from peer fd3903ba079e4f47aaf0aa4432382c23 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:14.147516 17584 raft_consensus.cc:697] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:14.151757 17584 consensus_queue.cc:237] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:14.149169 17561 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:19:14.157505 17561 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:14.157894 17561 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:14.158769 17561 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:14.182219 10181 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:14.192695 16763 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:14.200592 17592 tablet_replica.cc:333] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:14.201743 17592 raft_consensus.cc:2243] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.202399 17592 raft_consensus.cc:2272] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.205413 16763 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:14.208173 10711 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 25.
I20260709 13:19:14.224858 10004 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:14.226555 16739 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:14.227102 16739 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:14.233753 17356 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:14.244197 16739 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:14.283320 17561 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:14.250028 17590 log.cc:927] Time spent T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:14.310318 17449 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.314564 17592 ts_tablet_manager.cc:1916] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:14.347023 17449 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.404289 17449 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.406416 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:14.407141 10185 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:19:14.413241 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:14.414002 10111 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
I20260709 13:19:14.415305 10004 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.419386 17449 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:14.419826 17449 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.420168 17449 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.470697 10185 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:14.473346 10711 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEARNER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:14.477366 10033 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:14.477913 17453 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:14.479030 17548 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:14.491268 17453 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.491964 17453 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.494899 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.495591 10033 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
I20260709 13:19:14.496901 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.497764 17561 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:14.498193 17561 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.499253 17561 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:14.500881 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:14.503029 17453 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.506035 17449 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.524175 17356 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:19:14.587415 17453 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.604530 17449 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.605485 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:14.606160 10185 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.608546 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:14.609138 10110 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.603586 17592 ts_tablet_manager.cc:1929] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:19:14.615991 10185 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:14.610466 17548 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.616961 10110 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:14.617101 10003 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:14.621783 17512 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:14.622308 17512 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:14.605705 10036 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.627518 17512 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.620664 17548 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.634454 17548 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.618767 17592 log.cc:1199] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 9a67604b91f54791b1316fd327793337: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/wals/8111eefbfbe3442e98fd2c9b054ee1a5
I20260709 13:19:14.639954 17561 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.644343 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.648753  9925 catalog_manager.cc:5028] TS 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): tablet 8111eefbfbe3442e98fd2c9b054ee1a5 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:19:14.654976 10713 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:14.645998 10033 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:19:14.666880 17273 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:14.668140  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:14.668397 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:14.669302 10081 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.682121 17548 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:14.682613 17548 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.685787 17548 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.688082 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:14.688958 10033 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:14.683811 17561 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.694796 10115 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 13:19:14.695192 10115 pending_rounds.cc:85] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Aborting all ops after (but not including) 17
I20260709 13:19:14.695422 10115 pending_rounds.cc:107] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 13:19:14.695880 10115 raft_consensus.cc:2889] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:14.704710 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:14.717635 10110 raft_consensus.cc:1275] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:14.711372 17535 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 13:19:14.730146 17584 consensus_queue.cc:1048] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:14.730600 10033 raft_consensus.cc:2468] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:19:14.737684 10081 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:14.732705 10713 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.745615 17497 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.746273 17497 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:14.741910 17356 raft_consensus.cc:2804] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:14.750916 17356 raft_consensus.cc:697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:14.765118 17521 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.765511 17497 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.765805 17521 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.767894 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:14.769557 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.770395 10036 raft_consensus.cc:2410] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:19:14.774230 10716 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:19:14.776635 17449 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:14.789340 17584 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.789960 17584 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.753260 17356 consensus_queue.cc:237] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.798019 17521 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:14.811044 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.811826 10033 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:19:14.816105 17584 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:14.820955 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:14.821612 10115 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 25.
I20260709 13:19:14.822718 17584 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:14.819428 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:14.823254 17584 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:14.826779 10181 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.830775 17548 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.831319 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.831451 17521 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:14.836547 17521 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.838263 10036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337"
I20260709 13:19:14.838522 17548 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.838873 17584 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:19:14.839016 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:14.822835 17549 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:14.839601 10180 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.839227 10033 raft_consensus.cc:2393] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 21: Already voted for candidate 9a67604b91f54791b1316fd327793337 in this term.
I20260709 13:19:14.832662 17273 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:14.838835 10036 raft_consensus.cc:3060] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.844723 17273 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.846805 17273 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:14.842557 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.842902 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:14.848191 10115 raft_consensus.cc:2368] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25.
I20260709 13:19:14.842617 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:14.848737 10180 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 25.
I20260709 13:19:14.849084 10107 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:19:14.849311 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.839706 17549 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.849908 10078 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.851329 17549 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.856009 10033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:14.840613 17521 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:14.856635 10033 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:19:14.841619 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.862939 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:14.849977 10035 raft_consensus.cc:2368] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 23. Current term is 24.
I20260709 13:19:14.870579 10155 leader_election.cc:400] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 23. Current term is 24.
I20260709 13:19:14.870888 10155 leader_election.cc:403] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:14.872594 10036 raft_consensus.cc:2468] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 25.
I20260709 13:19:14.873456 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:14.873592 10153 leader_election.cc:400] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25.
I20260709 13:19:14.874027 10153 leader_election.cc:403] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:14.874614 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:14.875386 10180 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:14.879990 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:14.879833  9938 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index -1 to 12, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:19:14.888447  9938 catalog_manager.cc:5697] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 23 to 26, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 26 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.890178  9938 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.893891  9938 catalog_manager.cc:5697] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.895274  9938 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 21 to 22, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 22 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.896736  9938 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.898079  9938 catalog_manager.cc:5697] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 19, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:19:14.917711 16739 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.918304 16739 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:14.900374  9938 catalog_manager.cc:5697] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.878129 17273 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:14.880388 17163 raft_consensus.cc:2804] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:14.879674 17521 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:14.880635 17531 raft_consensus.cc:3060] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:19:14.886552 17533 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 24. Current term is 25.
I20260709 13:19:14.885510 17549 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:14.927723  9938 catalog_manager.cc:5697] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 21 to 23, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 23 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:19:14.952345 16739 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:14.953954  9933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 303) took 11129 ms. Trace:
I20260709 13:19:14.939486  9938 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 21, leader changed from 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 21 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.933887 17273 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.955199  9938 catalog_manager.cc:5697] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:14.935971 17356 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:14.964350 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:14.965063 10180 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 26.
I20260709 13:19:14.940172 17163 raft_consensus.cc:697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:14.939555 17549 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:14.966004 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:14.994722 16739 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:14.995133 16739 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.995446 16739 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:14.957742 17533 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:14.951095 17506 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:15.000385  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
I20260709 13:19:14.954867 17584 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:14.957131 17273 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:15.001713 10035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a67604b91f54791b1316fd327793337" is_pre_election: true
I20260709 13:19:15.005903 10035 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
W20260709 13:19:15.001889 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 122089us
I20260709 13:19:14.954382  9933 rpcz_store.cc:276] 0709 13:19:03.824968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.873995 (+ 49027us) service_pool.cc:224] Handling call
0709 13:19:05.058817 (+1184822us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f452090 00007f3c6f4f0f3a 00007f3c752a71cc 00007f3c753a537e 00007f3c738662a4 00007f3c73866232 00007f3c73866161 00007f3c738660dc 00007f3c73865392 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:14.953876 (+9895059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:14.408159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:14.408704 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:14.408740 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:14.408758 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:14.409321 (+   563us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:14.409377 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:14.409406 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:19:14.409773 (+   367us) tablet.cc:701] Row locks acquired
0709 13:19:14.409791 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:14.409930 (+   139us) write_op.cc:270] Start()
0709 13:19:14.410047 (+   117us) write_op.cc:276] Timestamp: P: 1783603154409883 usec, L: 0
0709 13:19:14.410074 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:19:14.410720 (+   646us) log.cc:844] Serialized 1701 byte log entry
0709 13:19:14.627547 (+216827us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b1800428ec0. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c752c3de1 00007f3c752d05b1 00007f3c6c3fb3f3 00007f3c6c3fd7c1 00007f3c6c3fd779 00007f3c6c3fd709 00007f3c6c3fd6d1 00007f3c6c3fc9cd 000000000038f354 000000000038f199 00007f3c6c3de83a
0709 13:19:14.627937 (+   390us) op_driver.cc:464] REPLICATION: finished
0709 13:19:14.708603 (+ 80666us) write_op.cc:301] APPLY: starting
0709 13:19:14.708687 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:14.725125 (+ 16438us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:14.725149 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:14.777234 (+ 52085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:14.777444 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:19:14.777492 (+    48us) write_op.cc:312] APPLY: finished
0709 13:19:14.777702 (+   210us) log.cc:844] Serialized 49 byte log entry
0709 13:19:14.777857 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:14.777951 (+    94us) write_op.cc:454] Released schema lock
0709 13:19:14.777999 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:14.783164 (+  5165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:14.809597 (+ 26433us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":610270,"reported_tablets":30,"spinlock_wait_cycles":360264064,"child_traces":[["op",{"apply.queue_time_us":80390,"apply.run_cpu_time_us":7675,"apply.run_wall_time_us":69813,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":297045,"prepare.run_cpu_time_us":8216,"prepare.run_wall_time_us":117071,"raft.queue_time_us":50377,"raft.run_cpu_time_us":2433,"raft.run_wall_time_us":22721,"replication_time_us":217682,"spinlock_wait_cycles":9080576,"thread_start_us":255212,"threads_started":4,"wal-append.queue_time_us":114955}]]}
I20260709 13:19:14.997085 17549 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:15.000702 17533 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:14.992013 17356 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.044106 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:15.051481 10114 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 25.
I20260709 13:19:15.008312 17506 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.041100 17533 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.037200 17163 consensus_queue.cc:237] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.053016 16739 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.010352 17584 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.084699 16739 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:15.089203 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 72581.8us
I20260709 13:19:15.094071 10682 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:15.104956 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 82823.3us
I20260709 13:19:15.117599 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:15.118279 10180 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:15.114457 10682 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:19:15.123654 17617 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.124235 17617 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:15.126082 17613 log.cc:927] Time spent T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:15.126403 17617 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.130716 17273 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.134445 17273 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:15.152119 10181 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:19:15.156493 17612 log.cc:927] Time spent T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:19:15.157366 17584 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:15.158250 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:15.158816 10114 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:19:15.170466 17506 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.115496 17626 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:19:15.180830 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 173801us
I20260709 13:19:15.186715 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:15.171643 17531 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563) with higher term. Message: Invalid argument: T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 23. Current term is 24.
I20260709 13:19:15.190672 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:15.193475 10114 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 27.
I20260709 13:19:15.196074 10180 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 27.
I20260709 13:19:15.184195 17626 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.207293 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:15.208797 10109 raft_consensus.cc:3060] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:15.208000 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.210959 10003 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:15.212909 16739 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:15.213356 16739 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 27 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:15.213871 10180 raft_consensus.cc:2393] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:15.214099 16739 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:15.216610 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 204969us
I20260709 13:19:15.218693 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.219416 10181 raft_consensus.cc:2368] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 26. Current term is 27.
I20260709 13:19:15.223150 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.223812 10181 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:15.226994 10078 leader_election.cc:400] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 26. Current term is 27.
I20260709 13:19:15.227398 10078 leader_election.cc:403] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:15.209759 17626 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.228327 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.230522 10180 raft_consensus.cc:1275] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:15.230621 17629 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:15.231154 17629 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.231500 17629 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.236038 17626 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.237959 10711 raft_consensus.cc:2368] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:19:15.237993 17616 consensus_queue.cc:1048] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:15.239959 10153 leader_election.cc:400] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
I20260709 13:19:15.240231 10153 leader_election.cc:403] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:15.241998 17626 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.254568 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:15.255225 10182 raft_consensus.cc:3060] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.215538 17506 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:19:15.263489 10182 raft_consensus.cc:2468] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:15.228055 17617 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091) with higher term. Message: Invalid argument: T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 for earlier term 26. Current term is 27.
I20260709 13:19:15.262296 17615 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.275640 10109 raft_consensus.cc:2468] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 26.
I20260709 13:19:15.264746 17356 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.279294 10679 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:15.271104 17614 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001) with higher term. Message: Invalid argument: T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for earlier term 20. Current term is 21.
W20260709 13:19:15.306738 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 195614us
I20260709 13:19:15.303056 17488 raft_consensus.cc:2804] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:19:15.319564 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 118495us
W20260709 13:19:15.329883 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 44336.1us
W20260709 13:19:15.339985 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 67140.1us
I20260709 13:19:15.292145 17615 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.338569 17488 raft_consensus.cc:697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:15.387463 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:15.390259 16739 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:15.338514 17533 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:15.391016 16739 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.379237 17633 raft_consensus.cc:493] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:15.386888 17409 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.407912 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 194403us
W20260709 13:19:15.396731 17601 log.cc:927] Time spent T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:19:15.411376 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 124901us
I20260709 13:19:15.427894 16739 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:15.430536 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68705.8us
I20260709 13:19:15.435649 10153 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.425099 17488 consensus_queue.cc:237] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.445111 17533 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563)
I20260709 13:19:15.444909 17629 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.446362 17642 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:15.446878 17642 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.448971 17642 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:15.450762 10110 raft_consensus.cc:2368] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:15.452595 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:15.452634 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:15.412243 17409 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:15.461520 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65166.7us
W20260709 13:19:15.462185 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 47454.1us
I20260709 13:19:15.410044 17633 raft_consensus.cc:515] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.483269 10112 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:15.455942 17533 raft_consensus.cc:2804] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:15.455200 17629 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.488624 10111 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
W20260709 13:19:15.476015 10081 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.495839 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.496066 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:15.496604 10181 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:15.499255 10111 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:15.505400 10711 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:15.527107 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34831254ce7143c8bf6fa684a958c7dc" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:15.527768 10185 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.507433 17533 raft_consensus.cc:697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 26 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:19:15.536048 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.535471 10185 raft_consensus.cc:2468] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:15.539968 17409 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.520087 17449 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:15.542135 17449 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.516090 17273 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.544169 17449 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.544485 17273 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.546855 17273 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:15.547932 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:15.537760 17635 log.cc:927] Time spent T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 13:19:15.549369 10112 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:15.559185 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:15.561591 10081 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.572425 17533 consensus_queue.cc:237] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.589002 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.589831 10180 raft_consensus.cc:2393] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 20: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
W20260709 13:19:15.594203 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.600060 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 69453.6us
I20260709 13:19:15.604578 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.605295 10180 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 17.
W20260709 13:19:15.605424 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.614130 17633 leader_election.cc:290] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:15.618115 17549 consensus_meta.cc:287] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:19:15.571558 17615 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:15.622304 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.638262 10682 leader_election.cc:336] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:15.639257 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.606114 10078 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.642541 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.643596 17453 raft_consensus.cc:2804] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:15.644235 17453 raft_consensus.cc:697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:15.645138 17453 consensus_queue.cc:237] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.647944 17356 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:15.648437 17356 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.648761 17356 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:15.660192 10180 raft_consensus.cc:1275] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:15.665537 17629 consensus_queue.cc:1048] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:15.673393 17549 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.682041 10112 raft_consensus.cc:2410] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:19:15.688037 17549 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.691056 17356 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:15.698062 17356 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:15.728827 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:19:15.744594 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.745814 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.746709 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.747646 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.748447 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.748268 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 63550.9us
I20260709 13:19:15.758562 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:15.749405 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.776526 17633 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.778230 17535 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:15.777962 17633 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
I20260709 13:19:15.778796 17535 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:15.779405 17535 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:15.793720 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.795264 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.777187 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:15.796823 10188 raft_consensus.cc:2393] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 18: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:15.800436 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:15.806622 10181 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:19:15.825137 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.845299 17633 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:15.817902 10081 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.860021 17512 raft_consensus.cc:493] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:15.860952 17512 raft_consensus.cc:515] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.865552 17512 leader_election.cc:290] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:15.878160 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050435abbd194f2ea45db6d7a8974831" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:15.886296 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 101401us
W20260709 13:19:15.910924 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.932057 10153 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.933465 17521 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:15.934568 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.936088 17521 raft_consensus.cc:697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:15.937256 17619 raft_consensus.cc:493] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
W20260709 13:19:15.937966 10081 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.937575 17521 consensus_queue.cc:237] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:19:15.940042 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.943761 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:15.945297 17533 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:15.917306 17408 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.952648 17408 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:15.956130 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.959081 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.960427 10181 raft_consensus.cc:2468] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:15.961156 17619 raft_consensus.cc:515] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.963106 17632 raft_consensus.cc:2764] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:19:15.964732 17506 raft_consensus.cc:493] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:15.965507 17506 raft_consensus.cc:515] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.968575 17633 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:15.969448 17633 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:15.945739 17533 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.974150 17533 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.984210 17506 leader_election.cc:290] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.004433 17633 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:15.963572 17619 leader_election.cc:290] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.005599 17535 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.008083 17535 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Requested vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:16.017575 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 49347.6us
I20260709 13:19:16.042594 17408 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.036147 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.050838 17506 raft_consensus.cc:493] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:16.037554 17619 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:16.056952 10109 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 20.
W20260709 13:19:16.066697 10682 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.067304 10081 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.070485 10081 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:16.074447 17657 raft_consensus.cc:493] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:16.082727 17657 raft_consensus.cc:515] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.085309 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.086489 10189 raft_consensus.cc:2410] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:19:16.086658 17619 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.089039 17619 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.071667 17506 raft_consensus.cc:515] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.085744 17657 leader_election.cc:290] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.102223 17652 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:16.104323 17652 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.099771 10078 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:16.109392 17549 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:16.127664 17640 raft_consensus.cc:493] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:16.128580 17640 raft_consensus.cc:515] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:16.148453 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 85092us
I20260709 13:19:16.160713 17535 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:16.161487 17535 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.162995 10112 raft_consensus.cc:1275] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:19:16.165751 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 130898us
I20260709 13:19:16.165969 17356 raft_consensus.cc:2804] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:16.170171 10189 raft_consensus.cc:1275] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:16.171049 17615 consensus_queue.cc:1048] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:19:16.172501 10181 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:19:16.181804 17506 leader_election.cc:290] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.189249 17535 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.193455 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.131901 17640 leader_election.cc:290] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.201089 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.205439 17651 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:16.205852 10081 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.198371 17356 raft_consensus.cc:697] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
W20260709 13:19:16.205358 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 100496us
I20260709 13:19:16.213496 10679 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:16.225950 17356 consensus_queue.cc:237] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.218658 17652 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.232441 17651 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.240849 17163 consensus_queue.cc:1048] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:19:16.245570 17305 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:16.249511 17651 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.252815 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.253705 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:16.263149 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 94869.3us
I20260709 13:19:16.231361 17640 raft_consensus.cc:493] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:16.254046 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:16.264410 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.267274 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.277753 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.278594 17533 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.279551 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.280414 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.280958 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.281140 10112 raft_consensus.cc:2468] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 21.
I20260709 13:19:16.283398 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.285372 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:16.286877 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 48093.6us
W20260709 13:19:16.287773 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 80462.6us
W20260709 13:19:16.294690 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.307456 10182 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 17.
I20260709 13:19:16.291178 17506 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:19:16.264357 17640 raft_consensus.cc:515] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.319633 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.320037 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a32b1065fb4ad3a7f2a86329f56464" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:16.333182 17533 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:16.358820 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.361757 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:16.366253 10112 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.370038 10110 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:19:16.370637 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970bd90924ef4157a7c0b99fe31e7fcb" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.371956 17453 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.372502 17453 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:16.377193 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 86561.6us
I20260709 13:19:16.377028 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085543d3b9b94f2d806b9cd16489951a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:16.379449 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31abbd8853749ac891b56f5989949b0" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:16.381867 17640 leader_election.cc:290] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.390841 17453 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.391067 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.395496 10182 raft_consensus.cc:1275] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:16.407428 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:16.412860 10081 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.418434 10110 raft_consensus.cc:1275] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:16.421643 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:16.416242 10081 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:16.423775 10711 raft_consensus.cc:2393] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 17: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:16.421725 10003 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:16.447104 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b36c20170946939b59a55932ff2f8d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.449312 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a6af7e1c84c848d5ae312ca4c3eb8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.454367 17651 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:16.457818 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f43d8e966541cf899abeeacbe8ff29" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.412388 17305 consensus_queue.cc:1048] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:19:16.461658 17652 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.462371 17652 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.464061 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9339757002c64268bb483f1a5bfe0ccf" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:16.444718 17163 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:16.468511 17651 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:16.476603 17651 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.508949 17535 raft_consensus.cc:493] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:16.509701 17535 raft_consensus.cc:515] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.512161 17535 leader_election.cc:290] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.541438 10112 raft_consensus.cc:2468] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 21.
I20260709 13:19:16.560982 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:16.571234 17671 log.cc:927] Time spent T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:19:16.592622 17657 raft_consensus.cc:493] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:16.593434 17657 raft_consensus.cc:515] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.597424 17639 raft_consensus.cc:493] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:16.598330 17639 raft_consensus.cc:515] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.616762 17535 raft_consensus.cc:493] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:16.617483 17535 raft_consensus.cc:515] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.619628 17632 consensus_queue.cc:1048] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:19:16.622001 17640 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:16.558640 17619 raft_consensus.cc:493] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:16.633088 10153 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:16.634351 17615 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:16.634924 17615 raft_consensus.cc:697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:16.635918 17615 consensus_queue.cc:237] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.632917 17619 raft_consensus.cc:515] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.639290 17652 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.603981 17633 raft_consensus.cc:493] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:16.640266 17633 raft_consensus.cc:515] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.640887 17619 leader_election.cc:290] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.642395 17633 leader_election.cc:290] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:16.649945 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.655833 10181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.666102 10181 raft_consensus.cc:2393] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:16.666373 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e77e3a0687c460f8d3f29e5194c49e9" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:16.665786 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44897.8us
I20260709 13:19:16.669661 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.667233 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e1f2cc55034d12aba959a49530a6f8" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:16.647346 17657 leader_election.cc:290] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.662932 17535 leader_election.cc:290] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.695909 10004 leader_election.cc:400] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
I20260709 13:19:16.696239 10004 leader_election.cc:403] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:16.697273 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 265682us
I20260709 13:19:16.704344 17639 leader_election.cc:290] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:16.708300 10183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:16.751395 17677 log.cc:927] Time spent T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
W20260709 13:19:16.776646 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 107337us
I20260709 13:19:16.778990 10004 leader_election.cc:304] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:16.777369 17640 raft_consensus.cc:3060] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.792191  9934 catalog_manager.cc:5697] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 18 to 21, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:16.794060  9934 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.781414 17633 raft_consensus.cc:493] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.798164 17633 raft_consensus.cc:515] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.793931 17163 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.800537 17163 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:16.779556 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.800463 17633 leader_election.cc:290] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:16.807498 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51746.9us
I20260709 13:19:16.797327  9938 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 202) took 2400 ms. Trace:
W20260709 13:19:16.861382 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.832194 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:16.836596 17163 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.860698  9938 rpcz_store.cc:276] 0709 13:19:14.397252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.397422 (+   170us) service_pool.cc:224] Handling call
0709 13:19:16.797124 (+2399702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:15.202592 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:15.241118 (+ 38526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:15.241157 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:19:15.241170 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:15.242196 (+  1026us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:15.242250 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:15.242280 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:15.243188 (+   908us) tablet.cc:701] Row locks acquired
0709 13:19:15.243207 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:15.243356 (+   149us) write_op.cc:270] Start()
0709 13:19:15.243476 (+   120us) write_op.cc:276] Timestamp: P: 1783603155243306 usec, L: 0
0709 13:19:15.243498 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:15.283693 (+ 40195us) log.cc:844] Serialized 4426 byte log entry
0709 13:19:15.585793 (+302100us) op_driver.cc:464] REPLICATION: finished
0709 13:19:15.826486 (+240693us) write_op.cc:301] APPLY: starting
0709 13:19:15.826697 (+   211us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:15.998093 (+171396us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:15.998248 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:16.268003 (+269755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:16.268344 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:19:16.268402 (+    58us) write_op.cc:312] APPLY: finished
0709 13:19:16.268871 (+   469us) log.cc:844] Serialized 105 byte log entry
0709 13:19:16.312866 (+ 43995us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.339541 (+ 26675us) write_op.cc:454] Released schema lock
0709 13:19:16.339612 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:16.369426 (+ 29814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.369457 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14024,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":240115,"apply.run_cpu_time_us":21408,"apply.run_wall_time_us":537784,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50041,"num_ops":11,"prepare.queue_time_us":170546,"prepare.run_cpu_time_us":4436,"prepare.run_wall_time_us":118488,"replication_time_us":342110,"spinlock_wait_cycles":1920,"thread_start_us":207288,"threads_started":2}]]}
I20260709 13:19:16.869165 17639 raft_consensus.cc:2749] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:16.810640  9934 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 21 to 23, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 23 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.870375 10155 leader_election.cc:336] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.876237 10081 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.878911 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 99997.1us
I20260709 13:19:16.880187  9934 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:16.882244  9934 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 21 to 23, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 23 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.885658 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:16.885543 17633 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.957010 17631 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:16.957649 17631 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:16.960167 17619 raft_consensus.cc:2804] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:16.960621 17619 raft_consensus.cc:493] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:16.961026 17619 raft_consensus.cc:3060] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:16.962721 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.967010 10155 leader_election.cc:336] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.964501 17640 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119) with higher term. Message: Invalid argument: T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a67604b91f54791b1316fd327793337 for earlier term 20. Current term is 21.
W20260709 13:19:16.968866 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.974715 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 89155.6us
I20260709 13:19:16.975517 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23; no voters: f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:16.970762 17630 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:16.993739 17630 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:16.997668 17640 raft_consensus.cc:2804] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:16.998184 17640 raft_consensus.cc:493] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.998548 17640 raft_consensus.cc:3060] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.004148 10182 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:16.952824 17633 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.009231 17681 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:17.010778 17633 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:16.972385  9934 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 17 to 18, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.012894 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.013666 10187 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:17.015223 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:17.016207 17633 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:17.016594 17633 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.016914 17633 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.022451 17408 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:17.023087 17408 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.025098 17631 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.031772 17626 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:17.032665 17630 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.032469 17626 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.034626 17619 raft_consensus.cc:515] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.039300 17619 leader_election.cc:290] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.039963 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.053453 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:17.043365 10112 raft_consensus.cc:1275] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:17.056294 17632 consensus_queue.cc:1048] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:19:17.044329 10081 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.045660  9934 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 16 to 18, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:17.059446 10682 leader_election.cc:336] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.047860 10680 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.186.254:36577, user_credentials={real_user=slave}} blocked reactor thread for 63491.4us
I20260709 13:19:17.059180  9934 catalog_manager.cc:5697] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 reported cstate change: term changed from 14 to 16, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 16 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:19:17.064291 10682 leader_election.cc:336] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.037320 17626 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.072175 10682 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.073060 17626 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:17.082818 10081 leader_election.cc:336] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.093434 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.094162 10711 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 25.
I20260709 13:19:17.102151 10079 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:19:17.108244 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 141263us
W20260709 13:19:17.109068 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.112766 17657 raft_consensus.cc:493] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.113066 17633 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.113543 17657 raft_consensus.cc:515] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.115597 17633 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.117908 17657 leader_election.cc:290] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.117807 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:17.118661 10180 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.118778 17640 raft_consensus.cc:515] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } }
W20260709 13:19:17.120630 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 143596us
I20260709 13:19:17.124680 10004 leader_election.cc:304] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.127816 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.128808 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.131495 10180 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:17.132727 17535 raft_consensus.cc:2749] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.132911 10003 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:17.136487 10004 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.140481 17651 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:17.141108 17651 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Becoming Leader. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:17.130048 17163 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:17.142452 17163 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:17.142130 17651 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.147516 17535 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.135828 17633 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 13:19:17.149032 10004 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.150264 10004 leader_election.cc:304] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.151149 17535 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:17.151927 17535 raft_consensus.cc:2749] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:17.153162 10004 leader_election.cc:304] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.154557 10004 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.158257 10109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.142831 17163 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.173391 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.176359 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.180092 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2597dc9899784d6eb96b916d235dc5b2" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.184954 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db964eeed76452cb3a8a969e5e2b32a" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.156262 17657 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.181716 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe760ac48e44c2d9fce1d214088eb0e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.188160 10182 raft_consensus.cc:1275] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:17.174602 17535 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.174335 17633 raft_consensus.cc:2749] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.194229 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.198756 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.199004 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d5d93de0b049d0b905d6e491783021" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.196311 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.202221 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d1dcb93ee43aeb594457df0185659" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.206947 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2bb95bebdf4e86b0b5a76ee511bbee" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.190129 17408 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:17.231420 10716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fa3c9e8a7a496eaa49ec78b5a92103" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.232395 10711 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:17.230108 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57d4d09773c44b6b5b6a6c1002cf19f" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.230290 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.235152 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ab28ea212034df2acdf22eab1b39bdd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.237876 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a2fe5619be481399904909f88ce441" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.239871 10108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.240530 10108 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 18.
I20260709 13:19:17.247021 10115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6c3346fb334d2cbbcdfc623a3e64dc" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:17.257542 17633 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:17.258208 17633 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.262377 17633 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.263008 17640 leader_election.cc:290] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.267227 17681 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:17.267411 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:17.268131 10110 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.269093 17651 raft_consensus.cc:493] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:17.269709 17651 raft_consensus.cc:515] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.284546 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:17.285392 10004 leader_election.cc:304] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.286901 10004 leader_election.cc:304] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.279023 17681 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.289001 17619 raft_consensus.cc:2749] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.290832 17619 raft_consensus.cc:2749] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.292009 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.297796 17651 leader_election.cc:290] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.299201 17681 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.300093 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.281359 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.312057 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:17.342607 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 55775.9us
I20260709 13:19:17.343441 10004 leader_election.cc:304] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.328075 17630 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.313133 17631 consensus_queue.cc:1048] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:19:17.350915 17535 raft_consensus.cc:2749] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.334426 17163 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.357061 10109 raft_consensus.cc:2393] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f672b54d4754c5aa62b5b919597a14e in current term 26: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:17.358193 17163 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.359665 10107 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:17.362560 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.370851 10004 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.364902 17610 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.379899 17639 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.382442 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:17.389726 10004 leader_election.cc:304] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:17.389631 10081 leader_election.cc:336] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.396981 17535 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.397650 17535 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.396844 17356 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:17.400961 17633 raft_consensus.cc:2749] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.402763 10081 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:17.404551 17356 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.408619 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.412824 10004 leader_election.cc:304] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.422633 10110 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a67604b91f54791b1316fd327793337 in term 19.
I20260709 13:19:17.424834 17639 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:17.403019 17535 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:17.429036 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 100085us
I20260709 13:19:17.440121 17631 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:17.440691 17631 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.442761 17631 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.443238 17631 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:17.463966 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.445649 17549 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:17.467713 17549 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.470327 17549 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.473639 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.474833 17610 raft_consensus.cc:2749] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.475646 17657 raft_consensus.cc:2749] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.491021 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7c959dd43740e0922779387d4a3046" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:17.492717 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.494274 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f53253de3345159399b6816804e1e6" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.497231 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a137ce092c4e1f93e053d05a21cb5c" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
W20260709 13:19:17.493074 10081 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.498795 10081 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.500756 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.505646 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4197bea6d247b289e63500fc5bc56e" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.506958 17561 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.486714 17631 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.510795 17631 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:17.516526 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 85856.2us
I20260709 13:19:17.520617 10713 raft_consensus.cc:1240] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Rejecting Update request from peer 9a67604b91f54791b1316fd327793337 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:17.525113 10004 leader_election.cc:304] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.525882 17535 raft_consensus.cc:493] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2f672b54d4754c5aa62b5b919597a14e)
I20260709 13:19:17.526269 10004 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.526433 17535 raft_consensus.cc:515] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:17.527408 10004 leader_election.cc:304] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.528112 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400d1a1ff7f24369b1d869661f6a2640" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.528481 10004 leader_election.cc:304] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:17.532502 10081 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.532858 17657 raft_consensus.cc:2749] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.533772 17697 raft_consensus.cc:3060] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.534713 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.540263 17652 raft_consensus.cc:2749] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.539198 17631 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.542054 10004 leader_election.cc:304] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.542866 17652 raft_consensus.cc:2749] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.544034 10004 leader_election.cc:304] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.544764 17657 raft_consensus.cc:2749] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.545977 10004 leader_election.cc:304] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.546783 17657 raft_consensus.cc:2749] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.548465 10004 leader_election.cc:304] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.549800 17657 raft_consensus.cc:2749] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.551658 10004 leader_election.cc:304] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.552564 17657 raft_consensus.cc:2749] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.555856 17657 consensus_queue.cc:1059] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:19:17.556963 17652 raft_consensus.cc:3055] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:17.557322 17652 raft_consensus.cc:740] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9a67604b91f54791b1316fd327793337, State: Running, Role: LEADER
I20260709 13:19:17.558099 17652 consensus_queue.cc:260] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:17.558876 10081 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.559268 17652 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:17.543929 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.560262 10155 leader_election.cc:336] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.561105 10155 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.561954 10155 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.562273 10155 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.562597 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:17.563352 10155 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.564393 17685 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.562487 17535 leader_election.cc:290] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:17.567065 17696 raft_consensus.cc:2749] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:17.571907 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 52040.9us
I20260709 13:19:17.578411 17697 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.588336 10004 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.589178 17696 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:17.566449 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.591557 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.589563 10004 leader_election.cc:304] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.599195 17696 raft_consensus.cc:2749] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.603986 10004 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.607504 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.608319 17696 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.613186 10107 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:17.615496 10711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbda83574ee42f494a2a55e59683596" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:17.632054 10004 leader_election.cc:304] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.632850 17696 raft_consensus.cc:2749] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.635063 10004 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:17.643623 17696 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.646447 10004 leader_election.cc:304] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5
W20260709 13:19:17.653470 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:17.672416 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:17.672641 17696 raft_consensus.cc:2749] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.673846 17163 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.689014 17696 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:17.692291 10184 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer 9a67604b91f54791b1316fd327793337: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:17.694075 17697 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:17.713241 10155 leader_election.cc:336] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.714251 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.724740 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.730134  9935 catalog_manager.cc:5697] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 25 to 29, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 29 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.734972  9935 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 19 to 22, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 22 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.746407  9934 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46600 (request call id 300) took 7775 ms. Trace:
I20260709 13:19:17.751592  9934 rpcz_store.cc:276] 0709 13:19:09.992406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.020297 (+ 27891us) service_pool.cc:224] Handling call
0709 13:19:10.125328 (+105031us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b540024a9d4. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c6f452090 00007f3c6f4f0f3a 00007f3c752a71cc 00007f3c753a537e 00007f3c738662a4 00007f3c73866232 00007f3c73866161 00007f3c738660dc 00007f3c73865392 00007f3c6d82348c 00007f3c6d8228c6
0709 13:19:17.746324 (+7620996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:17.266389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:17.267057 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:17.267109 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:19:17.267126 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:17.268080 (+   954us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:17.268179 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:17.268205 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:19:17.299134 (+ 30929us) tablet.cc:701] Row locks acquired
0709 13:19:17.299180 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:19:17.299459 (+   279us) write_op.cc:270] Start()
0709 13:19:17.304027 (+  4568us) write_op.cc:276] Timestamp: P: 1783603157299380 usec, L: 0
0709 13:19:17.304052 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:17.314996 (+ 10944us) log.cc:844] Serialized 3258 byte log entry
0709 13:19:17.519479 (+204483us) op_driver.cc:464] REPLICATION: finished
0709 13:19:17.582043 (+ 62564us) write_op.cc:301] APPLY: starting
0709 13:19:17.582133 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:17.586886 (+  4753us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:17.586974 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:17.636750 (+ 49776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:17.636991 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:19:17.637037 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:17.637306 (+   269us) log.cc:844] Serialized 81 byte log entry
0709 13:19:17.647186 (+  9880us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.647324 (+   138us) write_op.cc:454] Released schema lock
0709 13:19:17.647382 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:17.672017 (+ 24635us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.672048 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128528,"reported_tablets":37,"spinlock_wait_cycles":51998976,"child_traces":[["op",{"apply.queue_time_us":62295,"apply.run_cpu_time_us":11426,"apply.run_wall_time_us":89942,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":124552,"prepare.run_cpu_time_us":22844,"prepare.run_wall_time_us":113841,"raft.queue_time_us":107266,"raft.run_cpu_time_us":9968,"raft.run_wall_time_us":32606,"replication_time_us":215256,"thread_start_us":246393,"threads_started":4,"wal-append.queue_time_us":78709}]]}
I20260709 13:19:17.749935  9935 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.755635  9935 catalog_manager.cc:5697] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 16 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:17.758383  9935 catalog_manager.cc:5697] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 13 to 14, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 14 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.776510  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:17.778483  8939 tablet_replica.cc:333] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.781107  8939 raft_consensus.cc:2243] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.781888  8939 raft_consensus.cc:2272] T b4a137ce092c4e1f93e053d05a21cb5c P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.785136  8939 tablet_replica.cc:333] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.786099  8939 raft_consensus.cc:2243] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.786687  8939 raft_consensus.cc:2272] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.780055  9935 catalog_manager.cc:5697] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:17.789469  8939 tablet_replica.cc:333] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.791752  9935 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:19:17.800282 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:17.801882  8939 raft_consensus.cc:2243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.805214  8939 raft_consensus.cc:2272] T 3c6c3346fb334d2cbbcdfc623a3e64dc P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.811775  8939 tablet_replica.cc:333] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.812636  8939 raft_consensus.cc:2243] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.828058  8939 raft_consensus.cc:2272] T 6e77e3a0687c460f8d3f29e5194c49e9 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.831053  8939 tablet_replica.cc:333] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.848614  8939 raft_consensus.cc:2243] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.849287  8939 raft_consensus.cc:2272] T 49f43d8e966541cf899abeeacbe8ff29 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.859330  8939 tablet_replica.cc:333] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.860170  8939 raft_consensus.cc:2243] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.861320  8939 raft_consensus.cc:2272] T 5fbda83574ee42f494a2a55e59683596 P 9a67604b91f54791b1316fd327793337 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.864248  8939 tablet_replica.cc:333] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.865015  8939 raft_consensus.cc:2243] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.866165  8939 raft_consensus.cc:2272] T a9fbf8d873bf4f76894423df3dee3e74 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.885711 17652 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.886487 17652 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:17.889107 17652 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:17.896999  8939 tablet_replica.cc:333] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.897975  8939 raft_consensus.cc:2243] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.898577  8939 raft_consensus.cc:2272] T 63d5d93de0b049d0b905d6e491783021 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.898862 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:17.900599 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10bea19d11e44342889595040e4d97bd" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:17.901528  8939 tablet_replica.cc:333] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.902426  8939 raft_consensus.cc:2243] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.928236  8939 raft_consensus.cc:2272] T fefbaaae9f26463bb73383d72660a7a1 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.931133  8939 tablet_replica.cc:333] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.931947  8939 raft_consensus.cc:2243] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.932453  8939 raft_consensus.cc:2272] T 970bd90924ef4157a7c0b99fe31e7fcb P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.935101  8939 tablet_replica.cc:333] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337: stopping tablet replica
W20260709 13:19:17.945760 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:17.959947  8939 raft_consensus.cc:2243] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.960556  8939 raft_consensus.cc:2272] T 342754e0259d4d1197a5da7433555a8b P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.963351  8939 tablet_replica.cc:333] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.964121  8939 raft_consensus.cc:2243] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.965130  8939 raft_consensus.cc:2272] T 230ae7ec0d4d46b88977591c29ce761b P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.972672  8939 tablet_replica.cc:333] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.973543  8939 raft_consensus.cc:2243] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.974493  8939 raft_consensus.cc:2272] T 6d3c204de67641b8a897fd3a314bf8ea P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.977073  8939 tablet_replica.cc:333] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:17.994123 10004 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:17.995223 10004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 43519.5us
I20260709 13:19:17.977805  8939 raft_consensus.cc:2243] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.996608  8939 raft_consensus.cc:2272] T 050435abbd194f2ea45db6d7a8974831 P 9a67604b91f54791b1316fd327793337 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.997704 17697 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.999258  8939 tablet_replica.cc:333] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.000278  8939 raft_consensus.cc:2243] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.000913  8939 raft_consensus.cc:2272] T f9a32b1065fb4ad3a7f2a86329f56464 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.004070  8939 tablet_replica.cc:333] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.004863  8939 raft_consensus.cc:2243] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.005417  8939 raft_consensus.cc:2272] T 2597dc9899784d6eb96b916d235dc5b2 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.019670  8939 tablet_replica.cc:333] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.020576  8939 raft_consensus.cc:2243] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.021564  8939 raft_consensus.cc:2272] T 0be325f96e974db28d904978cd65157d P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.029736  8939 tablet_replica.cc:333] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.031652  8939 raft_consensus.cc:2243] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.040306  8939 raft_consensus.cc:2272] T d5b36c20170946939b59a55932ff2f8d P 9a67604b91f54791b1316fd327793337 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:18.041872 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.050181 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.043267  8939 tablet_replica.cc:333] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.052407  8939 raft_consensus.cc:2243] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.080917  9933 catalog_manager.cc:5697] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.082837  9933 catalog_manager.cc:5697] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 14 to 15, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 15 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:18.088774  9933 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 18 to 20, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 20 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:18.091674  9933 catalog_manager.cc:5697] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.093123  9933 catalog_manager.cc:5697] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.086895  9935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46608 (request call id 299) took 4752 ms. Trace:
I20260709 13:19:18.094112  9935 rpcz_store.cc:276] 0709 13:19:13.334047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.337741 (+  3694us) service_pool.cc:224] Handling call
0709 13:19:18.043309 (+4705568us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.043338 (+    29us) write_op.cc:454] Released schema lock
0709 13:19:18.086834 (+ 43496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:17.825547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:17.826098 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:17.826133 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:19:17.826150 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:17.826924 (+   774us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:17.826978 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:17.827004 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:17.827548 (+   544us) tablet.cc:701] Row locks acquired
0709 13:19:17.827569 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:17.827707 (+   138us) write_op.cc:270] Start()
0709 13:19:17.827847 (+   140us) write_op.cc:276] Timestamp: P: 1783603157827661 usec, L: 0
0709 13:19:17.827871 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:19:17.828577 (+   706us) log.cc:844] Serialized 2865 byte log entry
0709 13:19:17.836547 (+  7970us) op_driver.cc:464] REPLICATION: finished
0709 13:19:17.838910 (+  2363us) write_op.cc:301] APPLY: starting
0709 13:19:17.838997 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:17.842853 (+  3856us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:17.842947 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:17.846847 (+  3900us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:17.847028 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:19:17.847073 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:17.847334 (+   261us) log.cc:844] Serialized 73 byte log entry
0709 13:19:17.859890 (+ 12556us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.860012 (+   122us) write_op.cc:454] Released schema lock
0709 13:19:17.860059 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:17.878189 (+ 18130us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b540024a828. stack: 00007f3c6c3c9343 00007f3c6c3c9240 00007f3c6bd581d4 00007f3c75a96304 00007f3c75a96299 00007f3c758a49e1 00007f3c758a364c 00007f3c72f343fd 00007f3c72f20389 00007f3c72f1fb53 00007f3c72f23d61 00007f3c72f23d19 00007f3c72f23ca9 00007f3c72f23c71 00007f3c72f22e9d 000000000038f354
Metrics: {"mutex_wait_us":46434,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":2126,"apply.run_cpu_time_us":11479,"apply.run_wall_time_us":39642,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29218,"num_ops":7,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":3402,"prepare.run_wall_time_us":10895,"replication_time_us":8527,"spinlock_wait_cycles":26982528}]]}
W20260709 13:19:18.103564 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.100409  9933 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:18.104664  8939 raft_consensus.cc:2272] T 400d1a1ff7f24369b1d869661f6a2640 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.104882  9933 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 21 to 23, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 23 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:18.106388  9933 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index 12 to 13, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.108810  9933 catalog_manager.cc:5697] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 21 to 23, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 23 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.110422  9933 catalog_manager.cc:5697] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.111871  9933 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 17 to 18, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 18 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:18.129141  8939 tablet_replica.cc:333] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.130460  8939 raft_consensus.cc:2243] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.145648  8939 raft_consensus.cc:2272] T a31abbd8853749ac891b56f5989949b0 P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:18.145963 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.153921 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.160567 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.161195 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.174305  8939 tablet_replica.cc:333] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.175315  8939 raft_consensus.cc:2243] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.176029  8939 raft_consensus.cc:2272] T 085543d3b9b94f2d806b9cd16489951a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.184247  9938 catalog_manager.cc:5697] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.191583 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.194543  8939 tablet_replica.cc:333] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.218042  9935 catalog_manager.cc:5697] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 24 to 26, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 26 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.223199  8939 raft_consensus.cc:2243] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.224123  8939 raft_consensus.cc:2272] T 4fe760ac48e44c2d9fce1d214088eb0e P 9a67604b91f54791b1316fd327793337 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.232425  9935 catalog_manager.cc:5697] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 20 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.234753  9935 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 17 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 21 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
W20260709 13:19:18.236899 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.237732 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.244841  9938 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50970 (request call id 203) took 1062 ms. Trace:
I20260709 13:19:18.248160  9933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46604 (request call id 304) took 2007 ms. Trace:
I20260709 13:19:18.237116  9935 catalog_manager.cc:5697] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 19 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 21 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.255070  9935 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 23 to 27, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 27 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:18.257309  8939 tablet_replica.cc:333] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.263350  8939 raft_consensus.cc:2243] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.248817  9938 rpcz_store.cc:276] 0709 13:19:17.182275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.188068 (+  5793us) service_pool.cc:224] Handling call
0709 13:19:18.207976 (+1019908us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.208005 (+    29us) write_op.cc:454] Released schema lock
0709 13:19:18.244726 (+ 36721us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:18.198403 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:18.198901 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:18.198942 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:19:18.198960 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:18.199295 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:18.199349 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:18.199381 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:18.199566 (+   185us) tablet.cc:701] Row locks acquired
0709 13:19:18.199582 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:19:18.199735 (+   153us) write_op.cc:270] Start()
0709 13:19:18.200070 (+   335us) write_op.cc:276] Timestamp: P: 1783603158199689 usec, L: 0
0709 13:19:18.200091 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.200713 (+   622us) log.cc:844] Serialized 536 byte log entry
0709 13:19:18.202890 (+  2177us) op_driver.cc:464] REPLICATION: finished
0709 13:19:18.203354 (+   464us) write_op.cc:301] APPLY: starting
0709 13:19:18.203440 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:18.204425 (+   985us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:18.204520 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:18.205215 (+   695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:18.205391 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:19:18.205434 (+    43us) write_op.cc:312] APPLY: finished
0709 13:19:18.205610 (+   176us) log.cc:844] Serialized 25 byte log entry
0709 13:19:18.205760 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.205847 (+    87us) write_op.cc:454] Released schema lock
0709 13:19:18.205900 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":17097,"reported_tablets":14,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":2853,"apply.run_wall_time_us":2853,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":2412,"prepare.run_wall_time_us":2601,"replication_time_us":2689}]]}
I20260709 13:19:18.251432  9933 rpcz_store.cc:276] 0709 13:19:16.240455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.240740 (+   285us) service_pool.cc:224] Handling call
0709 13:19:18.248092 (+2007352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:18.117997 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:18.118511 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:18.118545 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:18.118565 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:18.119538 (+   973us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:18.119599 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:18.119626 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:18.120552 (+   926us) tablet.cc:701] Row locks acquired
0709 13:19:18.120567 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:19:18.120713 (+   146us) write_op.cc:270] Start()
0709 13:19:18.120848 (+   135us) write_op.cc:276] Timestamp: P: 1783603158120664 usec, L: 0
0709 13:19:18.120870 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.121573 (+   703us) log.cc:844] Serialized 4466 byte log entry
0709 13:19:18.123990 (+  2417us) op_driver.cc:464] REPLICATION: finished
0709 13:19:18.124519 (+   529us) write_op.cc:301] APPLY: starting
0709 13:19:18.124608 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:18.131168 (+  6560us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:18.131272 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:18.146082 (+ 14810us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:18.146302 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:19:18.146344 (+    42us) write_op.cc:312] APPLY: finished
0709 13:19:18.146667 (+   323us) log.cc:844] Serialized 105 byte log entry
0709 13:19:18.163397 (+ 16730us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.163557 (+   160us) write_op.cc:454] Released schema lock
0709 13:19:18.163610 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:18.163966 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.163995 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5607,"reported_tablets":41,"spinlock_wait_cycles":9344,"child_traces":[["op",{"apply.queue_time_us":296,"apply.run_cpu_time_us":14884,"apply.run_wall_time_us":39423,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45914,"num_ops":11,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":3872,"prepare.run_wall_time_us":3872,"replication_time_us":2945}]]}
I20260709 13:19:18.265453  9935 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 16 to 17, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 17 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:18.278280 10107 consensus_queue.cc:237] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:18.285085  9935 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 14 to 19, leader changed from f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) to 9a67604b91f54791b1316fd327793337 (127.8.186.193). New cstate: current_term: 19 leader_uuid: "9a67604b91f54791b1316fd327793337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:18.289186  9935 catalog_manager.cc:5697] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } }
I20260709 13:19:18.264685  8939 raft_consensus.cc:2272] T d6e8de93fa794635a32ba4eb6cdc82ca P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.294477  8939 tablet_replica.cc:333] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.295370  8939 raft_consensus.cc:2243] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:19:18.348855 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:18.356029  8939 raft_consensus.cc:2272] T d739126ade124f87a06c44ebdd114d8b P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.367700  8939 tablet_replica.cc:333] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.376678  8939 raft_consensus.cc:2243] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.377393  8939 raft_consensus.cc:2272] T dc4197bea6d247b289e63500fc5bc56e P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.380558  8939 tablet_replica.cc:333] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.381366  8939 raft_consensus.cc:2243] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.382290  8939 raft_consensus.cc:2272] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:18.399978 10003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 57090.9us
I20260709 13:19:18.405225 10713 raft_consensus.cc:1275] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:18.417259 17561 consensus_queue.cc:1048] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:18.418948  8939 tablet_replica.cc:333] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.430687  8939 raft_consensus.cc:2243] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.431363  8939 raft_consensus.cc:2272] T 63a2fe5619be481399904909f88ce441 P 9a67604b91f54791b1316fd327793337 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.434379  8939 tablet_replica.cc:333] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.435159  8939 raft_consensus.cc:2243] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:18.445976 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.447811  8939 pending_rounds.cc:70] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Trying to abort 1 pending ops.
I20260709 13:19:18.450857  8939 pending_rounds.cc:77] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337: Aborting op as it isn't in flight: id { term: 17 index: 12 } timestamp: 7305638508484640768 op_type: NO_OP noop_request { }
I20260709 13:19:18.451327  8939 raft_consensus.cc:2889] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:18.451692  8939 raft_consensus.cc:2272] T 2db964eeed76452cb3a8a969e5e2b32a P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.454722  8939 tablet_replica.cc:333] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.455636  8939 raft_consensus.cc:2243] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.456918  8939 raft_consensus.cc:2272] T 380d0cf74fa74de9b77a62b31da282f1 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.460047  8939 tablet_replica.cc:333] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.460863  8939 raft_consensus.cc:2243] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.462054  8939 raft_consensus.cc:2272] T 72fb3f38009a4e7c9c49a225873b591d P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:18.468473 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.477064  8939 tablet_replica.cc:333] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.478088  8939 raft_consensus.cc:2243] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.479207  8939 raft_consensus.cc:2272] T d634bc48b9d24bac964c65941dbc95ba P 9a67604b91f54791b1316fd327793337 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.482234  8939 tablet_replica.cc:333] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.483031  8939 raft_consensus.cc:2243] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.483706  8939 raft_consensus.cc:2272] T 10bea19d11e44342889595040e4d97bd P 9a67604b91f54791b1316fd327793337 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.486506  8939 tablet_replica.cc:333] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.487241  8939 raft_consensus.cc:2243] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.491364 17561 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:18.499940  8939 raft_consensus.cc:2272] T 9339757002c64268bb483f1a5bfe0ccf P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.502959  8939 tablet_replica.cc:333] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.515940  8939 raft_consensus.cc:2243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.516608  8939 raft_consensus.cc:2272] T a30a6af7e1c84c848d5ae312ca4c3eb8 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.517077 10713 raft_consensus.cc:2955] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:18.519443  8939 tablet_replica.cc:333] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.520358  8939 raft_consensus.cc:2243] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.521545  8939 raft_consensus.cc:2272] T ffbced50ff05471aae6f2f593710055e P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.524416  8939 tablet_replica.cc:333] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.525177  8939 raft_consensus.cc:2243] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.526286  8939 raft_consensus.cc:2272] T 366d253a473243de9090f7b03b1c955b P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.532076  8939 tablet_replica.cc:333] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.532914  8939 raft_consensus.cc:2243] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.533556  8939 raft_consensus.cc:2272] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 9a67604b91f54791b1316fd327793337 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.542917  8939 tablet_replica.cc:333] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.543787  8939 raft_consensus.cc:2243] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.544512  8939 raft_consensus.cc:2272] T b57d4d09773c44b6b5b6a6c1002cf19f P 9a67604b91f54791b1316fd327793337 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.554459  8939 tablet_replica.cc:333] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.555456  8939 raft_consensus.cc:2243] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.556607  8939 raft_consensus.cc:2272] T 32f89d2cf222427f9747123276de473f P 9a67604b91f54791b1316fd327793337 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.559324  8939 tablet_replica.cc:333] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337: stopping tablet replica
W20260709 13:19:18.560577 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.560117  8939 raft_consensus.cc:2243] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.574851  8939 raft_consensus.cc:2272] T 34831254ce7143c8bf6fa684a958c7dc P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.577770  9933 catalog_manager.cc:5697] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 13 to 14, VOTER f145536c6dbe456fb8565950244bc2a5 (127.8.186.195) evicted. New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:18.592702  9923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5f53253de3345159399b6816804e1e6 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:18.619015  8939 tablet_replica.cc:333] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.623311  8939 raft_consensus.cc:2243] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.631012  8939 raft_consensus.cc:2272] T 9b7c959dd43740e0922779387d4a3046 P 9a67604b91f54791b1316fd327793337 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.634169  8939 tablet_replica.cc:333] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.634892  8939 raft_consensus.cc:2243] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.635540  8939 raft_consensus.cc:2272] T d1e1f2cc55034d12aba959a49530a6f8 P 9a67604b91f54791b1316fd327793337 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.654953  8939 tablet_replica.cc:333] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.656029  8939 raft_consensus.cc:2243] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.657047  8939 raft_consensus.cc:2272] T f5f53253de3345159399b6816804e1e6 P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.660142  8939 tablet_replica.cc:333] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.660941  8939 raft_consensus.cc:2243] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.661609  8939 raft_consensus.cc:2272] T 1ab28ea212034df2acdf22eab1b39bdd P 9a67604b91f54791b1316fd327793337 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.664428  8939 tablet_replica.cc:333] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.665165  8939 raft_consensus.cc:2243] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.666163  8939 raft_consensus.cc:2272] T a17d1dcb93ee43aeb594457df0185659 P 9a67604b91f54791b1316fd327793337 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.668318 10170 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f53253de3345159399b6816804e1e6 with delete_type TABLET_DATA_TOMBSTONED (TS f145536c6dbe456fb8565950244bc2a5 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:60070
W20260709 13:19:18.687319 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.704900 17697 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:18.705690 17697 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:18.708971 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:18.711067 17697 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:18.711592 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb1a4c54d724ebb8f354038db69e5a5" candidate_uuid: "9a67604b91f54791b1316fd327793337" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:18.713299 10004 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a67604b91f54791b1316fd327793337; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:18.721875 17697 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:18.739902 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.743609 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.744848  8939 tablet_replica.cc:333] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.745946  8939 raft_consensus.cc:2243] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.748842  8939 raft_consensus.cc:2272] T 2eb1a4c54d724ebb8f354038db69e5a5 P 9a67604b91f54791b1316fd327793337 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.754223  8939 tablet_replica.cc:333] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337: stopping tablet replica
I20260709 13:19:18.754848  8939 raft_consensus.cc:2243] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:18.756038  8939 raft_consensus.cc:2272] T 2398a1470b87449dab93ba045655ca29 P 9a67604b91f54791b1316fd327793337 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.763509 17717 tablet_replica.cc:333] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:18.782001 17717 raft_consensus.cc:2243] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.783069 17717 raft_consensus.cc:2272] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.786401 17717 ts_tablet_manager.cc:1916] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:18.812619 17717 ts_tablet_manager.cc:1929] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:19:18.813107 17717 log.cc:1199] T f5f53253de3345159399b6816804e1e6 P f145536c6dbe456fb8565950244bc2a5: Deleting WAL directory at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/wals/f5f53253de3345159399b6816804e1e6
I20260709 13:19:18.815135  9922 catalog_manager.cc:5028] TS f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): tablet f5f53253de3345159399b6816804e1e6 (table test-workload [id=abb1e3ba48ae4d17a69f036d56e4aef4]) successfully deleted
I20260709 13:19:18.833407 17632 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:18.834064 17632 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:18.839790 10155 leader_election.cc:336] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:18.840930 17632 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:18.843616 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:18.845292 10153 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:18.848078 17632 raft_consensus.cc:2749] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:18.906215 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.001266 17632 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.001856 17632 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.003937 17610 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.004106 17632 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.004535 17610 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.005805 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.006734 17610 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.007915 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.008545 10188 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:19:19.009829 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:19.010710 17610 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:19.011179 17610 raft_consensus.cc:493] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.011586 17610 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:19.019510 17610 raft_consensus.cc:515] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:19.024806 10155 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.026234 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:19.027012 17632 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:19.028791 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fbf8d873bf4f76894423df3dee3e74" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:19.029430 10188 raft_consensus.cc:3060] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:19.041934 10188 raft_consensus.cc:2468] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:19.043695 10679 leader_election.cc:304] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:19.044654 17408 raft_consensus.cc:2804] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:19.045156 17408 raft_consensus.cc:697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:19.046059 17408 consensus_queue.cc:237] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.042438 17610 leader_election.cc:290] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:19.057343 10682 leader_election.cc:336] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.078155  9933 catalog_manager.cc:5697] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 22 to 23, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 23 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:19.083482 10682 leader_election.cc:336] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.095048 17408 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.095659 17408 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.098105 17408 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.099669 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.100380 10111 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 26.
I20260709 13:19:19.101891 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:19.105398 10682 leader_election.cc:336] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.105944 17408 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:19.106416 17408 raft_consensus.cc:493] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.106736 17408 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:19.160884 17408 raft_consensus.cc:515] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.202299 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342754e0259d4d1197a5da7433555a8b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:19.202910 10111 raft_consensus.cc:3060] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:19.204367 10682 leader_election.cc:336] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.217825 10111 raft_consensus.cc:2468] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 27.
I20260709 13:19:19.219146 10680 leader_election.cc:304] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.220052 17305 raft_consensus.cc:2804] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:19.220558 17305 raft_consensus.cc:697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 27 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:19.221390 17305 consensus_queue.cc:237] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.229457 17408 leader_election.cc:290] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 27 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.239709 17632 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.240345 17632 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.243427  9933 catalog_manager.cc:5697] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 25 to 27, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 27 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:19.250027 10155 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.250867 17632 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.263353 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.265226 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:19.268483 17685 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:19.277549 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.334616 17408 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.335217 17408 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.337397 17408 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.341524 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
W20260709 13:19:19.352558 10682 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.353343 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:19.356719 17610 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:19.378834 17727 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.379447 17727 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.381618 17727 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.381887 17632 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.382560 17632 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.385205 17685 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.385768 17685 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.386317 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.386804 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.387377 10184 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:19.388444 17632 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.389643 17685 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:19.391667 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:19.392459 10713 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 17.
I20260709 13:19:19.394028 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:19.395037 17685 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:19.395488 17685 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.397006 17685 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:19.397483 10155 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.398007 10155 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:19.392678 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:19.399842 10081 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.402385 17727 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:19.402833 17727 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.403191 17727 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:19.404500 17729 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:19.417330 10155 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.426438 17685 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.429023 17685 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:19.435308 10155 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.430128 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230ae7ec0d4d46b88977591c29ce761b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:19.438007 10713 raft_consensus.cc:3060] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:19.438670 17727 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:19.448081 10081 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.451529 17632 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.452346 17632 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.453718 17610 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.454497 17632 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:19.454254 17610 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.454979 10713 raft_consensus.cc:2468] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:19.461136 17610 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.463845 17713 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.464427 17713 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.466922 17713 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.468711 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.469497 10184 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 19.
W20260709 13:19:19.477412 10081 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.479908 10155 leader_election.cc:336] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.479416 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:19.487087 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.481932 17305 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:19.488273 10153 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.492480 17727 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.491525 10184 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
I20260709 13:19:19.494263 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefbaaae9f26463bb73383d72660a7a1" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:19.494725 10188 raft_consensus.cc:3060] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:19.496719 17730 raft_consensus.cc:2804] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:19.498477 17730 raft_consensus.cc:697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:19:19.494920 10682 leader_election.cc:336] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.488555 17305 raft_consensus.cc:493] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:19:19.500276 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:19.500274 17305 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:19.504951 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.499436 17730 consensus_queue.cc:237] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.506776 17727 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:19.507189 17727 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.507565 17727 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:19.515949 10188 raft_consensus.cc:2468] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:19:19.522181 10078 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.523365 17561 raft_consensus.cc:2804] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:19.523937 17561 raft_consensus.cc:697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:19.524770 17561 consensus_queue.cc:237] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.525728 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:19.531857 10188 raft_consensus.cc:1275] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:19:19.534809 17727 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.537606 17731 consensus_queue.cc:1048] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:19:19.540318 17713 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.540947 17713 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.544291 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.544914 10184 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:19:19.545905 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:19.547166 17713 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.547794 17713 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:19.548149 17713 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.548504 17713 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:19.531780 17305 raft_consensus.cc:515] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.583509 10708 raft_consensus.cc:2393] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 20: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:19.586637 10153 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.601491 17632 raft_consensus.cc:3060] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:19.600118 17610 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.612469  9933 catalog_manager.cc:5697] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 21 to 22, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 22 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.618655 17305 leader_election.cc:290] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:19.625556 10081 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.628057 17727 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.616887 17610 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.641829 17610 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.635082 17713 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:19.643582 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54904us
I20260709 13:19:19.650004 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e8de93fa794635a32ba4eb6cdc82ca" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:19.667002 17632 raft_consensus.cc:2749] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:19.668385 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3c204de67641b8a897fd3a314bf8ea" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:19.668982 10180 raft_consensus.cc:3060] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:19.667073 10682 leader_election.cc:336] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.670220 10682 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.670274 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.671675 10081 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.674311 17713 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:19.676242 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 65585.4us
I20260709 13:19:19.678555 10180 raft_consensus.cc:2468] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:19.681404 10078 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.682572 17713 raft_consensus.cc:2804] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:19.679613 10188 raft_consensus.cc:2468] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
I20260709 13:19:19.685252 17713 raft_consensus.cc:697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:19.685616 10679 leader_election.cc:304] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.686215 17713 consensus_queue.cc:237] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.687127 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
W20260709 13:19:19.689077 10081 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.693588  9933 catalog_manager.cc:5697] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 17 to 18, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 18 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.696938 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:19.689098 17744 raft_consensus.cc:2804] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:19.698443 17735 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.699726 17735 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.698398 17742 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:19.702019 17735 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.702735 17744 raft_consensus.cc:697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
W20260709 13:19:19.710134 10081 leader_election.cc:336] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.705245 17744 consensus_queue.cc:237] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:19.717715 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:19.718817 17730 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.719422 17730 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.721520 17730 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.722260 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.723029 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.730392 10110 raft_consensus.cc:1275] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:19:19.732085 17742 consensus_queue.cc:1048] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:19:19.719002 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be325f96e974db28d904978cd65157d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:19.733989 17730 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
W20260709 13:19:19.732149 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.734565 17730 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.736707 17730 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.738502 17735 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.734122 10180 raft_consensus.cc:3060] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:19.739190 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.741242 10078 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:19.739051 17735 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:19.738806 10155 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.745709 10155 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:19.746433 17735 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.748594 17741 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:19.748739 17561 raft_consensus.cc:2749] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:19.750028 10155 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.752754 10081 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.753930 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:19.755219 17730 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:19.763476 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.765164 17741 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.765673 17741 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.767777 17741 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.769596 17741 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.769174  9935 catalog_manager.cc:5697] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 19 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 20 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.770181 17741 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.773286 17741 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:19.773628 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:19.776217 17735 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.769229 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.777029 10111 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:19.776804 17735 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.778967 17735 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.783645 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:19.784543 17561 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.785084 17561 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.786100 17730 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:19.786531 17730 raft_consensus.cc:493] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.786866 17730 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:19.791399 17561 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:19.802809 10081 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.803362 10081 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.806782  9933 catalog_manager.cc:5697] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 20 to 21, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 21 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.812444 17685 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.813879 17685 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.816927 17685 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.818369 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.821131 17685 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.821790 17685 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.825834 17685 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.827453 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:19.828151 10107 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 23.
I20260709 13:19:19.830013 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:19.835080 17685 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:19.835601 17685 raft_consensus.cc:493] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.836064 17685 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:19.806735 10180 raft_consensus.cc:2468] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:19.857812 17713 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.859371 17713 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.862866 10078 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:19.864109 17561 raft_consensus.cc:2749] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:19.866392 10081 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.877753 17713 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.833811 17730 raft_consensus.cc:515] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.892753 17561 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.893340 17561 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.895432 17561 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:19.899992 10081 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.902558 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.903045 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.903977 10078 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.904850 17713 raft_consensus.cc:2804] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:19.905258 17713 raft_consensus.cc:697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:19.906126 17713 consensus_queue.cc:237] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.910622 17730 leader_election.cc:290] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.911435 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d739126ade124f87a06c44ebdd114d8b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:19.912127 10107 raft_consensus.cc:3060] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:19.918363 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.919637 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.924628 10182 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 27.
I20260709 13:19:19.928295 17685 raft_consensus.cc:515] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.934095 10708 raft_consensus.cc:1275] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:19.934242 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.934852 10187 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 19.
I20260709 13:19:19.936070 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.936630 10187 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 23.
I20260709 13:19:19.937399 17741 consensus_queue.cc:1048] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:19.936661 17744 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.938484 17744 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.946134 17561 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.946764 17561 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.948132 17735 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.948674 17735 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:19.950763 17735 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:19.951508 17561 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:19.953974 10682 leader_election.cc:336] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.955035 10081 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:19.955583 10081 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.963055 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d253a473243de9090f7b03b1c955b" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:19.962921 10078 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:19.964756 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.965754 17685 leader_election.cc:290] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:19.967854 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:19.968298 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.968462 10713 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 21.
I20260709 13:19:19.966544 17561 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:19.969302 17561 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.969674 17561 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:19.970672 10110 raft_consensus.cc:3060] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:19.971669 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.966094 17737 raft_consensus.cc:2749] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:19.966507 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:19.970929 17727 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:19.973052 17727 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.973513 17727 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:19.966320 17744 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.978621 17561 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:19.973002 10187 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
I20260709 13:19:19.980346 17737 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:19.980926 17737 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.981326 17737 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:19.981611 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.984392 17742 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:19.984805 17742 raft_consensus.cc:493] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.985167 17742 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:19.989620  8939 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:19.990821 10081 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.993464 17727 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:19.995826 10155 leader_election.cc:336] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.980695 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
W20260709 13:19:19.996788 10155 leader_election.cc:336] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:19.997371 10155 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, 9a67604b91f54791b1316fd327793337
I20260709 13:19:19.998003 17736 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:19.999101 17736 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:19.999387 17736 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:20.000636 17727 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:19.995908 17737 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.006489 17737 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:20.010030 10081 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:20.016038 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:20.016628 10155 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:20.016626 10081 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.017561 17730 raft_consensus.cc:2749] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:20.017236 10155 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:20.018987 17730 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:20.015600  9935 catalog_manager.cc:5697] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 18 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 19 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.019953 10107 raft_consensus.cc:2468] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
W20260709 13:19:20.020745 10155 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.025545 17736 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:20.031946 17742 raft_consensus.cc:515] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:20.051182 17736 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
I20260709 13:19:20.032846 17561 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:20.033520 10110 raft_consensus.cc:2468] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
W20260709 13:19:20.045156  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 72fb3f38009a4e7c9c49a225873b591d: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.052232 10185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380d0cf74fa74de9b77a62b31da282f1" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:20.049209 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:20.052848 10185 raft_consensus.cc:3060] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:20.053359 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a3203f1155b4e9f83bfcd5d6b9fb72d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:20.053922 10180 raft_consensus.cc:3060] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.052284 17742 leader_election.cc:290] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:20.055967 10153 leader_election.cc:304] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:20.056071 10081 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.056813 17741 raft_consensus.cc:2804] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:20.057332 17741 raft_consensus.cc:697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:20.057816 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72fb3f38009a4e7c9c49a225873b591d" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:20.058364 10184 raft_consensus.cc:3060] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.058174 17741 consensus_queue.cc:237] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.060599 10185 raft_consensus.cc:2468] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:20.062803 10182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f89d2cf222427f9747123276de473f" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
W20260709 13:19:20.063493 10682 leader_election.cc:336] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.064651 10679 leader_election.cc:304] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.066682 17744 raft_consensus.cc:2804] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:20.066346 10188 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:20.077682 17744 raft_consensus.cc:697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:20.078696 17744 consensus_queue.cc:237] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:20.063365 10182 raft_consensus.cc:3060] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:20.068084 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbced50ff05471aae6f2f593710055e" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e"
I20260709 13:19:20.051944 17730 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:20.084131 10708 raft_consensus.cc:3060] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:20.084156 17730 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.085373 10187 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 18.
I20260709 13:19:20.087432 10182 raft_consensus.cc:2468] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 28.
W20260709 13:19:20.094668 10081 consensus_peers.cc:597] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.095151 10155 leader_election.cc:336] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:20.095707 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:20.096136 10155 leader_election.cc:336] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.106353 17730 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:20.109678 10184 raft_consensus.cc:2468] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 24.
I20260709 13:19:20.117844 10708 raft_consensus.cc:2468] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 22.
I20260709 13:19:20.120822 10180 raft_consensus.cc:2468] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd3903ba079e4f47aaf0aa4432382c23 in term 20.
W20260709 13:19:20.134461 10081 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111) [suppressed 322 similar messages]
W20260709 13:19:20.145843 10081 consensus_peers.cc:597] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.148453 10079 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.150826 17736 raft_consensus.cc:2804] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:20.151955 17736 raft_consensus.cc:697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:20.153410 10114 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:20.155676 17736 consensus_queue.cc:237] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:20.160451 17632 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:20.162031 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.165015 10153 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001): Couldn't send request to peer 2f672b54d4754c5aa62b5b919597a14e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49f43d8e966541cf899abeeacbe8ff29. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.166188 17632 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:20.166774 17632 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.170478 17632 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:20.136128 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:20.172457 10110 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 18.
I20260709 13:19:20.173635 10111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:20.174273 10111 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 23.
I20260709 13:19:20.175201 10078 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.177003 17561 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:20.177366 17561 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:20.177716 17561 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.178081 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:20.182212 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
I20260709 13:19:20.183372 17632 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:20.183754 17632 raft_consensus.cc:493] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:20.184113 17632 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.190699 10078 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.191780 17713 raft_consensus.cc:2804] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:20.192298 17713 raft_consensus.cc:697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 28 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:20.193120 17713 consensus_queue.cc:237] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.182065 17730 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:20.195966 17730 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a67604b91f54791b1316fd327793337)
I20260709 13:19:20.196481 17730 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.202492 10078 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.204227 10078 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.204409 17727 raft_consensus.cc:2804] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:20.204995 17735 raft_consensus.cc:2804] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:20.205469 17735 raft_consensus.cc:697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:20.206346 17735 consensus_queue.cc:237] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.173797 10182 raft_consensus.cc:1275] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:20.210853 17731 consensus_queue.cc:1048] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:20.240803 10184 raft_consensus.cc:1275] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:19:20.243958 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:20.246093 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.261833 17561 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.268779 17713 consensus_queue.cc:1048] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:20.279824 17727 raft_consensus.cc:697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Becoming Leader. State: Replica: fd3903ba079e4f47aaf0aa4432382c23, State: Running, Role: LEADER
I20260709 13:19:20.280829 10188 raft_consensus.cc:1275] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:19:20.285923 10155 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:20.286804 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:20.287226 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.287012 17760 consensus_queue.cc:1048] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:20.287724 10155 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.297824 17730 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.301661 17561 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:20.302506  9933 catalog_manager.cc:5697] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 22 to 23, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 23 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:20.281028 17727 consensus_queue.cc:237] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.308077 10180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "fd3903ba079e4f47aaf0aa4432382c23" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:20.314893  9935 catalog_manager.cc:5697] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 21 to 22, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 22 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:20.308857 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 96563.6us
I20260709 13:19:20.320245 10180 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate fd3903ba079e4f47aaf0aa4432382c23 in current term 19: Already voted for candidate f145536c6dbe456fb8565950244bc2a5 in this term.
I20260709 13:19:20.324630 10153 leader_election.cc:304] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:20.329138 17729 raft_consensus.cc:2955] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:19:20.339020 17730 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:20.352208 10110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:20.353047 10110 raft_consensus.cc:2393] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 19: Already voted for candidate fd3903ba079e4f47aaf0aa4432382c23 in this term.
I20260709 13:19:20.352679 10114 raft_consensus.cc:2955] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
W20260709 13:19:20.355129 10081 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.355613 10081 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:20.357652 17765 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:19:20.367542 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.369522 17743 raft_consensus.cc:2804] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:20.370131 17743 raft_consensus.cc:697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
W20260709 13:19:20.373538 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.377161 17632 raft_consensus.cc:515] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.380339 17632 leader_election.cc:290] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:20.371063 17743 consensus_queue.cc:237] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:20.387961 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398a1470b87449dab93ba045655ca29" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:20.388823 10107 raft_consensus.cc:3060] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.408802 10107 raft_consensus.cc:2468] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 24.
I20260709 13:19:20.410291 10153 leader_election.cc:304] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 
W20260709 13:19:20.416040 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 90104.1us
I20260709 13:19:20.414316 17632 raft_consensus.cc:2804] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:20.425592 17632 raft_consensus.cc:697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:20.426731 17632 consensus_queue.cc:237] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:20.448040 10155 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.448509 10155 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:20.453604  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet d739126ade124f87a06c44ebdd114d8b: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:20.455363 17730 raft_consensus.cc:2749] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:19:20.464061  9986 auto_rebalancer.cc:629] Failed to schedule move for tablet 6d3c204de67641b8a897fd3a314bf8ea: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:20.457618  9938 catalog_manager.cc:5697] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 23 to 24, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 24 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:20.476091 10155 leader_election.cc:336] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:20.484869 10081 consensus_peers.cc:597] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.495652 10182 raft_consensus.cc:1275] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:20.497444 17735 consensus_queue.cc:1048] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:20.511008 10107 raft_consensus.cc:1275] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:20.512698 17730 consensus_queue.cc:1048] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:20.544443 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.544986 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.553469  9938 catalog_manager.cc:5697] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 27 to 28, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 28 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:20.555754 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.555226  9938 catalog_manager.cc:5697] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 19 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 20 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.557888  9938 catalog_manager.cc:5697] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: term changed from 23 to 24, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194). New cstate: current_term: 24 leader_uuid: "fd3903ba079e4f47aaf0aa4432382c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:20.561692 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.561491  9938 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 reported cstate change: config changed from index -1 to 14, NON_VOTER 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) added. New cstate: current_term: 22 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } } }
I20260709 13:19:20.574066 10711 raft_consensus.cc:1275] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:20.578857 17713 consensus_queue.cc:1048] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:20.592710  9935 catalog_manager.cc:5697] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 18 to 19, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 19 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:20.594888  9935 catalog_manager.cc:5697] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 23 to 24, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 24 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:20.601516 10081 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.636934 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.679453 10188 raft_consensus.cc:1275] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:19:20.681308 17731 consensus_queue.cc:1048] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:19:20.684389 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.687381 10081 consensus_peers.cc:597] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.747605 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.770668 10081 consensus_peers.cc:597] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.801992 10182 raft_consensus.cc:1275] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:20.806945 17778 ts_tablet_manager.cc:933] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: Initiating tablet copy from peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:20.850811 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.856897 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.860210 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 62444us
I20260709 13:19:20.862231 10182 raft_consensus.cc:1275] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:20.862334 10107 raft_consensus.cc:1275] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:19:20.868171 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.870312 17730 consensus_queue.cc:1048] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:20.877338 10182 raft_consensus.cc:1275] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Refusing update from remote peer fd3903ba079e4f47aaf0aa4432382c23: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:19:20.877267 17778 tablet_copy_client.cc:323] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Beginning tablet copy session from remote peer at address 127.8.186.195:39091
I20260709 13:19:20.881750 10198 tablet_copy_service.cc:140] P f145536c6dbe456fb8565950244bc2a5: Received BeginTabletCopySession request for tablet 49f43d8e966541cf899abeeacbe8ff29 from peer 2f672b54d4754c5aa62b5b919597a14e ({username='slave'} at 127.0.0.1:47762)
I20260709 13:19:20.881584 17779 consensus_queue.cc:1048] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:20.882404 17737 consensus_queue.cc:1048] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:19:20.883270 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.882436 10198 tablet_copy_service.cc:161] P f145536c6dbe456fb8565950244bc2a5: Beginning new tablet copy session on tablet 49f43d8e966541cf899abeeacbe8ff29 from peer 2f672b54d4754c5aa62b5b919597a14e at {username='slave'} at 127.0.0.1:47762: session id = 2f672b54d4754c5aa62b5b919597a14e-49f43d8e966541cf899abeeacbe8ff29
W20260709 13:19:20.888696 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.882103 17765 consensus_queue.cc:1048] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:19:20.894564 10081 consensus_peers.cc:597] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.895016 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.893404 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:20.896240 10198 tablet_copy_source_session.cc:215] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:19:20.903623 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.917655 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.923425 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:20.944051 17778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f43d8e966541cf899abeeacbe8ff29. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:20.978816 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:20.990854  8939 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:20.998626 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:21.030079 10114 raft_consensus.cc:1275] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:21.032935 17763 consensus_queue.cc:1048] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:19:21.068415 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:21.241182 17778 tablet_copy_client.cc:806] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:21.241880 17778 tablet_copy_client.cc:670] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:21.247634 17778 tablet_copy_client.cc:538] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:19:21.263898 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:21.281836 17778 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap starting.
W20260709 13:19:21.378360 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.392412 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:21.456590 17778 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:21.468535 17778 tablet_bootstrap.cc:492] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: Bootstrap complete.
I20260709 13:19:21.469475 17778 ts_tablet_manager.cc:1403] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: Time spent bootstrapping tablet: real 0.188s	user 0.057s	sys 0.012s
I20260709 13:19:21.472993 17778 raft_consensus.cc:359] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:21.473925 17778 raft_consensus.cc:740] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Initialized, Role: LEARNER
I20260709 13:19:21.480273 17778 consensus_queue.cc:260] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: NON_VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: true } }
I20260709 13:19:21.482806 17778 ts_tablet_manager.cc:1434] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:19:21.485384 10198 tablet_copy_service.cc:342] P f145536c6dbe456fb8565950244bc2a5: Request end of tablet copy session 2f672b54d4754c5aa62b5b919597a14e-49f43d8e966541cf899abeeacbe8ff29 received from {username='slave'} at 127.0.0.1:47762
I20260709 13:19:21.485874 10198 tablet_copy_service.cc:434] P f145536c6dbe456fb8565950244bc2a5: ending tablet copy session 2f672b54d4754c5aa62b5b919597a14e-49f43d8e966541cf899abeeacbe8ff29 on tablet 49f43d8e966541cf899abeeacbe8ff29 with peer 2f672b54d4754c5aa62b5b919597a14e
W20260709 13:19:21.664947 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:21.748962 10711 raft_consensus.cc:1217] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
W20260709 13:19:21.927970 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:21.991354  8939 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:22.012854 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.127151 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.234340 17741 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.234895 17741 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:22.247879 17741 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:22.248358 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23" is_pre_election: true
I20260709 13:19:22.252132 10114 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 19.
W20260709 13:19:22.252714 10155 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:22.254318 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:22.258502 17741 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:22.268844 17741 raft_consensus.cc:493] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.269358 17741 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:22.268339 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.338466 17789 raft_consensus.cc:1064] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: attempting to promote NON_VOTER 2f672b54d4754c5aa62b5b919597a14e to VOTER
I20260709 13:19:22.339349 17741 raft_consensus.cc:515] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:22.341507 17789 consensus_queue.cc:237] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:22.354614 10155 leader_election.cc:336] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:22.355659 17741 leader_election.cc:290] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Requested vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:22.356662 10107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d634bc48b9d24bac964c65941dbc95ba" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fd3903ba079e4f47aaf0aa4432382c23"
I20260709 13:19:22.357288 10107 raft_consensus.cc:3060] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.364259 10107 raft_consensus.cc:2468] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f145536c6dbe456fb8565950244bc2a5 in term 20.
I20260709 13:19:22.365537 10153 leader_election.cc:304] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23; no voters: 9a67604b91f54791b1316fd327793337
I20260709 13:19:22.366709 17741 raft_consensus.cc:2804] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:22.368160 17741 raft_consensus.cc:697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Becoming Leader. State: Replica: f145536c6dbe456fb8565950244bc2a5, State: Running, Role: LEADER
I20260709 13:19:22.369087 17741 consensus_queue.cc:237] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:22.398795  9938 catalog_manager.cc:5697] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 reported cstate change: term changed from 18 to 20, leader changed from 9a67604b91f54791b1316fd327793337 (127.8.186.193) to f145536c6dbe456fb8565950244bc2a5 (127.8.186.195). New cstate: current_term: 20 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:22.433391 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.441955 10711 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEARNER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:22.442144 10107 raft_consensus.cc:1275] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:22.443593 17789 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:22.444411 17793 consensus_queue.cc:1048] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:19:22.446048 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.505992 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.509219 17793 raft_consensus.cc:2955] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:22.527184 10114 raft_consensus.cc:2955] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
I20260709 13:19:22.527938 10711 raft_consensus.cc:2955] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:19:22.543331 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.556339  9935 catalog_manager.cc:5697] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: config changed from index 14 to 15, 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "f145536c6dbe456fb8565950244bc2a5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } attrs { replace: true } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } } }
W20260709 13:19:22.566006 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.626850 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.637708 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.738155 10081 consensus_peers.cc:597] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.739989 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.745347 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.778893 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:22.779330 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.842410 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:22.929677 10107 raft_consensus.cc:1275] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Refusing update from remote peer f145536c6dbe456fb8565950244bc2a5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:19:22.931087 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:22.933329 17789 consensus_queue.cc:1048] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:22.954608 10081 consensus_peers.cc:597] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.959661 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.983175 10081 consensus_peers.cc:597] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.992151  8939 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:23.037698 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.083576 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.101938 10081 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.131855 10081 consensus_peers.cc:597] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.187966 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.231453 10081 consensus_peers.cc:597] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.232995 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.251163 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.279769 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.282924 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.312520 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.339058 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.342901 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.379583 10081 consensus_peers.cc:597] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.390728 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.396908 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.431506 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.434248 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.449005 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.464169 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.542127 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.621454 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:23.682027 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.964764 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.000100  8939 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:24.125043 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.141114 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.523705 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.576979 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.634197 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.781745 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.818934 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.821635 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:24.865592 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.866223 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.001137  8939 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:25.017493 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.153797 10682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111) [suppressed 467 similar messages]
W20260709 13:19:25.197834 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.210006 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:25.237182 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.243088 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.330018 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.336481 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.352536 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.443986 10081 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.469851 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.490121 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.508903 10081 consensus_peers.cc:597] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.525600 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.549319 10081 consensus_peers.cc:597] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.573519 10081 consensus_peers.cc:597] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.600512 10081 consensus_peers.cc:597] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.619916 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.623508 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.635164 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.698042 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.714650 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.727885 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.754760 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.800720 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.801766 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.829594 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.939824 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.966753 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.967789 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.007154  8939 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:26.023955 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.045143 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.071979 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.073169 10081 consensus_peers.cc:597] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.085011 10081 consensus_peers.cc:597] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.088196 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.102027 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.356911 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.564415 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.812424 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.007807  8939 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:27.063511 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.178438 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.339947 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.402619 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.422729 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.424803 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.509119 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.512822 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.589846 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.593060 10079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 50860.3us
W20260709 13:19:27.658103 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.697101 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.751073 10081 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.787274 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.834002 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.902742 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.904783 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08002022a0 after lost signal to thread 8942
W20260709 13:19:27.906124 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08002d48c0 after lost signal to thread 9972
W20260709 13:19:27.907644 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1380 after lost signal to thread 10139
W20260709 13:19:27.909070 10210 debug-util.cc:398] Leaking SignalData structure 0x7b0800319ae0 after lost signal to thread 10213
W20260709 13:19:27.920054 10210 debug-util.cc:398] Leaking SignalData structure 0x7b080034baa0 after lost signal to thread 10740
W20260709 13:19:27.924571 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.938386 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.945828 10081 consensus_peers.cc:597] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.949298 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.956596 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.963650 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.989490 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.997830 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.008507  8939 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:28.011379 10081 consensus_peers.cc:597] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.031354 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.111321 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.127573 10081 consensus_peers.cc:597] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.190990 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.285329 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.338045 10081 consensus_peers.cc:597] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.347436 10081 consensus_peers.cc:597] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.355824 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.359129 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.366971 10081 consensus_peers.cc:597] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.372517 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.461601 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.575400 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.593768 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.645449 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.681187 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.681923 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.692276 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.704560 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.832171 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 44295.7us
W20260709 13:19:28.915966 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 51688.4us
W20260709 13:19:28.919868 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.963935 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.008994  8939 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:29.217665 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.447844 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.460309 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.547394 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.744156 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.867143 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.883215 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.934114 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.997431 10081 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.009474  8939 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:30.091524 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:41001, user_credentials={real_user=slave}} blocked reactor thread for 114637us
W20260709 13:19:30.180472 10682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111) [suppressed 461 similar messages]
W20260709 13:19:30.193307 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.204039 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.204595 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.215583 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:30.240139 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:30.340580 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.346947 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.369251 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.375852 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.397894 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.486599 10081 consensus_peers.cc:597] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.495654 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.541654 10081 consensus_peers.cc:597] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.548264 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.608597 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.802616 10081 consensus_peers.cc:597] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.869247 10081 consensus_peers.cc:597] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.882735 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.911548 10081 consensus_peers.cc:597] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.937438 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.994000 10081 consensus_peers.cc:597] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.010219  8939 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:31.067265 10081 consensus_peers.cc:597] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.269459 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.308403 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.312634 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.398530 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.407975 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.409026 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.409569 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.410174 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.410717 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.445947 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.581231 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.603897 10081 consensus_peers.cc:597] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.685807 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.784089 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.811223 10081 consensus_peers.cc:597] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.915483 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.010735  8939 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 10061)
W20260709 13:19:32.040508 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.054288 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.147464 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.666498 10078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 497049us
W20260709 13:19:32.703765 10081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47627us
W20260709 13:19:32.779299 10682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 45197.7us
W20260709 13:19:32.785782 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 58250.5us
W20260709 13:19:32.831463 10081 consensus_peers.cc:597] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.835803 10081 consensus_peers.cc:597] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.871574 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 55980.3us
W20260709 13:19:32.886482 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.901839 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.912886 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.913443 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.916378 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.916862 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.946996 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.062536 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.080098 10081 consensus_peers.cc:597] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:33.092166 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:33.094512 10081 consensus_peers.cc:597] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.206804 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.246589 10081 consensus_peers.cc:597] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.252708 10081 consensus_peers.cc:597] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:33.346652 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.351243 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.353576 10081 consensus_peers.cc:597] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:33.392027 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:33.401896  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
W20260709 13:19:33.506160 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:33.565493  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
W20260709 13:19:33.592031 10153 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.596428 10680 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.675312 10680 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.701633 10680 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.703833 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08001925c0 after lost signal to thread 8942
W20260709 13:19:33.704977 10737 debug-util.cc:398] Leaking SignalData structure 0x7b0800369900 after lost signal to thread 9972
W20260709 13:19:33.706455 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0580 after lost signal to thread 10139
W20260709 13:19:33.709631 10737 debug-util.cc:398] Leaking SignalData structure 0x7b0800151260 after lost signal to thread 10213
W20260709 13:19:33.710976 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08002992c0 after lost signal to thread 10740
W20260709 13:19:33.711388 10081 consensus_peers.cc:597] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.714741 10153 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.720836 10081 consensus_peers.cc:597] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.721730 10153 consensus_peers.cc:597] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.740151 10153 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.740711 10153 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.760715 10081 consensus_peers.cc:597] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:33.758167 10153 consensus_peers.cc:597] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.763552 10153 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.802568 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.793234 10153 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.821694 10153 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.821842 10680 consensus_peers.cc:597] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.824254 10680 consensus_peers.cc:597] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.824900 10680 consensus_peers.cc:597] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.825606 10153 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.834263 10081 consensus_peers.cc:597] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.838891 10680 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.847203 10680 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.851264 10081 consensus_peers.cc:597] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:33.841580 10153 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.851764 10081 consensus_peers.cc:597] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.857549 10153 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.920804  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:33.922240  8939 tablet_replica.cc:333] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
W20260709 13:19:33.926599 10153 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.934758 10680 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.927248  8939 raft_consensus.cc:2243] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.936579  8939 raft_consensus.cc:2272] T 1d2bb95bebdf4e86b0b5a76ee511bbee P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.940030  8939 tablet_replica.cc:333] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:33.941253  8939 raft_consensus.cc:2243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:33.947136 10680 consensus_peers.cc:597] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.948350  8939 raft_consensus.cc:2272] T 3c6c3346fb334d2cbbcdfc623a3e64dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.951499  8939 tablet_replica.cc:333] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
W20260709 13:19:33.964668 10153 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.966789 10680 consensus_peers.cc:597] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.972944  8939 raft_consensus.cc:2243] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:19:33.973529 10153 consensus_peers.cc:597] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.974371  8939 raft_consensus.cc:2272] T 6e77e3a0687c460f8d3f29e5194c49e9 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.977876  8939 tablet_replica.cc:333] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:33.980322  8939 raft_consensus.cc:2243] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.981567  8939 raft_consensus.cc:2272] T 49f43d8e966541cf899abeeacbe8ff29 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.983649 10153 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.984526  8939 tablet_replica.cc:333] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:33.985508  8939 raft_consensus.cc:2243] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.986187  8939 raft_consensus.cc:2272] T 6a5cf83b6b34444eb97230c9c7106ca4 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.989123  8939 tablet_replica.cc:333] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:33.990018  8939 raft_consensus.cc:2243] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.991348  8939 raft_consensus.cc:2272] T 8352b62df8ae441f825cf2075b4f63cb P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.994370  8939 tablet_replica.cc:333] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:33.995318  8939 raft_consensus.cc:2243] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.996229  8939 raft_consensus.cc:2272] T e127deec1bdf4a7883aec8a35942fb23 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.999171  8939 tablet_replica.cc:333] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.000104  8939 raft_consensus.cc:2243] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.000805  8939 raft_consensus.cc:2272] T c62c17c1a96045a9a7d8729d053776f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.002050 10153 consensus_peers.cc:597] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.003670  8939 tablet_replica.cc:333] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.004793  8939 raft_consensus.cc:2243] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.006508  8939 raft_consensus.cc:2272] T ffbced50ff05471aae6f2f593710055e P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.009518  8939 tablet_replica.cc:333] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.010380  8939 raft_consensus.cc:2243] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.012162  8939 raft_consensus.cc:2272] T fefbaaae9f26463bb73383d72660a7a1 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.020094 10081 consensus_peers.cc:597] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.030665  8939 tablet_replica.cc:333] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.031878  8939 raft_consensus.cc:2243] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.050621  8939 raft_consensus.cc:2272] T 2e34dad81aac43a1aac71ca8c862321d P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.053825  8939 tablet_replica.cc:333] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.064594  8939 raft_consensus.cc:2243] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.065498  8939 raft_consensus.cc:2272] T 63d5d93de0b049d0b905d6e491783021 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.080303  8939 tablet_replica.cc:333] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.081332  8939 raft_consensus.cc:2243] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.084046  8939 raft_consensus.cc:2272] T 970bd90924ef4157a7c0b99fe31e7fcb P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.086797  8939 tablet_replica.cc:333] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.087630  8939 raft_consensus.cc:2243] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.088944  8939 raft_consensus.cc:2272] T 6d3c204de67641b8a897fd3a314bf8ea P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.091722  8939 tablet_replica.cc:333] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.092536  8939 raft_consensus.cc:2243] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.093185  8939 raft_consensus.cc:2272] T f9a32b1065fb4ad3a7f2a86329f56464 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.098627  8939 tablet_replica.cc:333] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.102937  8939 raft_consensus.cc:2243] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.105043  8939 raft_consensus.cc:2272] T 2597dc9899784d6eb96b916d235dc5b2 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.107929  8939 tablet_replica.cc:333] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.108765  8939 raft_consensus.cc:2243] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.109371  8939 raft_consensus.cc:2272] T 050435abbd194f2ea45db6d7a8974831 P fd3903ba079e4f47aaf0aa4432382c23 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.112179  8939 tablet_replica.cc:333] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.113131  8939 raft_consensus.cc:2243] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.114387  8939 raft_consensus.cc:2272] T 0be325f96e974db28d904978cd65157d P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.117316  8939 tablet_replica.cc:333] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.118095  8939 raft_consensus.cc:2243] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.119323  8939 raft_consensus.cc:2272] T d5b36c20170946939b59a55932ff2f8d P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.122555  8939 tablet_replica.cc:333] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.123418  8939 raft_consensus.cc:2243] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.124828  8939 raft_consensus.cc:2272] T 2ff24b1804914099b167420853598f48 P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.128026  8939 tablet_replica.cc:333] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.128840  8939 raft_consensus.cc:2243] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.129660  8939 raft_consensus.cc:2272] T 342754e0259d4d1197a5da7433555a8b P fd3903ba079e4f47aaf0aa4432382c23 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.141628  8939 tablet_replica.cc:333] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.152153  8939 raft_consensus.cc:2243] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.152864  8939 raft_consensus.cc:2272] T 8b5bb7b33f6c4f0da898f288eb770258 P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.155702  8939 tablet_replica.cc:333] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.167999  8939 raft_consensus.cc:2243] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.168675  8939 raft_consensus.cc:2272] T 11d1d6b12e0b4e5b9006189784101119 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.178375  8939 tablet_replica.cc:333] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.179247  8939 raft_consensus.cc:2243] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.180037  8939 raft_consensus.cc:2272] T 4fe760ac48e44c2d9fce1d214088eb0e P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.183130  8939 tablet_replica.cc:333] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.196153  8939 raft_consensus.cc:2243] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.197328  8939 raft_consensus.cc:2272] T dc4197bea6d247b289e63500fc5bc56e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.200366  8939 tablet_replica.cc:333] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.201224  8939 raft_consensus.cc:2243] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.202747  8939 raft_consensus.cc:2272] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.204433 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.205608  8939 tablet_replica.cc:333] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.216065  8939 raft_consensus.cc:2243] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.217762  8939 raft_consensus.cc:2272] T 63a2fe5619be481399904909f88ce441 P fd3903ba079e4f47aaf0aa4432382c23 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.218366 10081 consensus_peers.cc:597] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.220570  8939 tablet_replica.cc:333] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.221408  8939 raft_consensus.cc:2243] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.222620  8939 raft_consensus.cc:2272] T 2db964eeed76452cb3a8a969e5e2b32a P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.225732  8939 tablet_replica.cc:333] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.226608  8939 raft_consensus.cc:2243] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.227255  8939 raft_consensus.cc:2272] T d739126ade124f87a06c44ebdd114d8b P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.240495  8939 tablet_replica.cc:333] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.241348  8939 raft_consensus.cc:2243] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.242597  8939 raft_consensus.cc:2272] T 400d1a1ff7f24369b1d869661f6a2640 P fd3903ba079e4f47aaf0aa4432382c23 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.245482  8939 tablet_replica.cc:333] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.246335  8939 raft_consensus.cc:2243] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.247434  8939 raft_consensus.cc:2272] T 8111eefbfbe3442e98fd2c9b054ee1a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.249857 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:34.264993 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.286101  8939 tablet_replica.cc:333] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.292142  8939 raft_consensus.cc:2243] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.293493  8939 raft_consensus.cc:2272] T 32f89d2cf222427f9747123276de473f P fd3903ba079e4f47aaf0aa4432382c23 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.296309  8939 tablet_replica.cc:333] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.303143  8939 raft_consensus.cc:2243] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:19:34.303582 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.304738  8939 raft_consensus.cc:2272] T 34831254ce7143c8bf6fa684a958c7dc P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.317690  8939 tablet_replica.cc:333] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.318874  8939 raft_consensus.cc:2243] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.328413  8939 raft_consensus.cc:2272] T 10bea19d11e44342889595040e4d97bd P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.333261 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.364076  8939 tablet_replica.cc:333] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.367628  8939 raft_consensus.cc:2243] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:19:34.387442 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:34.388154 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:34.396339  8939 raft_consensus.cc:2272] T 9339757002c64268bb483f1a5bfe0ccf P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.404170  8939 tablet_replica.cc:333] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.405097  8939 raft_consensus.cc:2243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.406416  8939 raft_consensus.cc:2272] T a30a6af7e1c84c848d5ae312ca4c3eb8 P fd3903ba079e4f47aaf0aa4432382c23 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.409148  8939 tablet_replica.cc:333] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.435863  8939 raft_consensus.cc:2243] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.436614  8939 raft_consensus.cc:2272] T 366d253a473243de9090f7b03b1c955b P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.439540  8939 tablet_replica.cc:333] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.440343  8939 raft_consensus.cc:2243] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.440992  8939 raft_consensus.cc:2272] T b57d4d09773c44b6b5b6a6c1002cf19f P fd3903ba079e4f47aaf0aa4432382c23 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.454285 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 51358.4us
W20260709 13:19:34.459364 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.463865  8939 tablet_replica.cc:333] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.464833  8939 raft_consensus.cc:2243] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.465691  8939 raft_consensus.cc:2272] T d634bc48b9d24bac964c65941dbc95ba P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.468698  8939 tablet_replica.cc:333] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.469475  8939 raft_consensus.cc:2243] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.470667  8939 raft_consensus.cc:2272] T 72fb3f38009a4e7c9c49a225873b591d P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.489524  8939 tablet_replica.cc:333] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.490357  8939 raft_consensus.cc:2243] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.491570  8939 raft_consensus.cc:2272] T 2eb1a4c54d724ebb8f354038db69e5a5 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.494241  8939 tablet_replica.cc:333] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.495007  8939 raft_consensus.cc:2243] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.521972  8939 raft_consensus.cc:2272] T 133523a809584dd5b44a19acf589801d P fd3903ba079e4f47aaf0aa4432382c23 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.526417  8939 tablet_replica.cc:333] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.528043  8939 raft_consensus.cc:2243] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.529317  8939 raft_consensus.cc:2272] T 778034d202c94f46bfe767ecaf503d1e P fd3903ba079e4f47aaf0aa4432382c23 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.534138  8939 tablet_replica.cc:333] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.545394  8939 raft_consensus.cc:2243] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.546657  8939 raft_consensus.cc:2272] T a17d1dcb93ee43aeb594457df0185659 P fd3903ba079e4f47aaf0aa4432382c23 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.559952 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.588230  8939 tablet_replica.cc:333] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.590656  8939 raft_consensus.cc:2243] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.592839  8939 raft_consensus.cc:2272] T 811060649d664704b4b7ab08b2d4a419 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.598081  8939 tablet_replica.cc:333] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.599534  8939 raft_consensus.cc:2243] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.600798  8939 raft_consensus.cc:2272] T 9b7c959dd43740e0922779387d4a3046 P fd3903ba079e4f47aaf0aa4432382c23 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.612115  8939 tablet_replica.cc:333] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.613435  8939 raft_consensus.cc:2243] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.614657  8939 raft_consensus.cc:2272] T 2398a1470b87449dab93ba045655ca29 P fd3903ba079e4f47aaf0aa4432382c23 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.625064 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:34.648366  8939 tablet_replica.cc:333] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.649883  8939 raft_consensus.cc:2243] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.650986  8939 raft_consensus.cc:2272] T d1e1f2cc55034d12aba959a49530a6f8 P fd3903ba079e4f47aaf0aa4432382c23 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.667045  8939 tablet_replica.cc:333] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23: stopping tablet replica
I20260709 13:19:34.670497  8939 raft_consensus.cc:2243] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.673552  8939 raft_consensus.cc:2272] T f5f53253de3345159399b6816804e1e6 P fd3903ba079e4f47aaf0aa4432382c23 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:34.726855 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 49170.2us
W20260709 13:19:34.756256 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:34.759634 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 93628.5us
W20260709 13:19:34.790283 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:34.791182 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:34.874897 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:34.930169 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:35.159433 17865 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.161823 17865 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.166893 17865 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.184571 10682 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:35.187404 17860 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.189035 17860 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:35.199488 10153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111) [suppressed 475 similar messages]
I20260709 13:19:35.213239 17860 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196:41001)
W20260709 13:19:35.215109 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 54192.3us
I20260709 13:19:35.223989 17865 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.227998 17865 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.232723 17865 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:35.275141 10680 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.275987 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.277729 17865 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:35.283962 10680 leader_election.cc:336] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.287386 17864 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.288564 17864 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.293875 17864 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:35.324693 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:35.326190 10184 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 20.
W20260709 13:19:35.330448 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:35.368940 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:35.370074 10188 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 23.
I20260709 13:19:35.402413 17869 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.403622 17869 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.409103 17869 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.419183 10679 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
W20260709 13:19:35.420890 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 85772.5us
I20260709 13:19:35.421849 17826 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:35.422688 17826 raft_consensus.cc:493] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.423293 17826 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:35.428076 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.430069 17867 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:19:35.433853 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 234825us
W20260709 13:19:35.435703 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 98261.7us
I20260709 13:19:35.449604 17826 raft_consensus.cc:515] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.451675 17867 raft_consensus.cc:493] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.459080 10713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "f145536c6dbe456fb8565950244bc2a5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2f672b54d4754c5aa62b5b919597a14e" is_pre_election: true
I20260709 13:19:35.460841 17867 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:35.446112 17869 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.467918 17869 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:35.473359 10680 leader_election.cc:336] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:35.477535 10679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:39091, user_credentials={real_user=slave}} blocked reactor thread for 49091.2us
I20260709 13:19:35.485781 17826 leader_election.cc:290] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:35.504112 17869 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.510252 17838 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.517697 17838 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.523941 17870 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.525318 17870 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.532743 17838 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.548707 17870 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.558233 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff24b1804914099b167420853598f48" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:35.559525 10188 raft_consensus.cc:3060] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:35.559962 10155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:38563, user_credentials={real_user=slave}} blocked reactor thread for 47151us
I20260709 13:19:35.565650 17860 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.566743 17860 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.570785 17860 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.575876 17838 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.577713 17838 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.581794 17838 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.584545 17860 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.585757 17871 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.587002 17871 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.585561 17860 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.597124 17860 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.596657 10188 raft_consensus.cc:2468] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
I20260709 13:19:35.605777 10679 leader_election.cc:304] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:35.602186 17867 raft_consensus.cc:515] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.610662 10713 raft_consensus.cc:2393] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f145536c6dbe456fb8565950244bc2a5 in current term 24: Already voted for candidate 2f672b54d4754c5aa62b5b919597a14e in this term.
I20260709 13:19:35.602330 17871 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.613670 10680 leader_election.cc:336] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:35.601850 10153 leader_election.cc:336] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.609526 17873 raft_consensus.cc:2804] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:35.617080 17873 raft_consensus.cc:697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:35.618938 17873 consensus_queue.cc:237] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.624524 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8352b62df8ae441f825cf2075b4f63cb" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:35.625906 10188 raft_consensus.cc:3060] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:35.613706 17867 leader_election.cc:290] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:35.638718 17872 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.639984 17872 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.644765 17872 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.650832 17867 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.652022 17867 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.654651 17875 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.655848 17875 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.657693 10153 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 2f672b54d4754c5aa62b5b919597a14e, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.662556 17867 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
I20260709 13:19:35.664783 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5" is_pre_election: true
I20260709 13:19:35.666082 10184 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 21.
W20260709 13:19:35.654999 10155 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.668937 10682 leader_election.cc:336] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:35.674507 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:35.675268 17860 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.676908 17872 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:35.677660 17872 raft_consensus.cc:493] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Starting leader election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.678404 17872 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:35.680186 17875 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.682475 10680 leader_election.cc:336] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.676347 17860 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.695165 17871 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.696026 17871 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.697501 17874 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.698336 17874 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.698837 17871 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.706933 10680 leader_election.cc:336] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.707894 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:35.708425 10153 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.709262 17867 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:35.710148 17860 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.710602 10680 leader_election.cc:336] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:35.710464 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.711503 10155 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.712085 10155 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:35.709275 10153 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.713333 10188 raft_consensus.cc:2468] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 24.
I20260709 13:19:35.713897 17860 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:35.711400 17874 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.726112 10682 leader_election.cc:336] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.726131 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:35.744443 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:35.732311 17838 raft_consensus.cc:2749] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:35.745090 17874 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.734045 10679 leader_election.cc:304] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.748260 17867 raft_consensus.cc:2804] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:35.749176 17867 raft_consensus.cc:697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 24 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:35.750963 17867 consensus_queue.cc:237] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:35.753012 17872 raft_consensus.cc:515] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:35.745317 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:35.760598 17872 leader_election.cc:290] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Requested vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:35.760638 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:35.763069 10184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811060649d664704b4b7ab08b2d4a419" candidate_uuid: "2f672b54d4754c5aa62b5b919597a14e" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f145536c6dbe456fb8565950244bc2a5"
I20260709 13:19:35.764123 10184 raft_consensus.cc:3060] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:35.768097  9935 catalog_manager.cc:5697] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 20 to 21, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 21 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:35.771524 10155 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.792642 10155 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.793736 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.794461 10155 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.795421 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:35.796236 10155 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.797253 10155 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.743292 10153 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.746222 17874 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:35.789858 10680 leader_election.cc:336] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.809252 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:35.800997 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:35.799414 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.810704 10184 raft_consensus.cc:2468] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f672b54d4754c5aa62b5b919597a14e in term 22.
W20260709 13:19:35.811606 10153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 68388.2us
I20260709 13:19:35.812361 17860 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:35.813936 10153 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.810422 17874 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.815685 10155 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.811614 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:35.817966 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:35.820273 10153 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.820627 10679 leader_election.cc:304] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e, f145536c6dbe456fb8565950244bc2a5; no voters: 
I20260709 13:19:35.821107 10153 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.822679 17872 raft_consensus.cc:2804] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:35.823307 17874 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:35.824272 17872 raft_consensus.cc:697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEADER]: Becoming Leader. State: Replica: 2f672b54d4754c5aa62b5b919597a14e, State: Running, Role: LEADER
I20260709 13:19:35.823798 17838 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:35.827450 17871 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:35.826478 17872 consensus_queue.cc:237] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
W20260709 13:19:35.829396 10153 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.833415 17871 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:35.834228 10680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:35119, user_credentials={real_user=slave}} blocked reactor thread for 44475us
I20260709 13:19:35.834630 17871 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.838888 17860 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.840107 17860 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.841974 17871 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.832571 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.844940 17860 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:35.851899 17838 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:35.870226 10153 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.871608 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:35.870280 10155 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.889083 10155 leader_election.cc:336] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.891340 10682 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.896626 10680 leader_election.cc:336] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.898491 17838 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:35.903024 10155 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.904112 10155 leader_election.cc:336] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.923101 10153 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:35.924912 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:35.929546 10680 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.930228 10680 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.930962 17874 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:35.923714 10153 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.932456 17838 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:35.936291 10153 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.936794 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.937529 17838 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:35.937743 10153 leader_election.cc:336] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.938529 10153 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.940327 17838 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:35.945503 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.950400 10680 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:35.961905 10153 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.962438 10153 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.965402 17860 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:35.966470 10153 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.966917 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.967649 17860 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:35.969928 17860 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:35.970494 17860 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:35.972847 17860 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:35.978626  8939 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10136)
W20260709 13:19:35.978765 10155 leader_election.cc:336] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:35.991457 10153 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.991956 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:35.992743 17860 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:35.998713 10153 leader_election.cc:336] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:35.999387 10153 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:36.034134  9935 catalog_manager.cc:5697] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 23 to 24, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 24 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.038115  9935 catalog_manager.cc:5697] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e reported cstate change: term changed from 21 to 22, leader changed from fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194) to 2f672b54d4754c5aa62b5b919597a14e (127.8.186.196). New cstate: current_term: 22 leader_uuid: "2f672b54d4754c5aa62b5b919597a14e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.045675 17838 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:36.049007 10153 leader_election.cc:336] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:36.049927 10153 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:36.051254 17860 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:36.060307 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:36.091100 10153 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.155761 10680 consensus_peers.cc:597] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:36.156988 10184 raft_consensus.cc:1275] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:36.158994 17874 consensus_queue.cc:1048] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:36.217865 10153 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.233369 10153 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.246136 10680 consensus_peers.cc:597] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.250713 10680 consensus_peers.cc:597] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:36.254475 10184 raft_consensus.cc:1275] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:36.269274 17874 consensus_queue.cc:1048] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:19:36.284441 10680 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.302479 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.301851 10153 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:36.306391 10184 raft_consensus.cc:1275] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Refusing update from remote peer 2f672b54d4754c5aa62b5b919597a14e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:36.309914 17865 consensus_queue.cc:1048] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:36.329879 10153 consensus_peers.cc:597] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.330610 10153 consensus_peers.cc:597] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.354254 10680 consensus_peers.cc:597] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.355240 10680 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.362159 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0340 after lost signal to thread 8942
W20260709 13:19:36.364154 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5dc0 after lost signal to thread 9972
W20260709 13:19:36.366549 10210 debug-util.cc:398] Leaking SignalData structure 0x7b0800162c40 after lost signal to thread 10213
W20260709 13:19:36.368857 10210 debug-util.cc:398] Leaking SignalData structure 0x7b08000eda80 after lost signal to thread 10740
W20260709 13:19:36.374298 10680 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.383993 10680 consensus_peers.cc:597] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.398062 10153 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.426837 10153 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.441159 10153 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.446949 10153 consensus_peers.cc:597] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.484674 10680 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.515692 10153 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.519214 10153 consensus_peers.cc:597] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.527932 10680 consensus_peers.cc:597] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.546025 10153 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.604926 10153 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.630698 10680 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.639931 10153 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.643385 10680 consensus_peers.cc:597] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.685441 10680 consensus_peers.cc:597] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.686350 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:36.699996 10153 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.747921 10153 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:36.749305 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:36.776001 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:36.857335 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:36.927131 17874 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:36.927922 17874 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:36.931051 17874 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:36.945742 10682 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:36.947455 10680 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:36.947945 10680 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:36.953138 17874 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:36.959195 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:36.979415  8939 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10136)
W20260709 13:19:37.044505 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.092491 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.204155 10155 consensus_peers.cc:597] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.268886 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.286474 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:37.468096 17838 raft_consensus.cc:493] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.468801 17838 raft_consensus.cc:515] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.471333 17838 leader_election.cc:290] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.478840 10153 leader_election.cc:336] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:37.501510 17894 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.502161 17894 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:37.504492 17894 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:37.525895 17867 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.526672 17867 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:37.529801 17867 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.567287 10682 leader_election.cc:336] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:37.567915 10682 leader_election.cc:336] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:37.568444 10682 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.568923 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.569331 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:37.573212 17898 raft_consensus.cc:493] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.574034 17898 raft_consensus.cc:515] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.576443 17898 leader_election.cc:290] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:37.577504 17838 raft_consensus.cc:493] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.579435 17871 raft_consensus.cc:493] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.581851 17838 raft_consensus.cc:515] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.582082 17871 raft_consensus.cc:515] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.584147 17838 leader_election.cc:290] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:37.584347 17871 leader_election.cc:290] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:37.579144 17898 raft_consensus.cc:493] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.585374 17898 raft_consensus.cc:515] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.587411 17898 leader_election.cc:290] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.590330 10153 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.593187 10153 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.593701 10153 leader_election.cc:336] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.594141 10153 leader_election.cc:336] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.595237 10680 leader_election.cc:336] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.595386 10155 leader_election.cc:336] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.595729 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.595814 10155 leader_election.cc:304] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.596596 17898 raft_consensus.cc:2749] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:37.596560 17874 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:37.598358 10155 consensus_peers.cc:597] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.598423 10680 leader_election.cc:336] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:37.598891 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.599572 17874 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:37.602351 10155 leader_election.cc:336] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.602795 10155 leader_election.cc:304] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.603483 17898 raft_consensus.cc:2749] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:37.604621 10155 leader_election.cc:336] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.605001 10155 leader_election.cc:304] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.605690 17898 raft_consensus.cc:2749] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:37.606680 10155 leader_election.cc:336] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.607055 10155 leader_election.cc:304] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.607712 17898 raft_consensus.cc:2749] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:37.608611 10155 leader_election.cc:336] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.608981 10155 leader_election.cc:304] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.609613 17898 raft_consensus.cc:2749] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:37.659873 17898 raft_consensus.cc:493] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.660414 17898 raft_consensus.cc:515] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.662828 17898 leader_election.cc:290] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.667436 10155 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:37.667938 10153 leader_election.cc:336] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:37.668394 10153 leader_election.cc:304] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.669611 17898 raft_consensus.cc:2749] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:37.685878 10155 consensus_peers.cc:597] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:37.739025 17898 raft_consensus.cc:493] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.739692 17898 raft_consensus.cc:515] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.750386 17871 raft_consensus.cc:493] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
W20260709 13:19:37.750720 10155 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.751199 17871 raft_consensus.cc:515] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.753497 17871 leader_election.cc:290] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:37.754407 17898 leader_election.cc:290] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.763195 10153 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.763734 10153 leader_election.cc:336] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:37.764125 10153 leader_election.cc:304] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:37.766636 10155 leader_election.cc:336] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.767104 10155 leader_election.cc:304] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.767858 17871 raft_consensus.cc:2749] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:37.768529 17871 raft_consensus.cc:2749] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:37.800751 17898 raft_consensus.cc:493] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.801478 17898 raft_consensus.cc:515] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.803720 17898 leader_election.cc:290] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:37.807796 17894 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.808466 17894 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:37.810660 17894 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.832564 10682 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:37.836794 10153 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:37.838601 10155 leader_election.cc:336] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:37.839031 10155 leader_election.cc:304] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:37.839881 10680 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:37.840350 10680 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:37.842655 17871 raft_consensus.cc:2749] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:37.851022 17873 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:37.905514 10155 consensus_peers.cc:597] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:37.930994 17898 raft_consensus.cc:493] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.931679 17898 raft_consensus.cc:515] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:37.933673 17898 leader_election.cc:290] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:37.935671 10155 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.952171 10682 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:37.952792 17898 raft_consensus.cc:493] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:37.985913 17898 raft_consensus.cc:515] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
W20260709 13:19:37.960260 10155 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:38.004737 10153 leader_election.cc:336] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:38.006729 10153 leader_election.cc:304] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:38.007956 17898 leader_election.cc:290] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:38.008812 17871 raft_consensus.cc:2749] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:38.036830 17871 raft_consensus.cc:493] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:38.037460 17871 raft_consensus.cc:515] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:38.039585 17871 leader_election.cc:290] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:38.067515 10155 consensus_peers.cc:597] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.068038 10155 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:38.086661 17898 raft_consensus.cc:493] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:38.087268 17898 raft_consensus.cc:515] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:38.089448 17898 leader_election.cc:290] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
I20260709 13:19:38.116406 17871 raft_consensus.cc:493] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:38.117008 17871 raft_consensus.cc:515] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } }
I20260709 13:19:38.120515 17871 leader_election.cc:290] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:38.129446 10155 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:38.130053 10155 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.130479 10155 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:38.152786 10155 consensus_peers.cc:597] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.159561 10153 leader_election.cc:336] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:38.161556 10153 leader_election.cc:304] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:38.167779 17871 raft_consensus.cc:2749] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:38.168831 10153 leader_election.cc:336] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:38.169246 10153 leader_election.cc:304] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:38.180610 17871 raft_consensus.cc:2749] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:38.182672 10682 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.178723 10155 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:38.201242 10153 leader_election.cc:336] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:38.201699 10153 leader_election.cc:304] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:38.205777 17871 raft_consensus.cc:2749] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:38.206733 10153 leader_election.cc:336] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:38.210510 10153 leader_election.cc:304] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f145536c6dbe456fb8565950244bc2a5; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:38.218248 17871 raft_consensus.cc:2749] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:38.217916 10155 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.275707 10155 consensus_peers.cc:597] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.327317 10153 consensus_peers.cc:597] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.329020 10682 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:38.370129 10155 consensus_peers.cc:597] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.384485 10155 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.414029 10680 consensus_peers.cc:597] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.466774 10680 consensus_peers.cc:597] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.486438 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb440 after lost signal to thread 8942
W20260709 13:19:38.487460 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08003a75a0 after lost signal to thread 9972
W20260709 13:19:38.488751 10737 debug-util.cc:398] Leaking SignalData structure 0x7b0800048d80 after lost signal to thread 10213
W20260709 13:19:38.490067 10737 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9e80 after lost signal to thread 10740
W20260709 13:19:38.541214 10680 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:38.551218  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
W20260709 13:19:38.582139 10680 consensus_peers.cc:597] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.593232 10155 consensus_peers.cc:597] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.716436 10680 consensus_peers.cc:597] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.723037 10153 consensus_peers.cc:597] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:38.731706  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
W20260709 13:19:38.735519 10155 consensus_peers.cc:597] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.748600 10679 consensus_peers.cc:597] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.755853 10153 consensus_peers.cc:597] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.756764 10153 consensus_peers.cc:597] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.764605 10679 consensus_peers.cc:597] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.779794 10679 consensus_peers.cc:597] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.815179 10680 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:38.816373 10679 consensus_peers.cc:597] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.836695  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:38.837858  8939 tablet_replica.cc:333] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.838986  8939 raft_consensus.cc:2243] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.840956  8939 raft_consensus.cc:2272] T 3c6c3346fb334d2cbbcdfc623a3e64dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.844677  8939 tablet_replica.cc:333] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.845678  8939 raft_consensus.cc:2243] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.846431  8939 raft_consensus.cc:2272] T b4a137ce092c4e1f93e053d05a21cb5c P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.847236 10679 consensus_peers.cc:597] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.849472  8939 tablet_replica.cc:333] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.850407  8939 raft_consensus.cc:2243] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.851684  8939 raft_consensus.cc:2272] T e127deec1bdf4a7883aec8a35942fb23 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.854250 10153 consensus_peers.cc:597] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:38.854540  8939 tablet_replica.cc:333] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.855572  8939 raft_consensus.cc:2243] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.857164  8939 raft_consensus.cc:2272] T 2398a1470b87449dab93ba045655ca29 P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.860082  8939 tablet_replica.cc:333] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.860958  8939 raft_consensus.cc:2243] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.862030  8939 raft_consensus.cc:2272] T 6a5cf83b6b34444eb97230c9c7106ca4 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.864919  8939 tablet_replica.cc:333] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.865810  8939 raft_consensus.cc:2243] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.866458  8939 raft_consensus.cc:2272] T 8352b62df8ae441f825cf2075b4f63cb P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.869318  8939 tablet_replica.cc:333] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.870172  8939 raft_consensus.cc:2243] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.870999  8939 raft_consensus.cc:2272] T 6e77e3a0687c460f8d3f29e5194c49e9 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.873924  8939 tablet_replica.cc:333] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.874734  8939 raft_consensus.cc:2243] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.876024  8939 raft_consensus.cc:2272] T c62c17c1a96045a9a7d8729d053776f8 P f145536c6dbe456fb8565950244bc2a5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.878813  8939 tablet_replica.cc:333] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.879673  8939 raft_consensus.cc:2243] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.881536  8939 raft_consensus.cc:2272] T 49f43d8e966541cf899abeeacbe8ff29 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.884400  8939 tablet_replica.cc:333] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.885295  8939 raft_consensus.cc:2243] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.886361  8939 raft_consensus.cc:2272] T fefbaaae9f26463bb73383d72660a7a1 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.886598 10679 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.889379  8939 tablet_replica.cc:333] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.890331  8939 raft_consensus.cc:2243] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.891634  8939 raft_consensus.cc:2272] T 970bd90924ef4157a7c0b99fe31e7fcb P f145536c6dbe456fb8565950244bc2a5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.894491  8939 tablet_replica.cc:333] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.895423  8939 raft_consensus.cc:2243] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.896652  8939 raft_consensus.cc:2272] T 2e34dad81aac43a1aac71ca8c862321d P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.899662  8939 tablet_replica.cc:333] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.900449  8939 raft_consensus.cc:2243] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.901427  8939 raft_consensus.cc:2272] T 5fbda83574ee42f494a2a55e59683596 P f145536c6dbe456fb8565950244bc2a5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.904318  8939 tablet_replica.cc:333] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.905074  8939 raft_consensus.cc:2243] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.905767  8939 raft_consensus.cc:2272] T 6d3c204de67641b8a897fd3a314bf8ea P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.908582  8939 tablet_replica.cc:333] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.909384  8939 raft_consensus.cc:2243] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.910077  8939 raft_consensus.cc:2272] T a9fbf8d873bf4f76894423df3dee3e74 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.912933  8939 tablet_replica.cc:333] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.913748  8939 raft_consensus.cc:2243] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.915048  8939 raft_consensus.cc:2272] T 63d5d93de0b049d0b905d6e491783021 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.917908  8939 tablet_replica.cc:333] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.918684  8939 raft_consensus.cc:2243] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.919866  8939 raft_consensus.cc:2272] T 050435abbd194f2ea45db6d7a8974831 P f145536c6dbe456fb8565950244bc2a5 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.922506  8939 tablet_replica.cc:333] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.923303  8939 raft_consensus.cc:2243] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.924652  8939 raft_consensus.cc:2272] T 2597dc9899784d6eb96b916d235dc5b2 P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.927642  8939 tablet_replica.cc:333] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.928474  8939 raft_consensus.cc:2243] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.929314  8939 raft_consensus.cc:2272] T 0be325f96e974db28d904978cd65157d P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.932016  8939 tablet_replica.cc:333] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.932709  8939 raft_consensus.cc:2243] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.933274  8939 raft_consensus.cc:2272] T d5b36c20170946939b59a55932ff2f8d P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.936415  8939 tablet_replica.cc:333] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.937219  8939 raft_consensus.cc:2243] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.937829  8939 raft_consensus.cc:2272] T 8b5bb7b33f6c4f0da898f288eb770258 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.940726  8939 tablet_replica.cc:333] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.941442  8939 raft_consensus.cc:2243] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.942189  8939 raft_consensus.cc:2272] T 11d1d6b12e0b4e5b9006189784101119 P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.944984  8939 tablet_replica.cc:333] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.945859  8939 raft_consensus.cc:2243] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.947254  8939 raft_consensus.cc:2272] T 230ae7ec0d4d46b88977591c29ce761b P f145536c6dbe456fb8565950244bc2a5 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.948132 10679 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.950418  8939 tablet_replica.cc:333] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.951390  8939 raft_consensus.cc:2243] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.952397  8939 raft_consensus.cc:2272] T 2ff24b1804914099b167420853598f48 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.955104  8939 tablet_replica.cc:333] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
W20260709 13:19:38.955232 10153 consensus_peers.cc:597] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:38.955894  8939 raft_consensus.cc:2243] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.957381  8939 raft_consensus.cc:2272] T 085543d3b9b94f2d806b9cd16489951a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.958792 10679 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.960367  8939 tablet_replica.cc:333] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.961263  8939 raft_consensus.cc:2243] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.961860  8939 raft_consensus.cc:2272] T 1a3203f1155b4e9f83bfcd5d6b9fb72d P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.964593  8939 tablet_replica.cc:333] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.965435  8939 raft_consensus.cc:2243] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.966841  8939 raft_consensus.cc:2272] T 63a2fe5619be481399904909f88ce441 P f145536c6dbe456fb8565950244bc2a5 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.969496 10680 consensus_peers.cc:597] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.969697  8939 tablet_replica.cc:333] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.970559  8939 raft_consensus.cc:2243] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.971288  8939 raft_consensus.cc:2272] T 2db964eeed76452cb3a8a969e5e2b32a P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.974151  8939 tablet_replica.cc:333] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.974936  8939 raft_consensus.cc:2243] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.975931  8939 raft_consensus.cc:2272] T d6e8de93fa794635a32ba4eb6cdc82ca P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.979168  8939 tablet_replica.cc:333] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.979981  8939 raft_consensus.cc:2243] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.981269  8939 raft_consensus.cc:2272] T d739126ade124f87a06c44ebdd114d8b P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.984149  8939 tablet_replica.cc:333] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.984939  8939 raft_consensus.cc:2243] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.985724  8939 raft_consensus.cc:2272] T 1ab28ea212034df2acdf22eab1b39bdd P f145536c6dbe456fb8565950244bc2a5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.988924  8939 tablet_replica.cc:333] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.989725  8939 raft_consensus.cc:2243] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.990969  8939 raft_consensus.cc:2272] T d1e1f2cc55034d12aba959a49530a6f8 P f145536c6dbe456fb8565950244bc2a5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.993731  8939 tablet_replica.cc:333] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.994486  8939 raft_consensus.cc:2243] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.996028  8939 raft_consensus.cc:2272] T 8111eefbfbe3442e98fd2c9b054ee1a5 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.998835  8939 tablet_replica.cc:333] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:38.999607  8939 raft_consensus.cc:2243] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.000240  8939 raft_consensus.cc:2272] T 400d1a1ff7f24369b1d869661f6a2640 P f145536c6dbe456fb8565950244bc2a5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.002508  8939 tablet_replica.cc:333] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.003021  8939 raft_consensus.cc:2243] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.003585  8939 raft_consensus.cc:2272] T a31abbd8853749ac891b56f5989949b0 P f145536c6dbe456fb8565950244bc2a5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.006009  8939 tablet_replica.cc:333] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.006556  8939 raft_consensus.cc:2243] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.007062  8939 raft_consensus.cc:2272] T 380d0cf74fa74de9b77a62b31da282f1 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.009502  8939 tablet_replica.cc:333] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.010088  8939 raft_consensus.cc:2243] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.010598  8939 raft_consensus.cc:2272] T 72fb3f38009a4e7c9c49a225873b591d P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.012841  8939 tablet_replica.cc:333] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.013367  8939 raft_consensus.cc:2243] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.014456  8939 raft_consensus.cc:2272] T d634bc48b9d24bac964c65941dbc95ba P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.016892  8939 tablet_replica.cc:333] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.017518  8939 raft_consensus.cc:2243] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.018517  8939 raft_consensus.cc:2272] T 778034d202c94f46bfe767ecaf503d1e P f145536c6dbe456fb8565950244bc2a5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.020722  8939 tablet_replica.cc:333] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.021433  8939 raft_consensus.cc:2243] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.022006  8939 raft_consensus.cc:2272] T 2eb1a4c54d724ebb8f354038db69e5a5 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.024701  8939 tablet_replica.cc:333] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.025477  8939 raft_consensus.cc:2243] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.026134  8939 raft_consensus.cc:2272] T 133523a809584dd5b44a19acf589801d P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:39.026561 10680 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:39.028581  8939 tablet_replica.cc:333] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.029152  8939 raft_consensus.cc:2243] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.029668  8939 raft_consensus.cc:2272] T 10bea19d11e44342889595040e4d97bd P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.031947  8939 tablet_replica.cc:333] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.032459  8939 raft_consensus.cc:2243] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.033397  8939 raft_consensus.cc:2272] T 366d253a473243de9090f7b03b1c955b P f145536c6dbe456fb8565950244bc2a5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.035511  8939 tablet_replica.cc:333] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.036084  8939 raft_consensus.cc:2243] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.037011  8939 raft_consensus.cc:2272] T f1fa3c9e8a7a496eaa49ec78b5a92103 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.039160  8939 tablet_replica.cc:333] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.039723  8939 raft_consensus.cc:2243] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.040249  8939 raft_consensus.cc:2272] T 32f89d2cf222427f9747123276de473f P f145536c6dbe456fb8565950244bc2a5 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.042958  8939 tablet_replica.cc:333] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.043605  8939 raft_consensus.cc:2243] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.044469  8939 raft_consensus.cc:2272] T 34831254ce7143c8bf6fa684a958c7dc P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:39.045095 10679 consensus_peers.cc:597] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:39.047206  8939 tablet_replica.cc:333] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.048005  8939 raft_consensus.cc:2243] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.048641  8939 raft_consensus.cc:2272] T a30a6af7e1c84c848d5ae312ca4c3eb8 P f145536c6dbe456fb8565950244bc2a5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.051360  8939 tablet_replica.cc:333] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.052090  8939 raft_consensus.cc:2243] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.053229  8939 raft_consensus.cc:2272] T 9b7c959dd43740e0922779387d4a3046 P f145536c6dbe456fb8565950244bc2a5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:39.055305 10679 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:39.056164  8939 tablet_replica.cc:333] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5: stopping tablet replica
I20260709 13:19:39.056716  8939 raft_consensus.cc:2243] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:39.057266  8939 raft_consensus.cc:2272] T 811060649d664704b4b7ab08b2d4a419 P f145536c6dbe456fb8565950244bc2a5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:39.071671 10680 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:39.079854 10679 consensus_peers.cc:597] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.082067 10679 consensus_peers.cc:597] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.097731 10679 consensus_peers.cc:597] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.143931 10680 consensus_peers.cc:597] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:39.179425 10680 consensus_peers.cc:597] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:39.182202 10679 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:39091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.195406 10679 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:39091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.227437 10679 consensus_peers.cc:597] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:39091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.247203 10680 consensus_peers.cc:597] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:39.300730 10679 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Couldn't send request to peer f145536c6dbe456fb8565950244bc2a5. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:39091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:39.322674 10680 consensus_peers.cc:597] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:39.370628 10680 consensus_peers.cc:597] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e -> Peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Couldn't send request to peer fd3903ba079e4f47aaf0aa4432382c23. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:39.372776 10682 consensus_peers.cc:597] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.383535 10682 consensus_peers.cc:597] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.396008 10682 consensus_peers.cc:597] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.404145 10682 consensus_peers.cc:597] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.447712 10682 consensus_peers.cc:597] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.626971 10682 consensus_peers.cc:597] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.706418 10682 consensus_peers.cc:597] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.758638 10682 consensus_peers.cc:597] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.803265 10682 consensus_peers.cc:597] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:39.869240 17894 raft_consensus.cc:493] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:39.869777 17894 raft_consensus.cc:515] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:39.871645 17894 leader_election.cc:290] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:39.876722 10682 leader_election.cc:336] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:39.879156 10680 leader_election.cc:336] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:39.879639 10680 leader_election.cc:304] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
W20260709 13:19:39.877292 10682 consensus_peers.cc:597] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:39.880965 17899 raft_consensus.cc:2749] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:39.892777 17894 raft_consensus.cc:493] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
I20260709 13:19:39.893282 17894 raft_consensus.cc:515] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:39.898655 17894 leader_election.cc:290] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:39.899909 10680 leader_election.cc:336] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:39.903625 10679 leader_election.cc:336] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Network error: Client connection negotiation failed: client connection to 127.8.186.195:39091: connect: Connection refused (error 111)
I20260709 13:19:39.903995  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:19:39.904106 10679 leader_election.cc:304] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: f145536c6dbe456fb8565950244bc2a5, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:39.906296 17894 raft_consensus.cc:2749] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:39.911634 17894 raft_consensus.cc:493] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:39.912184 17894 raft_consensus.cc:515] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:39.914475 17894 leader_election.cc:290] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:39.920203 10680 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
W20260709 13:19:39.925084 10682 leader_election.cc:336] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:39.925552 10682 leader_election.cc:304] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:39.926452 17899 raft_consensus.cc:2749] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:39.926638 10682 consensus_peers.cc:597] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e -> Peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Couldn't send request to peer 9a67604b91f54791b1316fd327793337. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:39.930363 17899 raft_consensus.cc:493] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:39.930881 17899 raft_consensus.cc:515] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:39.933326 17899 leader_election.cc:290] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:39.938810 10680 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:39.940955 17899 raft_consensus.cc:493] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f145536c6dbe456fb8565950244bc2a5)
W20260709 13:19:39.940966 10682 leader_election.cc:336] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:39.941884 10682 leader_election.cc:304] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:39.941915 17899 raft_consensus.cc:515] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "f145536c6dbe456fb8565950244bc2a5" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 39091 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:39.942781 17894 raft_consensus.cc:2749] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:39.949724 10679 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091): Network error: Client connection negotiation failed: client connection to 127.8.186.195:39091: connect: Connection refused (error 111)
I20260709 13:19:39.947364 17899 leader_election.cc:290] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), f145536c6dbe456fb8565950244bc2a5 (127.8.186.195:39091)
W20260709 13:19:39.950974 10682 leader_election.cc:336] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
I20260709 13:19:39.951426 10682 leader_election.cc:304] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, f145536c6dbe456fb8565950244bc2a5
I20260709 13:19:39.952201 17899 raft_consensus.cc:2749] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:39.956920 17899 raft_consensus.cc:493] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fd3903ba079e4f47aaf0aa4432382c23)
I20260709 13:19:39.957471 17899 raft_consensus.cc:515] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9a67604b91f54791b1316fd327793337" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 38563 } } peers { permanent_uuid: "fd3903ba079e4f47aaf0aa4432382c23" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 35119 } } peers { permanent_uuid: "2f672b54d4754c5aa62b5b919597a14e" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 41001 } attrs { promote: false } }
I20260709 13:19:39.959985 17899 leader_election.cc:290] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563), fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119)
W20260709 13:19:39.964881 10682 leader_election.cc:336] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9a67604b91f54791b1316fd327793337 (127.8.186.193:38563): Network error: Client connection negotiation failed: client connection to 127.8.186.193:38563: connect: Connection refused (error 111)
W20260709 13:19:39.968066 10680 leader_election.cc:336] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fd3903ba079e4f47aaf0aa4432382c23 (127.8.186.194:35119): Network error: Client connection negotiation failed: client connection to 127.8.186.194:35119: connect: Connection refused (error 111)
I20260709 13:19:39.968515 10680 leader_election.cc:304] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f672b54d4754c5aa62b5b919597a14e; no voters: 9a67604b91f54791b1316fd327793337, fd3903ba079e4f47aaf0aa4432382c23
I20260709 13:19:39.969278 17894 raft_consensus.cc:2749] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:40.024775  8939 tablet_server.cc:179] TabletServer@127.8.186.196:0 shutting down...
I20260709 13:19:40.074646  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:40.075332  8939 tablet_replica.cc:333] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.076242  8939 raft_consensus.cc:2243] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.076960  8939 raft_consensus.cc:2272] T 49f43d8e966541cf899abeeacbe8ff29 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.079617  8939 tablet_replica.cc:333] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.080269  8939 raft_consensus.cc:2243] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.080746  8939 raft_consensus.cc:2272] T e127deec1bdf4a7883aec8a35942fb23 P 2f672b54d4754c5aa62b5b919597a14e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.082789  8939 tablet_replica.cc:333] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.083323  8939 raft_consensus.cc:2243] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.084277  8939 raft_consensus.cc:2272] T 133523a809584dd5b44a19acf589801d P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.086323  8939 tablet_replica.cc:333] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.086912  8939 raft_consensus.cc:2243] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.087929  8939 raft_consensus.cc:2272] T f9a32b1065fb4ad3a7f2a86329f56464 P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.090061  8939 tablet_replica.cc:333] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.090727  8939 raft_consensus.cc:2243] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.091261  8939 raft_consensus.cc:2272] T 9339757002c64268bb483f1a5bfe0ccf P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.094308  8939 tablet_replica.cc:333] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.095175  8939 raft_consensus.cc:2243] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.095927  8939 raft_consensus.cc:2272] T ffbced50ff05471aae6f2f593710055e P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.098855  8939 tablet_replica.cc:333] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.099608  8939 raft_consensus.cc:2243] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.100741  8939 raft_consensus.cc:2272] T 5fbda83574ee42f494a2a55e59683596 P 2f672b54d4754c5aa62b5b919597a14e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.103458  8939 tablet_replica.cc:333] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.104254  8939 raft_consensus.cc:2243] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.105307  8939 raft_consensus.cc:2272] T 8352b62df8ae441f825cf2075b4f63cb P 2f672b54d4754c5aa62b5b919597a14e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.107977  8939 tablet_replica.cc:333] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.108703  8939 raft_consensus.cc:2243] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.109722  8939 raft_consensus.cc:2272] T 811060649d664704b4b7ab08b2d4a419 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.112325  8939 tablet_replica.cc:333] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.113204  8939 raft_consensus.cc:2243] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.113773  8939 raft_consensus.cc:2272] T 2e34dad81aac43a1aac71ca8c862321d P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.116439  8939 tablet_replica.cc:333] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.117213  8939 raft_consensus.cc:2243] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.118392  8939 raft_consensus.cc:2272] T 4fe760ac48e44c2d9fce1d214088eb0e P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.121066  8939 tablet_replica.cc:333] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.121775  8939 raft_consensus.cc:2243] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.122829  8939 raft_consensus.cc:2272] T f1fa3c9e8a7a496eaa49ec78b5a92103 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.125582  8939 tablet_replica.cc:333] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.126399  8939 raft_consensus.cc:2243] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.127526  8939 raft_consensus.cc:2272] T b57d4d09773c44b6b5b6a6c1002cf19f P 2f672b54d4754c5aa62b5b919597a14e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.130065  8939 tablet_replica.cc:333] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.130771  8939 raft_consensus.cc:2243] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.131455  8939 raft_consensus.cc:2272] T c62c17c1a96045a9a7d8729d053776f8 P 2f672b54d4754c5aa62b5b919597a14e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.134011  8939 tablet_replica.cc:333] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.134718  8939 raft_consensus.cc:2243] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.135843  8939 raft_consensus.cc:2272] T 11d1d6b12e0b4e5b9006189784101119 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.138531  8939 tablet_replica.cc:333] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.139266  8939 raft_consensus.cc:2243] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.140254  8939 raft_consensus.cc:2272] T 1d2bb95bebdf4e86b0b5a76ee511bbee P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.142848  8939 tablet_replica.cc:333] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.143603  8939 raft_consensus.cc:2243] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.144721  8939 raft_consensus.cc:2272] T 380d0cf74fa74de9b77a62b31da282f1 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.147351  8939 tablet_replica.cc:333] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.148075  8939 raft_consensus.cc:2243] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.149221  8939 raft_consensus.cc:2272] T a9fbf8d873bf4f76894423df3dee3e74 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.151882  8939 tablet_replica.cc:333] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.152642  8939 raft_consensus.cc:2243] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.153710  8939 raft_consensus.cc:2272] T 6a5cf83b6b34444eb97230c9c7106ca4 P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.156737  8939 tablet_replica.cc:333] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.157423  8939 raft_consensus.cc:2243] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.158052  8939 raft_consensus.cc:2272] T 230ae7ec0d4d46b88977591c29ce761b P 2f672b54d4754c5aa62b5b919597a14e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.160477  8939 tablet_replica.cc:333] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.161195  8939 raft_consensus.cc:2243] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.162201  8939 raft_consensus.cc:2272] T 8b5bb7b33f6c4f0da898f288eb770258 P 2f672b54d4754c5aa62b5b919597a14e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.164713  8939 tablet_replica.cc:333] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.165478  8939 raft_consensus.cc:2243] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.166277  8939 raft_consensus.cc:2272] T f5f53253de3345159399b6816804e1e6 P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.169262  8939 tablet_replica.cc:333] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.169960  8939 raft_consensus.cc:2243] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.171000  8939 raft_consensus.cc:2272] T 2ff24b1804914099b167420853598f48 P 2f672b54d4754c5aa62b5b919597a14e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.173573  8939 tablet_replica.cc:333] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.174228  8939 raft_consensus.cc:2243] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.175328  8939 raft_consensus.cc:2272] T 342754e0259d4d1197a5da7433555a8b P 2f672b54d4754c5aa62b5b919597a14e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.177784  8939 tablet_replica.cc:333] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.178472  8939 raft_consensus.cc:2243] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.179009  8939 raft_consensus.cc:2272] T dc4197bea6d247b289e63500fc5bc56e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.181629  8939 tablet_replica.cc:333] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.182319  8939 raft_consensus.cc:2243] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.183341  8939 raft_consensus.cc:2272] T a17d1dcb93ee43aeb594457df0185659 P 2f672b54d4754c5aa62b5b919597a14e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.185870  8939 tablet_replica.cc:333] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.186542  8939 raft_consensus.cc:2243] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.187597  8939 raft_consensus.cc:2272] T 1ab28ea212034df2acdf22eab1b39bdd P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.189826  8939 tablet_replica.cc:333] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.190315  8939 raft_consensus.cc:2243] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.191129  8939 raft_consensus.cc:2272] T d6e8de93fa794635a32ba4eb6cdc82ca P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.193080  8939 tablet_replica.cc:333] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.193550  8939 raft_consensus.cc:2243] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.194397  8939 raft_consensus.cc:2272] T b4a137ce092c4e1f93e053d05a21cb5c P 2f672b54d4754c5aa62b5b919597a14e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.196311  8939 tablet_replica.cc:333] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.196748  8939 raft_consensus.cc:2243] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.197482  8939 raft_consensus.cc:2272] T 085543d3b9b94f2d806b9cd16489951a P 2f672b54d4754c5aa62b5b919597a14e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.199281  8939 tablet_replica.cc:333] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.199712  8939 raft_consensus.cc:2243] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.200515  8939 raft_consensus.cc:2272] T 8111eefbfbe3442e98fd2c9b054ee1a5 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.202575  8939 tablet_replica.cc:333] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.202989  8939 raft_consensus.cc:2243] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.203801  8939 raft_consensus.cc:2272] T a31abbd8853749ac891b56f5989949b0 P 2f672b54d4754c5aa62b5b919597a14e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.205607  8939 tablet_replica.cc:333] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e: stopping tablet replica
I20260709 13:19:40.206024  8939 raft_consensus.cc:2243] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.206457  8939 raft_consensus.cc:2272] T 778034d202c94f46bfe767ecaf503d1e P 2f672b54d4754c5aa62b5b919597a14e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.635151  8939 tablet_server.cc:196] TabletServer@127.8.186.196:0 shutdown complete.
I20260709 13:19:40.702386  8939 master.cc:562] Master@127.8.186.254:36577 shutting down...
W20260709 13:19:40.740811  9986 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:19:40.741072  9986 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:40.741299  9986 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:19:40.745014  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.745609  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.745942  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P a2e763e48a394cda873aa837f65da240: stopping tablet replica
I20260709 13:19:40.863631  8939 master.cc:584] Master@127.8.186.254:36577 shutdown complete.
I20260709 13:19:40.903264  8939 test_util.cc:182] -----------------------------------------------
I20260709 13:19:40.903494  8939 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602915752797-8939-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (242074 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:40.906862  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:34083
I20260709 13:19:40.908067  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:40.913771 17903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:40.913828 17902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:40.914767 17905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:40.916684  8939 server_base.cc:1061] running on GCE node
I20260709 13:19:40.919476  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:40.919685  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:40.919845  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603180919831 us; error 0 us; skew 500 ppm
I20260709 13:19:40.920354  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:40.929241  8939 webserver.cc:533] Webserver started at http://127.8.186.254:45593/ using document root <none> and password file <none>
I20260709 13:19:40.929749  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:40.929910  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:40.930143  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:40.931387  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "974c2aa131d140b29fb3577a49e5258e"
format_stamp: "Formatted at 2026-07-09 13:19:40 on dist-test-slave-mq27"
I20260709 13:19:40.936245  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:19:40.940080 17910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:40.940852  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:40.941169  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "974c2aa131d140b29fb3577a49e5258e"
format_stamp: "Formatted at 2026-07-09 13:19:40 on dist-test-slave-mq27"
I20260709 13:19:40.941465  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:40.954838  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:40.956190  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.001353  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:34083
I20260709 13:19:41.001421 17961 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:34083 every 8 connection(s)
I20260709 13:19:41.006716 17962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.021449 17962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e: Bootstrap starting.
I20260709 13:19:41.026930 17962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:41.033178 17962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e: No bootstrap required, opened a new log
I20260709 13:19:41.035573 17962 raft_consensus.cc:359] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974c2aa131d140b29fb3577a49e5258e" member_type: VOTER }
I20260709 13:19:41.036072 17962 raft_consensus.cc:385] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.036294 17962 raft_consensus.cc:740] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974c2aa131d140b29fb3577a49e5258e, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.036897 17962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974c2aa131d140b29fb3577a49e5258e" member_type: VOTER }
I20260709 13:19:41.037366 17962 raft_consensus.cc:399] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:41.037578 17962 raft_consensus.cc:493] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:41.037828 17962 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.042968 17962 raft_consensus.cc:515] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974c2aa131d140b29fb3577a49e5258e" member_type: VOTER }
I20260709 13:19:41.043799 17962 leader_election.cc:304] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 974c2aa131d140b29fb3577a49e5258e; no voters: 
I20260709 13:19:41.045359 17962 leader_election.cc:290] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:41.045734 17965 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:41.047137 17965 raft_consensus.cc:697] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 1 LEADER]: Becoming Leader. State: Replica: 974c2aa131d140b29fb3577a49e5258e, State: Running, Role: LEADER
I20260709 13:19:41.047847 17965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974c2aa131d140b29fb3577a49e5258e" member_type: VOTER }
I20260709 13:19:41.048477 17962 sys_catalog.cc:565] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:41.052435 17967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 974c2aa131d140b29fb3577a49e5258e. Latest consensus state: current_term: 1 leader_uuid: "974c2aa131d140b29fb3577a49e5258e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974c2aa131d140b29fb3577a49e5258e" member_type: VOTER } }
I20260709 13:19:41.053200 17967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:41.054328 17966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "974c2aa131d140b29fb3577a49e5258e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974c2aa131d140b29fb3577a49e5258e" member_type: VOTER } }
I20260709 13:19:41.057065 17966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:41.057454 17971 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:41.064975 17971 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:41.066431  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:41.075575 17971 catalog_manager.cc:1383] Generated new cluster ID: 2d2634c6ce8546a7947a1dfd47586fea
I20260709 13:19:41.075943 17971 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:41.106281 17971 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:41.107542 17971 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:41.120316 17971 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e: Generated new TSK 0
I20260709 13:19:41.120914 17971 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:41.134227  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.140518 17983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.142030 17984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.145795 17986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.148051  8939 server_base.cc:1061] running on GCE node
I20260709 13:19:41.151100  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:41.151353  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.151484  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603181151467 us; error 0 us; skew 500 ppm
I20260709 13:19:41.152034  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.155200  8939 webserver.cc:533] Webserver started at http://127.8.186.193:43847/ using document root <none> and password file <none>
I20260709 13:19:41.155681  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.155925  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.156167  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.157251  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "e8fdca3eaa0547d08fd840005216e2da"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.161964  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:19:41.165421 17991 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.166188  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:41.166481  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "e8fdca3eaa0547d08fd840005216e2da"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.166757  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.200280  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.201534  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.203086  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.205463  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:41.205662  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.205904  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:41.206073  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.249007  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:41391
I20260709 13:19:41.249136 18053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:41391 every 8 connection(s)
I20260709 13:19:41.254091  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.262122 18058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.263971 18059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.266162  8939 server_base.cc:1061] running on GCE node
W20260709 13:19:41.268057 18061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.269312  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:41.269520  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.269651  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603181269638 us; error 0 us; skew 500 ppm
I20260709 13:19:41.269718 18054 heartbeater.cc:344] Connected to a master server at 127.8.186.254:34083
I20260709 13:19:41.270125 18054 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:41.270215  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.271008 18054 heartbeater.cc:507] Master 127.8.186.254:34083 requested a full tablet report, sending...
I20260709 13:19:41.272941  8939 webserver.cc:533] Webserver started at http://127.8.186.194:45025/ using document root <none> and password file <none>
I20260709 13:19:41.273486 17927 ts_manager.cc:194] Registered new tserver with Master: e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:41.273686  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.273984  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.274325  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.275875  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "830a192d6137410e8bd043588f0ed425"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.276055 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33068
I20260709 13:19:41.280705  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:19:41.284545 18066 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.285496  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:19:41.285828  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "830a192d6137410e8bd043588f0ed425"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.286089  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.298722  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.300062  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.301556  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.303895  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:41.304100  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.304327  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:41.304478  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.347962  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:38977
I20260709 13:19:41.348083 18128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:38977 every 8 connection(s)
I20260709 13:19:41.353399  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.361629 18133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.361644 18132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.369203 18129 heartbeater.cc:344] Connected to a master server at 127.8.186.254:34083
I20260709 13:19:41.369676 18129 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:41.369804 18135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.370513 18129 heartbeater.cc:507] Master 127.8.186.254:34083 requested a full tablet report, sending...
I20260709 13:19:41.370656  8939 server_base.cc:1061] running on GCE node
I20260709 13:19:41.371798  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:41.372043  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.372251  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603181372232 us; error 0 us; skew 500 ppm
I20260709 13:19:41.372884  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.372975 17927 ts_manager.cc:194] Registered new tserver with Master: 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:41.374590 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33078
I20260709 13:19:41.375428  8939 webserver.cc:533] Webserver started at http://127.8.186.195:36911/ using document root <none> and password file <none>
I20260709 13:19:41.376174  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.376420  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.376744  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.377936  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "e6e16b9214a1403293e3eeb06be25a91"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.382561  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:41.386099 18140 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.386900  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:19:41.387209  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "e6e16b9214a1403293e3eeb06be25a91"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.387465  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.400653  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.401921  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.403431  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.405776  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:41.405993  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.406234  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:41.406375  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.447990  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:37697
I20260709 13:19:41.448091 18202 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:37697 every 8 connection(s)
I20260709 13:19:41.452909  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.460381 18206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.461580 18207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.464262 18209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.464406  8939 server_base.cc:1061] running on GCE node
I20260709 13:19:41.465423 18203 heartbeater.cc:344] Connected to a master server at 127.8.186.254:34083
I20260709 13:19:41.465595  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:41.465808 18203 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:41.465934  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.466185  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603181466167 us; error 0 us; skew 500 ppm
I20260709 13:19:41.466635 18203 heartbeater.cc:507] Master 127.8.186.254:34083 requested a full tablet report, sending...
I20260709 13:19:41.466777  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.469116 17927 ts_manager.cc:194] Registered new tserver with Master: e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:41.469897  8939 webserver.cc:533] Webserver started at http://127.8.186.196:35259/ using document root <none> and password file <none>
I20260709 13:19:41.470625  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.470865  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.471037 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33094
I20260709 13:19:41.471199  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.472725  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-3-root/instance:
uuid: "23853b156a904ba6a31afa79977f3adc"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.477402  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:41.481007 18214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.481778  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:41.482084  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-3-root
uuid: "23853b156a904ba6a31afa79977f3adc"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:41.482388  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.510818  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.512130  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.513583  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.515903  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:41.516106  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.516325  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:41.516474  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.558490  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.196:35299
I20260709 13:19:41.558602 18276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.196:35299 every 8 connection(s)
I20260709 13:19:41.572563 18277 heartbeater.cc:344] Connected to a master server at 127.8.186.254:34083
I20260709 13:19:41.573055 18277 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:41.573825 18277 heartbeater.cc:507] Master 127.8.186.254:34083 requested a full tablet report, sending...
I20260709 13:19:41.575819 17927 ts_manager.cc:194] Registered new tserver with Master: 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:41.576316  8939 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014778076s
I20260709 13:19:41.577217 17927 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33100
I20260709 13:19:41.602303 17927 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33108:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:41.843371 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 951bc38e637242429f4d8415582fa5dc (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:41.841902 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 77a6d9f19cd54ca29ff8bb17b2f7abb7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:41.845018 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951bc38e637242429f4d8415582fa5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.845737 18018 tablet_service.cc:1511] Processing CreateTablet for tablet 675aa5689d904979a3aaa90534d93385 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:41.847314 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675aa5689d904979a3aaa90534d93385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.848357 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a6d9f19cd54ca29ff8bb17b2f7abb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.849073 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 3879a0395b8c47ee82b8d483717aacd7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:41.850590 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879a0395b8c47ee82b8d483717aacd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.859323 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 41c7cf1efa6d4c26b013079c0cfeb2c5 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:41.861142 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c7cf1efa6d4c26b013079c0cfeb2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.868739 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 227d050c5ac14865954c8c8dce1cfe86 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:41.870249 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d050c5ac14865954c8c8dce1cfe86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.870425 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 77a6d9f19cd54ca29ff8bb17b2f7abb7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:41.872946 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 951bc38e637242429f4d8415582fa5dc (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:41.875352 18240 tablet_service.cc:1511] Processing CreateTablet for tablet 4b19233b689b4661a029f09f617dd4b7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:41.877795 18239 tablet_service.cc:1511] Processing CreateTablet for tablet 41c7cf1efa6d4c26b013079c0cfeb2c5 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:41.880160 18238 tablet_service.cc:1511] Processing CreateTablet for tablet 227d050c5ac14865954c8c8dce1cfe86 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:41.880224 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a6d9f19cd54ca29ff8bb17b2f7abb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.882311 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951bc38e637242429f4d8415582fa5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.882975 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b19233b689b4661a029f09f617dd4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.885020 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c7cf1efa6d4c26b013079c0cfeb2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.888154 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d050c5ac14865954c8c8dce1cfe86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.895599 18237 tablet_service.cc:1511] Processing CreateTablet for tablet b8918d3a188f4572af4b584b200ba410 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:41.897359 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8918d3a188f4572af4b584b200ba410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.910442 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 26ca0113f4654093a3524c8198661196 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:41.912011 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ca0113f4654093a3524c8198661196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.917352 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2bb64614fc44ec9c9f2a6691cdd1e0 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:41.919054 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2bb64614fc44ec9c9f2a6691cdd1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.921082 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 481e9aa796fa47f5b94531ca8587c3c5 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:41.922885 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481e9aa796fa47f5b94531ca8587c3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.926291 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 26ca0113f4654093a3524c8198661196 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:41.926640 18012 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2bb64614fc44ec9c9f2a6691cdd1e0 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:41.927850 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ca0113f4654093a3524c8198661196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.928936 18011 tablet_service.cc:1511] Processing CreateTablet for tablet 802d97ba13fe467c87385eae6fe54a02 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:41.930723 18011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802d97ba13fe467c87385eae6fe54a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.932379 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2bb64614fc44ec9c9f2a6691cdd1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.945653 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 77a6d9f19cd54ca29ff8bb17b2f7abb7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:41.947163 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a6d9f19cd54ca29ff8bb17b2f7abb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.948199 18233 tablet_service.cc:1511] Processing CreateTablet for tablet 9163e7694071456bb2b68a6858e44443 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:41.948899 18092 tablet_service.cc:1511] Processing CreateTablet for tablet 4b19233b689b4661a029f09f617dd4b7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:41.949687 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9163e7694071456bb2b68a6858e44443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.950891 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b19233b689b4661a029f09f617dd4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.951478 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 3879a0395b8c47ee82b8d483717aacd7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:41.952875 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879a0395b8c47ee82b8d483717aacd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.957036 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 0918ff57517a4193add2df7b454631f8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:41.957871 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 9163e7694071456bb2b68a6858e44443 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:41.958709 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0918ff57517a4193add2df7b454631f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.959237 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9163e7694071456bb2b68a6858e44443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.960903 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 481e9aa796fa47f5b94531ca8587c3c5 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:41.962261 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481e9aa796fa47f5b94531ca8587c3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.966748 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 802d97ba13fe467c87385eae6fe54a02 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:41.968381 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802d97ba13fe467c87385eae6fe54a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:41.970396 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 41c7cf1efa6d4c26b013079c0cfeb2c5 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:41.974193 18089 tablet_service.cc:1511] Processing CreateTablet for tablet b8918d3a188f4572af4b584b200ba410 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:41.976485 18093 tablet_service.cc:1511] Processing CreateTablet for tablet 675aa5689d904979a3aaa90534d93385 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:41.978777 18087 tablet_service.cc:1511] Processing CreateTablet for tablet 26ca0113f4654093a3524c8198661196 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:41.996344 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 0e90ea9c973f4fcdbbd047a3346e4639 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:41.998076 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e90ea9c973f4fcdbbd047a3346e4639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.001928 18018 tablet_service.cc:1511] Processing CreateTablet for tablet 0918ff57517a4193add2df7b454631f8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:42.003489 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0918ff57517a4193add2df7b454631f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.005803 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c7cf1efa6d4c26b013079c0cfeb2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.005724 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 698a6a9993674b4eae04bad2efa5485f (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:42.028366 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698a6a9993674b4eae04bad2efa5485f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.024811 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 1380a01d5ea6449a8d7cf0fef7a4bf60 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:42.033169 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1380a01d5ea6449a8d7cf0fef7a4bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.036368 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675aa5689d904979a3aaa90534d93385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.013350 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 55a427d8aa884b3f98202c983c1292ab (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:42.049078 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8918d3a188f4572af4b584b200ba410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.047478 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 55a427d8aa884b3f98202c983c1292ab (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:42.050000 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ca0113f4654093a3524c8198661196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.050892 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a427d8aa884b3f98202c983c1292ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.058784 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a427d8aa884b3f98202c983c1292ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.059103 18297 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:42.062351 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:42.060386 18298 tablet_bootstrap.cc:492] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:42.067873 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec6c104c96c43e5848ec45b8cf9c36d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:42.069597 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec6c104c96c43e5848ec45b8cf9c36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.070140 18298 tablet_bootstrap.cc:654] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.083844 18238 tablet_service.cc:1511] Processing CreateTablet for tablet 13c71a8d73a841e5840ba9d18aba7b58 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:42.084368 18241 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec6c104c96c43e5848ec45b8cf9c36d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:42.085381 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c71a8d73a841e5840ba9d18aba7b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.087211 18297 tablet_bootstrap.cc:654] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.088891 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 2f57aae4fb06403aaac8a835763ff266 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:42.089493 18233 tablet_service.cc:1511] Processing CreateTablet for tablet c712025f0c334b2ea7f26a97e97c347b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:42.090878 18166 tablet_service.cc:1511] Processing CreateTablet for tablet 4b19233b689b4661a029f09f617dd4b7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:42.099823 18162 tablet_service.cc:1511] Processing CreateTablet for tablet 0918ff57517a4193add2df7b454631f8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:42.099978 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 951bc38e637242429f4d8415582fa5dc (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:42.102969 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b19233b689b4661a029f09f617dd4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.104372 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 227d050c5ac14865954c8c8dce1cfe86 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:42.105907 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d050c5ac14865954c8c8dce1cfe86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.107901 18161 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2bb64614fc44ec9c9f2a6691cdd1e0 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:42.103156 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 3879a0395b8c47ee82b8d483717aacd7 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:42.092940 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 675aa5689d904979a3aaa90534d93385 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:42.110363 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951bc38e637242429f4d8415582fa5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.092986 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 481e9aa796fa47f5b94531ca8587c3c5 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:42.111909 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481e9aa796fa47f5b94531ca8587c3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.108970 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 802d97ba13fe467c87385eae6fe54a02 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:42.113451 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675aa5689d904979a3aaa90534d93385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.114506 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0918ff57517a4193add2df7b454631f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.115998 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802d97ba13fe467c87385eae6fe54a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.100804 18163 tablet_service.cc:1511] Processing CreateTablet for tablet b8918d3a188f4572af4b584b200ba410 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:42.117237 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2bb64614fc44ec9c9f2a6691cdd1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.120055 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8918d3a188f4572af4b584b200ba410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.120409 18239 tablet_service.cc:1511] Processing CreateTablet for tablet 698a6a9993674b4eae04bad2efa5485f (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:42.121004 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879a0395b8c47ee82b8d483717aacd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.130002 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 1db0037842d34ab783fcba2d367d98eb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:42.133332 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 2f57aae4fb06403aaac8a835763ff266 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:42.107548 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 47fc415ccc6740a7ab53f700cb2a82c8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:42.145031 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fc415ccc6740a7ab53f700cb2a82c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.165158 18300 tablet_bootstrap.cc:492] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:42.166194 18092 tablet_service.cc:1511] Processing CreateTablet for tablet 9163e7694071456bb2b68a6858e44443 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:42.167658 18092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9163e7694071456bb2b68a6858e44443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.169020 18241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec6c104c96c43e5848ec45b8cf9c36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.176535 18013 tablet_service.cc:1511] Processing CreateTablet for tablet c712025f0c334b2ea7f26a97e97c347b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:42.177381 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 13c71a8d73a841e5840ba9d18aba7b58 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:42.181198 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 0e90ea9c973f4fcdbbd047a3346e4639 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:42.186757 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 1db0037842d34ab783fcba2d367d98eb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:42.201565 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db0037842d34ab783fcba2d367d98eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.203337 18300 tablet_bootstrap.cc:654] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.206418 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c71a8d73a841e5840ba9d18aba7b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.207419 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db0037842d34ab783fcba2d367d98eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.209432 18298 tablet_bootstrap.cc:492] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:42.210018 18298 ts_tablet_manager.cc:1403] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.011s
I20260709 13:19:42.209842 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 1380a01d5ea6449a8d7cf0fef7a4bf60 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:42.211232 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1380a01d5ea6449a8d7cf0fef7a4bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.212181 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c712025f0c334b2ea7f26a97e97c347b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.214689 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e90ea9c973f4fcdbbd047a3346e4639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.216197 18089 tablet_service.cc:1511] Processing CreateTablet for tablet c712025f0c334b2ea7f26a97e97c347b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:42.187207 18093 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec6c104c96c43e5848ec45b8cf9c36d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:42.190903 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f57aae4fb06403aaac8a835763ff266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.220136 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c712025f0c334b2ea7f26a97e97c347b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.228053 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f57aae4fb06403aaac8a835763ff266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.231997 18298 raft_consensus.cc:359] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:42.232843 18298 raft_consensus.cc:385] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.233147 18298 raft_consensus.cc:740] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.244167 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c712025f0c334b2ea7f26a97e97c347b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.246102 18093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec6c104c96c43e5848ec45b8cf9c36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.247676 18235 tablet_service.cc:1511] Processing CreateTablet for tablet a659b113eca540428fc23a797373191e (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:42.249231 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab3b20d1eec4e5c93ec3223184a53d3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:42.263384 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698a6a9993674b4eae04bad2efa5485f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.264268 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab3b20d1eec4e5c93ec3223184a53d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.268247 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a659b113eca540428fc23a797373191e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.289474 18054 heartbeater.cc:499] Master 127.8.186.254:34083 was elected leader, sending a full tablet report...
I20260709 13:19:42.300467 18019 tablet_service.cc:1511] Processing CreateTablet for tablet a659b113eca540428fc23a797373191e (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:42.303390 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a659b113eca540428fc23a797373191e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.291163 18298 consensus_queue.cc:260] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:42.300348 18297 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:42.313676 18297 ts_tablet_manager.cc:1403] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.255s	user 0.003s	sys 0.014s
I20260709 13:19:42.324561 18161 tablet_service.cc:1511] Processing CreateTablet for tablet 0e90ea9c973f4fcdbbd047a3346e4639 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:42.327287 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 13c71a8d73a841e5840ba9d18aba7b58 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:42.344585 18303 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:42.345188 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e90ea9c973f4fcdbbd047a3346e4639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.364464 18300 tablet_bootstrap.cc:492] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:42.365195 18300 ts_tablet_manager.cc:1403] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.200s	user 0.017s	sys 0.011s
I20260709 13:19:42.365681 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 8a20b2a9b6fc418eaebac50b17ddee1b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:42.367218 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a20b2a9b6fc418eaebac50b17ddee1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.368940 18300 raft_consensus.cc:359] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:42.369771 18300 raft_consensus.cc:385] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.370096 18300 raft_consensus.cc:740] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.370857 18300 consensus_queue.cc:260] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:42.376171 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 698a6a9993674b4eae04bad2efa5485f (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:42.377538 18129 heartbeater.cc:499] Master 127.8.186.254:34083 was elected leader, sending a full tablet report...
I20260709 13:19:42.376247 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c71a8d73a841e5840ba9d18aba7b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.384553 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698a6a9993674b4eae04bad2efa5485f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.381131 18240 tablet_service.cc:1511] Processing CreateTablet for tablet 8a20b2a9b6fc418eaebac50b17ddee1b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:42.388738 18167 tablet_service.cc:1511] Processing CreateTablet for tablet 55a427d8aa884b3f98202c983c1292ab (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:42.392235 18277 heartbeater.cc:499] Master 127.8.186.254:34083 was elected leader, sending a full tablet report...
I20260709 13:19:42.404277 18237 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab14946ec96453d983b98de84b5a104 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:42.369577 18162 tablet_service.cc:1511] Processing CreateTablet for tablet 1380a01d5ea6449a8d7cf0fef7a4bf60 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:42.406467 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a427d8aa884b3f98202c983c1292ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.411193 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1380a01d5ea6449a8d7cf0fef7a4bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.400388 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a20b2a9b6fc418eaebac50b17ddee1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.413545 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab14946ec96453d983b98de84b5a104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.409148 18018 tablet_service.cc:1511] Processing CreateTablet for tablet e5e40c116d0e4d4a9c87a0a4c8daf709 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:42.414708 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e40c116d0e4d4a9c87a0a4c8daf709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.415994 18304 raft_consensus.cc:493] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.397306 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab3b20d1eec4e5c93ec3223184a53d3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:42.416558 18304 raft_consensus.cc:515] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:42.417587 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab3b20d1eec4e5c93ec3223184a53d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.421232 18233 tablet_service.cc:1511] Processing CreateTablet for tablet 27094133c5bd4d54ae86e99d83396dec (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:42.422623 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27094133c5bd4d54ae86e99d83396dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.425980 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 47fc415ccc6740a7ab53f700cb2a82c8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:42.429718 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 1db0037842d34ab783fcba2d367d98eb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:42.445851 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fc415ccc6740a7ab53f700cb2a82c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.447597 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db0037842d34ab783fcba2d367d98eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.460125 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 27094133c5bd4d54ae86e99d83396dec (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:42.461510 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27094133c5bd4d54ae86e99d83396dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.464995 18300 ts_tablet_manager.cc:1434] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.099s	user 0.011s	sys 0.003s
I20260709 13:19:42.456138 18298 ts_tablet_manager.cc:1434] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.246s	user 0.021s	sys 0.004s
I20260709 13:19:42.473839 18203 heartbeater.cc:499] Master 127.8.186.254:34083 was elected leader, sending a full tablet report...
I20260709 13:19:42.478397 18297 raft_consensus.cc:359] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:42.482503 18297 raft_consensus.cc:385] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.482831 18297 raft_consensus.cc:740] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.485925 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab3b20d1eec4e5c93ec3223184a53d3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:42.487309 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab3b20d1eec4e5c93ec3223184a53d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.439684 18168 tablet_service.cc:1511] Processing CreateTablet for tablet 2f57aae4fb06403aaac8a835763ff266 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:42.488883 18298 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:42.487591 18297 consensus_queue.cc:260] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:42.490923 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab14946ec96453d983b98de84b5a104 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:42.467628 18085 tablet_service.cc:1511] Processing CreateTablet for tablet a659b113eca540428fc23a797373191e (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:42.492908 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a659b113eca540428fc23a797373191e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.493307 18087 tablet_service.cc:1511] Processing CreateTablet for tablet e5e40c116d0e4d4a9c87a0a4c8daf709 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:42.494544 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e40c116d0e4d4a9c87a0a4c8daf709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.496739 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab14946ec96453d983b98de84b5a104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.504317 18303 tablet_bootstrap.cc:654] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.489153 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f57aae4fb06403aaac8a835763ff266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.504559 18166 tablet_service.cc:1511] Processing CreateTablet for tablet 47fc415ccc6740a7ab53f700cb2a82c8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:42.519035 18304 leader_election.cc:290] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:42.523624 18300 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:42.547881 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 27094133c5bd4d54ae86e99d83396dec (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:42.549358 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27094133c5bd4d54ae86e99d83396dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.517629 18163 tablet_service.cc:1511] Processing CreateTablet for tablet 8a20b2a9b6fc418eaebac50b17ddee1b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:42.561313 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fc415ccc6740a7ab53f700cb2a82c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.562192 18297 ts_tablet_manager.cc:1434] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.241s	user 0.011s	sys 0.006s
W20260709 13:19:42.563004 18278 tablet.cc:2406] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:42.563511 18297 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:42.564538 18303 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:42.612483 18019 tablet_service.cc:1511] Processing CreateTablet for tablet f72264469fd94db8b68aa30adcacd8c8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:42.613993 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72264469fd94db8b68aa30adcacd8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.613132 18300 tablet_bootstrap.cc:654] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.575734 18010 tablet_service.cc:1511] Processing CreateTablet for tablet a010bb50f906431fa93244db273529cb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:42.570174 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a20b2a9b6fc418eaebac50b17ddee1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.617178 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a010bb50f906431fa93244db273529cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.576800 18242 tablet_service.cc:1511] Processing CreateTablet for tablet a010bb50f906431fa93244db273529cb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:42.619592 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a010bb50f906431fa93244db273529cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.590763 18088 tablet_service.cc:1511] Processing CreateTablet for tablet c950171fa2384c128706fe4e1cc5c562 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:42.624678 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c950171fa2384c128706fe4e1cc5c562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.638080 18239 tablet_service.cc:1511] Processing CreateTablet for tablet c950171fa2384c128706fe4e1cc5c562 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:42.639539 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c950171fa2384c128706fe4e1cc5c562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.594317 18167 tablet_service.cc:1511] Processing CreateTablet for tablet e5e40c116d0e4d4a9c87a0a4c8daf709 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:42.586905 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab14946ec96453d983b98de84b5a104 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:42.640703 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab14946ec96453d983b98de84b5a104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.642877 18086 tablet_service.cc:1511] Processing CreateTablet for tablet f72264469fd94db8b68aa30adcacd8c8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:42.644656 18167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e40c116d0e4d4a9c87a0a4c8daf709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.602487 18165 tablet_service.cc:1511] Processing CreateTablet for tablet a010bb50f906431fa93244db273529cb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:42.650960 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a010bb50f906431fa93244db273529cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.598498 18297 tablet_bootstrap.cc:654] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.578308 18298 tablet_bootstrap.cc:654] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.612587 18303 ts_tablet_manager.cc:1403] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.291s	user 0.015s	sys 0.007s
I20260709 13:19:42.665346 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 70fc24e67dd34b168bc7110e7b8bdfa3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:42.668748 18165 tablet_service.cc:1511] Processing CreateTablet for tablet c950171fa2384c128706fe4e1cc5c562 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:42.669041 18236 tablet_service.cc:1511] Processing CreateTablet for tablet 70fc24e67dd34b168bc7110e7b8bdfa3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:42.670182 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c950171fa2384c128706fe4e1cc5c562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.670502 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fc24e67dd34b168bc7110e7b8bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.671413 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72264469fd94db8b68aa30adcacd8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.663488 18303 raft_consensus.cc:359] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:42.695310 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:42.699529 18215 leader_election.cc:343] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.700030 18306 raft_consensus.cc:493] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.700531 18306 raft_consensus.cc:515] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:42.703100 18306 leader_election.cc:290] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:42.697124 18303 raft_consensus.cc:385] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.710678 18303 raft_consensus.cc:740] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.711508 18303 consensus_queue.cc:260] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:42.696659 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 70fc24e67dd34b168bc7110e7b8bdfa3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:42.722265 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fc24e67dd34b168bc7110e7b8bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.724896 18309 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.725483 18309 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:42.725976 18237 tablet_service.cc:1511] Processing CreateTablet for tablet 479841006f754b57b85acab5b257c912 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:42.727723 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479841006f754b57b85acab5b257c912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.751725 18300 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:42.752633 18300 ts_tablet_manager.cc:1403] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.229s	user 0.046s	sys 0.015s
I20260709 13:19:42.756201 18300 raft_consensus.cc:359] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:42.745687 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fc24e67dd34b168bc7110e7b8bdfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.762720 18300 raft_consensus.cc:385] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.772433 18303 ts_tablet_manager.cc:1434] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.112s	user 0.018s	sys 0.003s
I20260709 13:19:42.773593 18303 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:42.775484 18091 tablet_service.cc:1511] Processing CreateTablet for tablet a88eab1bc51e48fc9f75286f06f31b2d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:42.775655 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 479841006f754b57b85acab5b257c912 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:42.780040 18303 tablet_bootstrap.cc:654] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.780485 18298 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:42.781045 18298 ts_tablet_manager.cc:1403] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.292s	user 0.009s	sys 0.010s
I20260709 13:19:42.781993 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479841006f754b57b85acab5b257c912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.784058 18298 raft_consensus.cc:359] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:42.787022 18298 raft_consensus.cc:385] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.787665 18298 raft_consensus.cc:740] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.789419 18298 consensus_queue.cc:260] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:42.791179 18309 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:42.773186 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 479841006f754b57b85acab5b257c912 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:42.810264 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88eab1bc51e48fc9f75286f06f31b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.810984 18235 tablet_service.cc:1511] Processing CreateTablet for tablet a88eab1bc51e48fc9f75286f06f31b2d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:42.812855 18159 tablet_service.cc:1511] Processing CreateTablet for tablet a88eab1bc51e48fc9f75286f06f31b2d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:42.793414 18300 raft_consensus.cc:740] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.814245 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88eab1bc51e48fc9f75286f06f31b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.815388 18304 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.815954 18304 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:42.816541 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88eab1bc51e48fc9f75286f06f31b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.818379 18304 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:42.814323 18300 consensus_queue.cc:260] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:42.822104 18300 ts_tablet_manager.cc:1434] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:19:42.823215 18300 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:42.769122 18168 tablet_service.cc:1511] Processing CreateTablet for tablet f72264469fd94db8b68aa30adcacd8c8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:42.831120 18168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72264469fd94db8b68aa30adcacd8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.830929 18018 tablet_service.cc:1511] Processing CreateTablet for tablet 0088d5969b0d4183886e26ed2654e034 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:42.815392 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479841006f754b57b85acab5b257c912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.836864 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:42.838477 18215 leader_election.cc:343] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.848839 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 0088d5969b0d4183886e26ed2654e034 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:42.849443 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:42.850333 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0088d5969b0d4183886e26ed2654e034. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:42.851270 18070 leader_election.cc:343] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.855036 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:42.857295 18217 leader_election.cc:343] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.857894 18217 leader_election.cc:304] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:42.859402 18304 raft_consensus.cc:2749] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:42.885952 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0088d5969b0d4183886e26ed2654e034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.893771 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 926766f358784880a482cc7ea6052052 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:42.898248 18298 ts_tablet_manager.cc:1434] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:19:42.899027 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:42.901961 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 926766f358784880a482cc7ea6052052 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:42.903293 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926766f358784880a482cc7ea6052052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.904913 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926766f358784880a482cc7ea6052052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.905894 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 926766f358784880a482cc7ea6052052 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:19:42.876046 17911 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 92129.3us
I20260709 13:19:42.922655 18163 tablet_service.cc:1511] Processing CreateTablet for tablet 168fed5754ae48c19312ea4a2fa2c5ed (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:42.924077 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168fed5754ae48c19312ea4a2fa2c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.924188 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926766f358784880a482cc7ea6052052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.930233 18300 tablet_bootstrap.cc:654] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.945657 18240 tablet_service.cc:1511] Processing CreateTablet for tablet 168fed5754ae48c19312ea4a2fa2c5ed (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:42.947166 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168fed5754ae48c19312ea4a2fa2c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.949633 18306 raft_consensus.cc:493] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.950183 18306 raft_consensus.cc:515] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:42.952713 18306 leader_election.cc:290] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:42.958158 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 0088d5969b0d4183886e26ed2654e034 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:42.964650 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:42.964630 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 168fed5754ae48c19312ea4a2fa2c5ed (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:42.965896 18297 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:42.966344 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168fed5754ae48c19312ea4a2fa2c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.966511 18297 ts_tablet_manager.cc:1403] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.403s	user 0.045s	sys 0.038s
W20260709 13:19:42.966756 17995 leader_election.cc:343] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.937248 18298 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:42.973831 18085 tablet_service.cc:1511] Processing CreateTablet for tablet f0c73929e277490a8d8e29869c87f676 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:42.975263 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c73929e277490a8d8e29869c87f676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.977006 18233 tablet_service.cc:1511] Processing CreateTablet for tablet f0c73929e277490a8d8e29869c87f676 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:42.979285 18164 tablet_service.cc:1511] Processing CreateTablet for tablet f0c73929e277490a8d8e29869c87f676 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:19:42.970019 18067 leader_election.cc:343] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.984192 18067 leader_election.cc:304] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:42.985636 18306 raft_consensus.cc:2749] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:42.987039 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c73929e277490a8d8e29869c87f676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.986789 18297 raft_consensus.cc:359] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:42.988116 18297 raft_consensus.cc:385] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.988410 18297 raft_consensus.cc:740] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.989244 18297 consensus_queue.cc:260] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:42.999863 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 62389.9us
I20260709 13:19:43.001816 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:43.006207 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:43.007632 18067 leader_election.cc:343] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:43.008600 17994 leader_election.cc:343] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.009063 17994 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:43.010246 18309 raft_consensus.cc:2749] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.014305 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.015995 18297 ts_tablet_manager.cc:1434] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 13:19:42.967404 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0088d5969b0d4183886e26ed2654e034. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:43.023615 18218 leader_election.cc:343] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.024173 18218 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.025043 18304 raft_consensus.cc:2749] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.027076 18297 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:43.029482 18018 tablet_service.cc:1511] Processing CreateTablet for tablet 98540bdb13d84727be4be8cd6b851140 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:43.030660 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c73929e277490a8d8e29869c87f676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.032755 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98540bdb13d84727be4be8cd6b851140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.034773 18297 tablet_bootstrap.cc:654] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.041159 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 98540bdb13d84727be4be8cd6b851140 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:43.042573 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98540bdb13d84727be4be8cd6b851140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.045365 18303 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:43.045997 18303 ts_tablet_manager.cc:1403] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.273s	user 0.020s	sys 0.020s
I20260709 13:19:43.054710 18300 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:43.055411 18300 ts_tablet_manager.cc:1403] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.232s	user 0.010s	sys 0.005s
I20260709 13:19:43.057293 18298 tablet_bootstrap.cc:654] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.061537 18300 raft_consensus.cc:359] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.063242 18300 raft_consensus.cc:385] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:43.065387 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:43.069259 18303 raft_consensus.cc:359] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.070065 18303 raft_consensus.cc:385] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.070344 18303 raft_consensus.cc:740] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.071077 18303 consensus_queue.cc:260] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.074820 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 98540bdb13d84727be4be8cd6b851140 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:43.080220 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98540bdb13d84727be4be8cd6b851140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.081370 18303 ts_tablet_manager.cc:1434] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:19:43.067229 18300 raft_consensus.cc:740] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.075199 18233 tablet_service.cc:1511] Processing CreateTablet for tablet b44da0a6da3147d694f8909e41b70aa8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:43.082463 18303 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:43.082613 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44da0a6da3147d694f8909e41b70aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.082296 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:43.084649 18070 leader_election.cc:343] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.085156 18070 leader_election.cc:304] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.086553 18306 raft_consensus.cc:2749] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.090873 18091 tablet_service.cc:1511] Processing CreateTablet for tablet b44da0a6da3147d694f8909e41b70aa8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:43.092322 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44da0a6da3147d694f8909e41b70aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.088061 18300 consensus_queue.cc:260] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.100703 18298 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:43.101305 18298 ts_tablet_manager.cc:1403] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.008s
I20260709 13:19:43.105542 18159 tablet_service.cc:1511] Processing CreateTablet for tablet a1412fa1b14f40fea87fb6a4cf76931d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:43.107191 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1412fa1b14f40fea87fb6a4cf76931d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.111531 18306 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.112993 18306 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.115335 18306 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.115447 18300 ts_tablet_manager.cc:1434] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:19:43.116688 18300 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:43.116564 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:43.116828 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:43.118218 18070 leader_election.cc:343] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.118297 18029 raft_consensus.cc:2468] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:43.119959 18070 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc
I20260709 13:19:43.120064 18019 tablet_service.cc:1511] Processing CreateTablet for tablet b44da0a6da3147d694f8909e41b70aa8 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:43.121424 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b44da0a6da3147d694f8909e41b70aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.123031 18306 raft_consensus.cc:2804] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.123550 18306 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.123947 18306 raft_consensus.cc:3060] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.124504 18298 raft_consensus.cc:359] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.125326 18298 raft_consensus.cc:385] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.125664 18298 raft_consensus.cc:740] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.126546 18298 consensus_queue.cc:260] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.128921 18298 ts_tablet_manager.cc:1434] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:19:43.123260 18303 tablet_bootstrap.cc:654] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.136291 18300 tablet_bootstrap.cc:654] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.137544 18298 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:43.148129 18298 tablet_bootstrap.cc:654] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.149526 18303 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:43.150094 18303 ts_tablet_manager.cc:1403] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.009s
I20260709 13:19:43.151444 18233 tablet_service.cc:1511] Processing CreateTablet for tablet a1412fa1b14f40fea87fb6a4cf76931d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:43.152874 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1412fa1b14f40fea87fb6a4cf76931d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.153256 18303 raft_consensus.cc:359] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.154049 18303 raft_consensus.cc:385] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.154347 18303 raft_consensus.cc:740] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.154573 18018 tablet_service.cc:1511] Processing CreateTablet for tablet a1412fa1b14f40fea87fb6a4cf76931d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:43.155983 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1412fa1b14f40fea87fb6a4cf76931d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.155251 18303 consensus_queue.cc:260] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.162544 18303 ts_tablet_manager.cc:1434] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:19:43.164951 18300 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:43.165690 18300 ts_tablet_manager.cc:1403] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
I20260709 13:19:43.166458 18303 tablet_bootstrap.cc:492] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:43.170578 18300 raft_consensus.cc:359] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.171196 18317 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.171509 18300 raft_consensus.cc:385] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.171916 18317 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.177686 18317 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.182785 18297 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:43.183367 18306 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.185233 18303 tablet_bootstrap.cc:654] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.186800 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:43.183422 18297 ts_tablet_manager.cc:1403] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.037s
W20260709 13:19:43.188567 18070 leader_election.cc:343] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.191193 18297 raft_consensus.cc:359] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.192039 18297 raft_consensus.cc:385] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.192354 18297 raft_consensus.cc:740] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.193300 18297 consensus_queue.cc:260] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.171948 18300 raft_consensus.cc:740] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.202903 18300 consensus_queue.cc:260] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.203353 18297 ts_tablet_manager.cc:1434] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:19:43.207590 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 45716870c722497db3b6cad734aa0a5b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:43.216719 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 45716870c722497db3b6cad734aa0a5b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:43.217521 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 45716870c722497db3b6cad734aa0a5b (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:43.217825 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:43.218178 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45716870c722497db3b6cad734aa0a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.218668 18029 raft_consensus.cc:3060] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.220659 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45716870c722497db3b6cad734aa0a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.218832 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45716870c722497db3b6cad734aa0a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.229099 18303 tablet_bootstrap.cc:492] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:43.229676 18303 ts_tablet_manager.cc:1403] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.001s
I20260709 13:19:43.232730 18303 raft_consensus.cc:359] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:43.233482 18303 raft_consensus.cc:385] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.233780 18303 raft_consensus.cc:740] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.232892 18298 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:43.239197 18298 ts_tablet_manager.cc:1403] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.040s
I20260709 13:19:43.239645 18297 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:43.241216 18240 tablet_service.cc:1511] Processing CreateTablet for tablet f13a5a37e724480ebc62f12966c08386 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:43.242641 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13a5a37e724480ebc62f12966c08386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.242332 18298 raft_consensus.cc:359] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.243111 18298 raft_consensus.cc:385] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.242856 18018 tablet_service.cc:1511] Processing CreateTablet for tablet f3de96e0eff148aa92357ccf945a3a9d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:43.259814 18298 raft_consensus.cc:740] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.249812 18303 consensus_queue.cc:260] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:43.261395 18317 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.238981 18306 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.261734 18298 consensus_queue.cc:260] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.261911 18317 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.262300 18019 tablet_service.cc:1511] Processing CreateTablet for tablet f13a5a37e724480ebc62f12966c08386 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:43.250260 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:43.264204 18317 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
W20260709 13:19:43.266155 18144 leader_election.cc:343] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.263664 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13a5a37e724480ebc62f12966c08386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.239037 18088 tablet_service.cc:1511] Processing CreateTablet for tablet f3de96e0eff148aa92357ccf945a3a9d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:43.246765 18159 tablet_service.cc:1511] Processing CreateTablet for tablet f3de96e0eff148aa92357ccf945a3a9d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:43.273396 18298 ts_tablet_manager.cc:1434] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.016s
I20260709 13:19:43.274052 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3de96e0eff148aa92357ccf945a3a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.274565 18298 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:43.276117 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:43.276840 18252 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:43.271688 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3de96e0eff148aa92357ccf945a3a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.278604 18094 tablet_service.cc:1511] Processing CreateTablet for tablet f13a5a37e724480ebc62f12966c08386 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:43.282550 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13a5a37e724480ebc62f12966c08386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.280273 18317 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.283077 18317 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.280632 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3de96e0eff148aa92357ccf945a3a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.284590 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 4511aae3d2a140fc8941166745d82fe3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:43.285559 18317 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:43.281522 18303 ts_tablet_manager.cc:1434] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.052s	user 0.001s	sys 0.011s
I20260709 13:19:43.241704 18029 raft_consensus.cc:2468] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:43.286476 18144 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:43.288760 18317 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.289295 18317 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.289705 18317 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.287911 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4511aae3d2a140fc8941166745d82fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.292497 18298 tablet_bootstrap.cc:654] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.293771 18070 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc
I20260709 13:19:43.295089 18306 raft_consensus.cc:2804] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.295557 18309 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.296229 18309 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.300246 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:43.300995 18104 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:43.302765 18309 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:43.307514 17994 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:43.308800 18309 raft_consensus.cc:2804] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.311061 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.312215 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.313951 18027 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:43.315896 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 4511aae3d2a140fc8941166745d82fe3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:43.317628 18309 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.317417 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 348515f468ae48c3a679e082be5ba35d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:43.295642 18306 raft_consensus.cc:697] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:43.319182 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348515f468ae48c3a679e082be5ba35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.319938 18306 consensus_queue.cc:237] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:43.320518 18144 leader_election.cc:343] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.320849 18309 raft_consensus.cc:3060] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.321594 18144 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:43.321444 18165 tablet_service.cc:1511] Processing CreateTablet for tablet 348515f468ae48c3a679e082be5ba35d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:43.320020 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:43.322858 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348515f468ae48c3a679e082be5ba35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.323228 18178 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:43.317366 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4511aae3d2a140fc8941166745d82fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.324976 18304 raft_consensus.cc:493] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.328661 18304 raft_consensus.cc:515] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.329062 18233 tablet_service.cc:1511] Processing CreateTablet for tablet 4511aae3d2a140fc8941166745d82fe3 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:43.330578 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4511aae3d2a140fc8941166745d82fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.337728 18300 ts_tablet_manager.cc:1434] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.172s	user 0.011s	sys 0.002s
I20260709 13:19:43.337921 18239 tablet_service.cc:1511] Processing CreateTablet for tablet 348515f468ae48c3a679e082be5ba35d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:43.342238 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:43.334750 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.348152 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348515f468ae48c3a679e082be5ba35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.350356 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:43.350684 18217 leader_election.cc:343] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.352048 18016 tablet_service.cc:1511] Processing CreateTablet for tablet 2891e8255e0b4398a034d1bc7f353332 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:43.354259 18235 tablet_service.cc:1511] Processing CreateTablet for tablet f969e2d5e7334a5d9e4d21fe84cd0efb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:43.354511 18163 tablet_service.cc:1511] Processing CreateTablet for tablet 2891e8255e0b4398a034d1bc7f353332 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:19:43.360087 18218 leader_election.cc:343] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.360579 18218 leader_election.cc:304] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.361380 18016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2891e8255e0b4398a034d1bc7f353332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.334054 18303 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:43.348264 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 2891e8255e0b4398a034d1bc7f353332 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:43.363143 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2891e8255e0b4398a034d1bc7f353332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.364090 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f969e2d5e7334a5d9e4d21fe84cd0efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.330824 18304 leader_election.cc:290] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:43.335979 18297 tablet_bootstrap.cc:654] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.366340 18304 raft_consensus.cc:2749] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.360666 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2891e8255e0b4398a034d1bc7f353332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.373899 18300 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:43.377404 18015 tablet_service.cc:1511] Processing CreateTablet for tablet f969e2d5e7334a5d9e4d21fe84cd0efb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:43.378777 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f969e2d5e7334a5d9e4d21fe84cd0efb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:43.379822 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 58303.3us
I20260709 13:19:43.384830 18298 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:43.385363 18300 tablet_bootstrap.cc:654] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.385516 18298 ts_tablet_manager.cc:1403] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.013s
W20260709 13:19:43.398144 18144 leader_election.cc:343] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.399935 18144 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.400216 18303 tablet_bootstrap.cc:654] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.406347 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:43.407156 18104 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:43.406949 18086 tablet_service.cc:1511] Processing CreateTablet for tablet f969e2d5e7334a5d9e4d21fe84cd0efb (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:43.408371 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f969e2d5e7334a5d9e4d21fe84cd0efb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:43.404489 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 44450.2us
I20260709 13:19:43.416962 18317 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.419301 18317 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.396878 18298 raft_consensus.cc:359] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.428226 18298 raft_consensus.cc:385] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.430419 18298 raft_consensus.cc:740] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
W20260709 13:19:43.444283 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 48421.7us
I20260709 13:19:43.446455 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:43.447356 18252 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.443293 18317 raft_consensus.cc:2804] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.460487 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 549b6d4d69b644b7a7c5ec7b137eef7f (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:43.461971 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549b6d4d69b644b7a7c5ec7b137eef7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.462885 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 549b6d4d69b644b7a7c5ec7b137eef7f (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:43.464537 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549b6d4d69b644b7a7c5ec7b137eef7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.451397 18309 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.468881 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 549b6d4d69b644b7a7c5ec7b137eef7f (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:43.470489 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549b6d4d69b644b7a7c5ec7b137eef7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.436062 18298 consensus_queue.cc:260] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.472194 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:43.472429 18337 raft_consensus.cc:2749] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.473688 18309 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:43.476003 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:43.476641 18104 raft_consensus.cc:3060] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.459822 18317 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.490214 18298 ts_tablet_manager.cc:1434] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 13:19:43.491389 18298 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:43.492277 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:43.494294 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 39309f26ab25439e8503252118d584d0 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:43.494907 18297 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:43.495455 18297 ts_tablet_manager.cc:1403] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.256s	user 0.021s	sys 0.001s
I20260709 13:19:43.499812 18317 raft_consensus.cc:3060] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.501443 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 39309f26ab25439e8503252118d584d0 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:43.502907 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39309f26ab25439e8503252118d584d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.500476 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39309f26ab25439e8503252118d584d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.510144 18297 raft_consensus.cc:359] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.510989 18297 raft_consensus.cc:385] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.511313 18297 raft_consensus.cc:740] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.511945 18304 raft_consensus.cc:493] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.512480 18304 raft_consensus.cc:515] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.514663 18304 leader_election.cc:290] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.516909 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d050c5ac14865954c8c8dce1cfe86" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:43.519716 18215 leader_election.cc:343] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.520709 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d050c5ac14865954c8c8dce1cfe86" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.521461 18029 raft_consensus.cc:2468] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:43.523036 18218 leader_election.cc:304] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:43.502031 17927 catalog_manager.cc:5697] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.526922 18304 raft_consensus.cc:2804] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.535018 18304 raft_consensus.cc:493] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:43.537488 18144 leader_election.cc:343] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.554575 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae0e2b2834f4fc0bd95acb2401862ed (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:43.554912 18091 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae0e2b2834f4fc0bd95acb2401862ed (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:43.555959 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae0e2b2834f4fc0bd95acb2401862ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.556190 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae0e2b2834f4fc0bd95acb2401862ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.545184 18304 raft_consensus.cc:3060] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.576490 18303 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:43.577075 18303 ts_tablet_manager.cc:1403] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.011s
I20260709 13:19:43.574999 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 408437b0be3b484dae4ecaed1badf036 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:43.578349 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408437b0be3b484dae4ecaed1badf036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.578540 18298 tablet_bootstrap.cc:654] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.580950 18104 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:43.580556 18240 tablet_service.cc:1511] Processing CreateTablet for tablet 39309f26ab25439e8503252118d584d0 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:43.582243 17994 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:43.582979 18240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39309f26ab25439e8503252118d584d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.583201 18309 raft_consensus.cc:2804] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.591444 18303 raft_consensus.cc:359] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.592464 18303 raft_consensus.cc:385] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.592808 18303 raft_consensus.cc:740] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.539585 18297 consensus_queue.cc:260] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.597537 18252 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:43.599366 18144 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.600204 18303 consensus_queue.cc:260] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.600934 18337 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.609191 18337 raft_consensus.cc:697] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:43.610183 18337 consensus_queue.cc:237] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.617839 18309 raft_consensus.cc:697] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:43.619479 18346 raft_consensus.cc:493] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.620118 18346 raft_consensus.cc:515] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.622571 18346 leader_election.cc:290] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:43.614724 18300 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:43.627852 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:43.628741 18104 raft_consensus.cc:2468] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:43.631271 17994 leader_election.cc:304] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:43.634641 18317 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.636142 18178 raft_consensus.cc:2393] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:43.640616 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 1ae0e2b2834f4fc0bd95acb2401862ed (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:43.646713 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 408437b0be3b484dae4ecaed1badf036 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:43.648394 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408437b0be3b484dae4ecaed1badf036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.648808 18340 raft_consensus.cc:493] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.649338 18340 raft_consensus.cc:515] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:43.650882 18303 ts_tablet_manager.cc:1434] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.003s
I20260709 13:19:43.652204 18303 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:43.654039 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:43.654820 18252 raft_consensus.cc:2468] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:43.656104 18144 leader_election.cc:304] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:43.641922 18300 ts_tablet_manager.cc:1403] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.268s	user 0.017s	sys 0.018s
I20260709 13:19:43.668063 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ae0e2b2834f4fc0bd95acb2401862ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.668721 18348 raft_consensus.cc:2804] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.669167 18348 raft_consensus.cc:493] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.669546 18165 tablet_service.cc:1511] Processing CreateTablet for tablet c38e95faa660491da0ac409cbe606465 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:43.669498 18348 raft_consensus.cc:3060] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.671101 18165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38e95faa660491da0ac409cbe606465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.670086 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:43.672984 18143 leader_election.cc:343] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.651587 18340 leader_election.cc:290] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:43.675379 18340 raft_consensus.cc:2804] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.675781 18340 raft_consensus.cc:493] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.676115 18340 raft_consensus.cc:3060] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.676826 18317 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:43.680593 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:43.681553 18104 raft_consensus.cc:2393] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate e8fdca3eaa0547d08fd840005216e2da in this term.
I20260709 13:19:43.673085 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:43.683519 18178 raft_consensus.cc:2468] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:43.688306 18018 tablet_service.cc:1511] Processing CreateTablet for tablet c38e95faa660491da0ac409cbe606465 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:43.688977 18094 tablet_service.cc:1511] Processing CreateTablet for tablet 408437b0be3b484dae4ecaed1badf036 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:43.689744 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38e95faa660491da0ac409cbe606465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.690272 18094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408437b0be3b484dae4ecaed1badf036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.692796 18233 tablet_service.cc:1511] Processing CreateTablet for tablet c38e95faa660491da0ac409cbe606465 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:43.694093 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38e95faa660491da0ac409cbe606465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.616974 18304 raft_consensus.cc:515] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.621694 18309 consensus_queue.cc:237] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:43.712765 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 56766.8us
I20260709 13:19:43.722620 18160 tablet_service.cc:1511] Processing CreateTablet for tablet c7e89b6eefa04beea2f707a0208c3268 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:43.722999 18015 tablet_service.cc:1511] Processing CreateTablet for tablet 597550505a4d4924b3edf943e2dd4167 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:43.724090 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e89b6eefa04beea2f707a0208c3268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.724241 18015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597550505a4d4924b3edf943e2dd4167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.724548 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:43.735203 18298 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:43.735937 18298 ts_tablet_manager.cc:1403] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.245s	user 0.027s	sys 0.017s
I20260709 13:19:43.737743 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d050c5ac14865954c8c8dce1cfe86" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
W20260709 13:19:43.739372 18215 leader_election.cc:343] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.739506 18091 tablet_service.cc:1511] Processing CreateTablet for tablet c7e89b6eefa04beea2f707a0208c3268 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:43.740028 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d050c5ac14865954c8c8dce1cfe86" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:43.740654 18029 raft_consensus.cc:3060] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.741074 18091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e89b6eefa04beea2f707a0208c3268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.743080 18304 leader_election.cc:290] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.742350 18235 tablet_service.cc:1511] Processing CreateTablet for tablet c7e89b6eefa04beea2f707a0208c3268 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:43.747020 18298 raft_consensus.cc:359] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.751870 18298 raft_consensus.cc:385] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.752300 18298 raft_consensus.cc:740] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.752424 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e89b6eefa04beea2f707a0208c3268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.753486 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 597550505a4d4924b3edf943e2dd4167 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:43.753401 18298 consensus_queue.cc:260] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.750706 18304 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.754956 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597550505a4d4924b3edf943e2dd4167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.758152 18304 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:43.731415 18144 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.762131 18351 raft_consensus.cc:2749] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.747478 18303 tablet_bootstrap.cc:654] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.776592 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.777621 18027 raft_consensus.cc:2393] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 1: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
I20260709 13:19:43.779451 18297 ts_tablet_manager.cc:1434] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.284s	user 0.036s	sys 0.025s
I20260709 13:19:43.790926 18297 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:43.782833 18163 tablet_service.cc:1511] Processing CreateTablet for tablet 597550505a4d4924b3edf943e2dd4167 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:43.784320 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:43.742419 17925 catalog_manager.cc:5697] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.784987 18242 tablet_service.cc:1511] Processing CreateTablet for tablet 15af0e21890f4f18b1e124ce6ffdb689 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:43.787287 18300 raft_consensus.cc:359] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.785022 18304 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:43.780184 18298 ts_tablet_manager.cc:1434] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.010s
I20260709 13:19:43.794490 18018 tablet_service.cc:1511] Processing CreateTablet for tablet 15af0e21890f4f18b1e124ce6ffdb689 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:43.800874 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15af0e21890f4f18b1e124ce6ffdb689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.805756 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597550505a4d4924b3edf943e2dd4167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.795217 18340 raft_consensus.cc:515] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:43.800341 18300 raft_consensus.cc:385] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.820070 18090 tablet_service.cc:1511] Processing CreateTablet for tablet 15af0e21890f4f18b1e124ce6ffdb689 (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:43.821290 18298 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:43.830919 18090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15af0e21890f4f18b1e124ce6ffdb689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.824281 18217 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.825778 18340 leader_election.cc:290] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:43.817827 18348 raft_consensus.cc:515] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.776571 18029 raft_consensus.cc:2468] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:43.826087 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:43.827011 18252 raft_consensus.cc:3060] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:43.839614 18143 leader_election.cc:343] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.841372 18348 leader_election.cc:290] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:43.833930 18300 raft_consensus.cc:740] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.842510 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:43.843138 18178 raft_consensus.cc:3060] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.843005 18300 consensus_queue.cc:260] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.829902 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15af0e21890f4f18b1e124ce6ffdb689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.845527 18306 consensus_queue.cc:1048] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:43.828723 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:43.847425 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:43.859948 18104 raft_consensus.cc:3060] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.843288 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 35f2c770ec624cb48eb6dc2e7007437d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:43.848570 18218 leader_election.cc:304] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:43.848928 18297 tablet_bootstrap.cc:654] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.851357 18304 raft_consensus.cc:2749] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.868183 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f2c770ec624cb48eb6dc2e7007437d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.857384 18251 raft_consensus.cc:3060] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.882333 18233 tablet_service.cc:1511] Processing CreateTablet for tablet 35f2c770ec624cb48eb6dc2e7007437d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:43.883500 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f2c770ec624cb48eb6dc2e7007437d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.888821 18300 ts_tablet_manager.cc:1434] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.223s	user 0.012s	sys 0.000s
I20260709 13:19:43.890125 18300 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:43.875800 18304 raft_consensus.cc:2804] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.894176 18304 raft_consensus.cc:697] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:43.895161 18304 consensus_queue.cc:237] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.902609 18178 raft_consensus.cc:2468] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:43.904304 17992 leader_election.cc:304] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:43.905184 18348 raft_consensus.cc:2804] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.905689 18348 raft_consensus.cc:697] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:43.905911 18300 tablet_bootstrap.cc:654] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.907193 18104 raft_consensus.cc:2468] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:43.906908 18348 consensus_queue.cc:237] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:43.908695 18338 raft_consensus.cc:493] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.908846 18018 tablet_service.cc:1511] Processing CreateTablet for tablet 35f2c770ec624cb48eb6dc2e7007437d (DEFAULT_TABLE table=test-workload [id=6278d48a2f284318b3c7af8328ef8517]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:43.909242 18338 raft_consensus.cc:515] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.910053 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f2c770ec624cb48eb6dc2e7007437d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:43.911629 18338 leader_election.cc:290] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:43.914122 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a427d8aa884b3f98202c983c1292ab" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:43.886304 18306 consensus_queue.cc:1048] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:19:43.916491 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a427d8aa884b3f98202c983c1292ab" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:43.915812 18218 leader_election.cc:343] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.911397 17924 catalog_manager.cc:5697] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:43.930107 18215 leader_election.cc:343] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.932289 18215 leader_election.cc:304] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:43.932520 18303 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:43.933885 18303 ts_tablet_manager.cc:1403] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.282s	user 0.037s	sys 0.038s
I20260709 13:19:43.935284 18251 raft_consensus.cc:2468] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:43.936709 18144 leader_election.cc:304] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425
I20260709 13:19:43.937247 18303 raft_consensus.cc:359] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:43.937716 18340 raft_consensus.cc:2804] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.938407 18340 raft_consensus.cc:697] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:43.941335 18340 consensus_queue.cc:237] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:43.943879 18304 raft_consensus.cc:2749] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.938176 18303 raft_consensus.cc:385] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.951675 18303 raft_consensus.cc:740] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.984491 18298 tablet_bootstrap.cc:654] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.000440 18300 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.001044 18300 ts_tablet_manager.cc:1403] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.111s	user 0.021s	sys 0.004s
I20260709 13:19:44.004993 18300 raft_consensus.cc:359] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.005827 18300 raft_consensus.cc:385] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.006162 18300 raft_consensus.cc:740] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.006925 18300 consensus_queue.cc:260] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.010564 18303 consensus_queue.cc:260] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.018997 18297 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.019724 18297 ts_tablet_manager.cc:1403] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.229s	user 0.013s	sys 0.006s
I20260709 13:19:44.025713 18303 ts_tablet_manager.cc:1434] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.001s
I20260709 13:19:44.027410 18303 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.033406 18356 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.034093 18356 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.038295 18340 raft_consensus.cc:493] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.038544 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.038950 18340 raft_consensus.cc:515] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:44.040680 18070 leader_election.cc:343] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.038874 18356 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.047832 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.049875 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d050c5ac14865954c8c8dce1cfe86" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.041567 18340 leader_election.cc:290] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:44.049850 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d050c5ac14865954c8c8dce1cfe86" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
W20260709 13:19:44.051434 18067 leader_election.cc:343] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.050916 18027 raft_consensus.cc:2393] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:44.051832 18297 raft_consensus.cc:359] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.054487 18297 raft_consensus.cc:385] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.054811 18297 raft_consensus.cc:740] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.051975 18067 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.060423 18144 leader_election.cc:304] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.059821 17927 catalog_manager.cc:5697] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.064054 18340 raft_consensus.cc:3060] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.064714 17923 catalog_manager.cc:5697] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.061705 18300 ts_tablet_manager.cc:1434] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.060s	user 0.027s	sys 0.011s
W20260709 13:19:44.073156 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:44.076601 18300 tablet_bootstrap.cc:492] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.060333 18297 consensus_queue.cc:260] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.068125 18356 raft_consensus.cc:2749] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.084375 18348 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.087074 18348 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.088976 18340 raft_consensus.cc:2749] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.090296 18029 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.092137 18303 tablet_bootstrap.cc:654] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.095781 18297 ts_tablet_manager.cc:1434] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.002s
I20260709 13:19:44.096985 18297 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.103529 18298 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.103885 18300 tablet_bootstrap.cc:654] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.104194 18298 ts_tablet_manager.cc:1403] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.283s	user 0.032s	sys 0.030s
I20260709 13:19:44.104995 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.106990 18340 consensus_queue.cc:1048] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.117206 17926 catalog_manager.cc:5697] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.108719 18348 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.107545 18298 raft_consensus.cc:359] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.113030 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.123600 18252 raft_consensus.cc:2393] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:44.124503 18298 raft_consensus.cc:385] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.124874 18298 raft_consensus.cc:740] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.125645 18298 consensus_queue.cc:260] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.126998 17995 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.128247 18300 tablet_bootstrap.cc:492] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.128494 18298 ts_tablet_manager.cc:1434] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.005s
I20260709 13:19:44.128811 18300 ts_tablet_manager.cc:1403] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.001s
I20260709 13:19:44.129040 18348 raft_consensus.cc:2749] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.130146 18298 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.131477 18303 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.132093 18303 ts_tablet_manager.cc:1403] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.006s
I20260709 13:19:44.134804 18303 raft_consensus.cc:359] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.135360 18303 raft_consensus.cc:385] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.138718 18300 raft_consensus.cc:359] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.139539 18300 raft_consensus.cc:385] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.139904 18300 raft_consensus.cc:740] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.123677 18297 tablet_bootstrap.cc:654] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.141368 18298 tablet_bootstrap.cc:654] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.144063 18300 consensus_queue.cc:260] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.135558 18303 raft_consensus.cc:740] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.145413 18356 raft_consensus.cc:493] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.146039 18356 raft_consensus.cc:515] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.147539 18300 ts_tablet_manager.cc:1434] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:44.148486 18303 consensus_queue.cc:260] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.149926 18300 tablet_bootstrap.cc:492] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.150679 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0918ff57517a4193add2df7b454631f8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.151151 18303 ts_tablet_manager.cc:1434] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:19:44.151428 18178 raft_consensus.cc:2468] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:44.152352 18303 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.154695 18298 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.155272 18298 ts_tablet_manager.cc:1403] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.005s
I20260709 13:19:44.158216 18298 raft_consensus.cc:359] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.158943 18298 raft_consensus.cc:385] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.159078 18067 leader_election.cc:304] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:44.160104 18367 raft_consensus.cc:2804] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.160522 18367 raft_consensus.cc:493] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.160871 18367 raft_consensus.cc:3060] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.161732 18297 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.162305 18297 ts_tablet_manager.cc:1403] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.066s	user 0.004s	sys 0.011s
I20260709 13:19:44.165409 18297 raft_consensus.cc:359] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.166204 18300 tablet_bootstrap.cc:654] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.166337 18298 raft_consensus.cc:740] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.167282 18298 consensus_queue.cc:260] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.168817 18356 leader_election.cc:290] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.169480 18298 ts_tablet_manager.cc:1434] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:19:44.166157 18297 raft_consensus.cc:385] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.170063 18297 raft_consensus.cc:740] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.170790 18297 consensus_queue.cc:260] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.171551 18298 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.173202 18297 ts_tablet_manager.cc:1434] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:44.174247 18297 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.178665 18367 raft_consensus.cc:515] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.159354 18303 tablet_bootstrap.cc:654] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.181178 18298 tablet_bootstrap.cc:654] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.185473 18348 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.189563 18297 tablet_bootstrap.cc:654] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.189868 18348 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.193002 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.193810 18252 raft_consensus.cc:2468] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:44.195376 17995 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:44.196303 18309 raft_consensus.cc:2804] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.196696 18309 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.197077 18309 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.186460 18337 consensus_queue.cc:1048] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:19:44.198113 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.199229 18300 tablet_bootstrap.cc:492] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.199887 18300 ts_tablet_manager.cc:1403] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.007s
W20260709 13:19:44.199842 17994 leader_election.cc:343] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.203322 18298 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.203397 18300 raft_consensus.cc:359] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.204154 18298 ts_tablet_manager.cc:1403] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 13:19:44.204442 18300 raft_consensus.cc:385] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.204824 18300 raft_consensus.cc:740] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.205134 18309 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.206135 18348 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:44.207125 18298 raft_consensus.cc:359] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.207944 18298 raft_consensus.cc:385] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.208223 18298 raft_consensus.cc:740] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.208285 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:44.208971 18251 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.209059 18298 consensus_queue.cc:260] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.180428 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0918ff57517a4193add2df7b454631f8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.205703 18300 consensus_queue.cc:260] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.211550 18298 ts_tablet_manager.cc:1434] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:19:44.212451 18070 leader_election.cc:343] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.213119 18298 tablet_bootstrap.cc:492] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.220757 18251 raft_consensus.cc:2468] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:44.222054 17995 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:44.223026 18348 raft_consensus.cc:2804] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.215014 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0918ff57517a4193add2df7b454631f8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:44.217681 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0918ff57517a4193add2df7b454631f8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:44.213331 18367 leader_election.cc:290] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.225185 18178 raft_consensus.cc:3060] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.226964 18303 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.227512 18303 ts_tablet_manager.cc:1403] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.006s
I20260709 13:19:44.226861 18298 tablet_bootstrap.cc:654] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.225240 18300 ts_tablet_manager.cc:1434] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:19:44.237059 18178 raft_consensus.cc:2468] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:44.237849 18300 tablet_bootstrap.cc:492] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.239732 18303 raft_consensus.cc:359] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.241093 18303 raft_consensus.cc:385] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:44.241498 18070 leader_election.cc:343] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.242647 18309 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:44.241459 18303 raft_consensus.cc:740] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.244421 18303 consensus_queue.cc:260] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.245280 18297 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.245872 18297 ts_tablet_manager.cc:1403] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.000s
I20260709 13:19:44.246775 18303 ts_tablet_manager.cc:1434] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:44.247884 18303 tablet_bootstrap.cc:492] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.242591 18067 leader_election.cc:304] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.251816 18367 raft_consensus.cc:2804] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.251962 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
W20260709 13:19:44.253364 17994 leader_election.cc:343] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.254449 18297 raft_consensus.cc:359] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.255538 18297 raft_consensus.cc:385] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.252434 18367 raft_consensus.cc:697] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:44.256974 18297 raft_consensus.cc:740] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.256719 18367 consensus_queue.cc:237] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.261593 18348 raft_consensus.cc:697] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:44.262603 18348 consensus_queue.cc:237] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.267287 18300 tablet_bootstrap.cc:654] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.258575 18297 consensus_queue.cc:260] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.281484 17926 catalog_manager.cc:5697] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.282382 18297 ts_tablet_manager.cc:1434] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:19:44.284221 18297 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.285874 18298 tablet_bootstrap.cc:492] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.285955 18367 raft_consensus.cc:493] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.286586 18298 ts_tablet_manager.cc:1403] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.030s
I20260709 13:19:44.289840 18303 tablet_bootstrap.cc:654] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.289978 18298 raft_consensus.cc:359] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.290725 18298 raft_consensus.cc:385] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.290995 18298 raft_consensus.cc:740] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.291718 18298 consensus_queue.cc:260] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.286562 18367 raft_consensus.cc:515] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.293776 18298 ts_tablet_manager.cc:1434] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:19:44.297003 18298 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.298849 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8918d3a188f4572af4b584b200ba410" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:44.300554 18067 leader_election.cc:343] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.304152 18367 leader_election.cc:290] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.305423 18298 tablet_bootstrap.cc:654] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.312165 17926 catalog_manager.cc:5697] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.313074 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8918d3a188f4572af4b584b200ba410" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.313429 18297 tablet_bootstrap.cc:654] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.314071 18381 consensus_queue.cc:1048] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:44.316123 18070 leader_election.cc:343] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.316576 18070 leader_election.cc:304] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.316797 18304 consensus_queue.cc:1048] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.317775 18367 raft_consensus.cc:2749] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.336557 18300 tablet_bootstrap.cc:492] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.337159 18300 ts_tablet_manager.cc:1403] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.010s
I20260709 13:19:44.337898 18303 tablet_bootstrap.cc:492] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.338411 18303 ts_tablet_manager.cc:1403] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.018s
I20260709 13:19:44.341456 18300 raft_consensus.cc:359] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.342273 18300 raft_consensus.cc:385] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.342535 18300 raft_consensus.cc:740] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.343479 18381 consensus_queue.cc:1048] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:44.343626 18300 consensus_queue.cc:260] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.346105 18300 ts_tablet_manager.cc:1434] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:44.345896 18303 raft_consensus.cc:359] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.346632 18303 raft_consensus.cc:385] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.346911 18303 raft_consensus.cc:740] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.347295 18300 tablet_bootstrap.cc:492] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.352283 18297 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.352823 18297 ts_tablet_manager.cc:1403] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 13:19:44.355679 18297 raft_consensus.cc:359] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.356388 18297 raft_consensus.cc:385] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.356671 18297 raft_consensus.cc:740] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.357302 18297 consensus_queue.cc:260] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.347644 18303 consensus_queue.cc:260] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.361760 18303 ts_tablet_manager.cc:1434] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:19:44.362319 18309 consensus_queue.cc:1048] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.364041 18297 ts_tablet_manager.cc:1434] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:44.365247 18297 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.361683 18348 consensus_queue.cc:1048] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:44.362789 18303 tablet_bootstrap.cc:492] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.377486 18303 tablet_bootstrap.cc:654] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.378008 18297 tablet_bootstrap.cc:654] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.377486 18300 tablet_bootstrap.cc:654] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.385895 18303 tablet_bootstrap.cc:492] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.387205 18303 ts_tablet_manager.cc:1403] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:19:44.389417 18304 consensus_queue.cc:1048] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.392292 18303 raft_consensus.cc:359] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.394843 18303 raft_consensus.cc:385] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.395526 18303 raft_consensus.cc:740] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.396735 18303 consensus_queue.cc:260] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.399950 18303 ts_tablet_manager.cc:1434] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:44.402557 18297 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.402760 18303 tablet_bootstrap.cc:492] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.405432 18300 tablet_bootstrap.cc:492] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.405699 18338 raft_consensus.cc:493] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.405957 18300 ts_tablet_manager.cc:1403] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 13:19:44.406229 18338 raft_consensus.cc:515] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.408434 18338 leader_election.cc:290] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.411101 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.412024 18300 raft_consensus.cc:359] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.412689 18300 raft_consensus.cc:385] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.412955 18300 raft_consensus.cc:740] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.413394 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.414175 18176 raft_consensus.cc:2468] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:44.415577 18215 leader_election.cc:304] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:44.416501 18338 raft_consensus.cc:2804] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.416908 18338 raft_consensus.cc:493] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.417232 18338 raft_consensus.cc:3060] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.417614 18303 tablet_bootstrap.cc:654] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.411809 18104 raft_consensus.cc:2468] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:44.424065 18304 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.424925 18338 raft_consensus.cc:515] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.424636 18304 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.416479 18300 consensus_queue.cc:260] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.403110 18297 ts_tablet_manager.cc:1403] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.014s
I20260709 13:19:44.432915 18300 ts_tablet_manager.cc:1434] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:19:44.434453 18300 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.436633 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.436942 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
W20260709 13:19:44.437302 18389 log.cc:927] Time spent T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:44.440127 18104 raft_consensus.cc:3060] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.442116 18177 raft_consensus.cc:2468] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
W20260709 13:19:44.432413 17994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 68443.7us
I20260709 13:19:44.444271 18304 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:44.434664 18297 raft_consensus.cc:359] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.446115 18297 raft_consensus.cc:385] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.446412 18297 raft_consensus.cc:740] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.447063 18297 consensus_queue.cc:260] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.451259 18215 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:44.456265 18297 ts_tablet_manager.cc:1434] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:19:44.457320 18297 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.458832 18304 raft_consensus.cc:2804] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.459417 18304 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.459795 18304 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.460392 18338 leader_election.cc:290] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.461465 18104 raft_consensus.cc:2468] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:44.461637 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:44.463192 18298 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.463491 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.466714 18177 raft_consensus.cc:3060] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.463794 18297 tablet_bootstrap.cc:654] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.466073 18303 tablet_bootstrap.cc:492] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.467368 18217 leader_election.cc:304] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:44.472607 18298 ts_tablet_manager.cc:1403] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.176s	user 0.073s	sys 0.025s
I20260709 13:19:44.472596 18303 ts_tablet_manager.cc:1403] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.003s
I20260709 13:19:44.476490 18300 tablet_bootstrap.cc:654] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.471386 18304 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.482141 18340 consensus_queue.cc:1048] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.485176 18177 raft_consensus.cc:2468] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:44.485961 18303 raft_consensus.cc:359] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.487322 18303 raft_consensus.cc:385] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.487720 18303 raft_consensus.cc:740] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.492062 18398 raft_consensus.cc:2804] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.492594 18398 raft_consensus.cc:697] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:44.493321 18338 raft_consensus.cc:493] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.493430 18398 consensus_queue.cc:237] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.493934 18338 raft_consensus.cc:515] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.488857 18303 consensus_queue.cc:260] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.503050 18303 ts_tablet_manager.cc:1434] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:19:44.504120 18303 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.512609 18298 raft_consensus.cc:359] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.513435 18298 raft_consensus.cc:385] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.513757 18298 raft_consensus.cc:740] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.514412 18298 consensus_queue.cc:260] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.517194 18298 ts_tablet_manager.cc:1434] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:19:44.518180 18298 tablet_bootstrap.cc:492] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.519996 18338 leader_election.cc:290] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:44.521852 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ca0113f4654093a3524c8198661196" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:44.523314 18217 leader_election.cc:343] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.525669 18297 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.526211 18297 ts_tablet_manager.cc:1403] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.010s
I20260709 13:19:44.529562 18304 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:44.530443 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:44.531131 18177 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:44.532126 18218 leader_election.cc:343] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.532511 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ca0113f4654093a3524c8198661196" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.533120 18029 raft_consensus.cc:2468] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:44.534649 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:44.537698 18298 tablet_bootstrap.cc:654] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.539637 18218 leader_election.cc:304] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425
I20260709 13:19:44.541918 18304 raft_consensus.cc:2804] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.542299 18304 raft_consensus.cc:493] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.542645 18304 raft_consensus.cc:3060] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.542793 18103 raft_consensus.cc:3060] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.544389 18297 raft_consensus.cc:359] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.545104 18297 raft_consensus.cc:385] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.545364 18297 raft_consensus.cc:740] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.546072 18297 consensus_queue.cc:260] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:44.542320 18218 leader_election.cc:343] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.549111 18297 ts_tablet_manager.cc:1434] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:19:44.552896 18304 raft_consensus.cc:515] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.553663 18297 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.555040 18304 leader_election.cc:290] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:44.555756 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ca0113f4654093a3524c8198661196" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:44.556321 18029 raft_consensus.cc:3060] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.556375 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ca0113f4654093a3524c8198661196" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:44.558032 18303 tablet_bootstrap.cc:654] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:44.558318 18217 leader_election.cc:343] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.567819 18351 consensus_queue.cc:1048] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.570952 18029 raft_consensus.cc:2468] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:44.566562 17924 catalog_manager.cc:5697] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.574177 18218 leader_election.cc:304] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425
I20260709 13:19:44.575371 18177 raft_consensus.cc:2468] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:44.575501 18402 raft_consensus.cc:2804] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.578881 18402 raft_consensus.cc:697] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:44.579592 18215 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.579941 18402 consensus_queue.cc:237] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.580961 18403 raft_consensus.cc:2804] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.581480 18403 raft_consensus.cc:697] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:44.582355 18403 consensus_queue.cc:237] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.592761 18392 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.593341 18392 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.597808 18300 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.598356 18300 ts_tablet_manager.cc:1403] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.165s	user 0.011s	sys 0.013s
I20260709 13:19:44.598889 18298 tablet_bootstrap.cc:492] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.599608 18392 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.600329 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.601024 18103 raft_consensus.cc:2468] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:44.602205 17994 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:44.603464 18298 ts_tablet_manager.cc:1403] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.001s
I20260709 13:19:44.604097 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.606186 18177 raft_consensus.cc:2468] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:44.608752 18348 raft_consensus.cc:493] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.609277 18348 raft_consensus.cc:515] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.610425 18300 raft_consensus.cc:359] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.611188 18300 raft_consensus.cc:385] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.611445 18300 raft_consensus.cc:740] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.612232 18300 consensus_queue.cc:260] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.613884 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.614326 18300 ts_tablet_manager.cc:1434] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
W20260709 13:19:44.615473 17992 leader_election.cc:343] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.604826 18392 raft_consensus.cc:2804] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.616441 18392 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.616791 18392 raft_consensus.cc:3060] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.616905 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:44.618400 17994 leader_election.cc:343] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.618170 18298 raft_consensus.cc:359] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.615428 18300 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.619339 17994 leader_election.cc:304] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.611518 18348 leader_election.cc:290] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.624518 18309 raft_consensus.cc:2749] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.619047 18298 raft_consensus.cc:385] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.625671 18298 raft_consensus.cc:740] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.626386 18298 consensus_queue.cc:260] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.627170 18300 tablet_bootstrap.cc:654] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.628692 18298 ts_tablet_manager.cc:1434] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:19:44.629698 18298 tablet_bootstrap.cc:492] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.632153 18303 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.632706 18303 ts_tablet_manager.cc:1403] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.129s	user 0.036s	sys 0.009s
I20260709 13:19:44.635844 18298 tablet_bootstrap.cc:654] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.638561 18300 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.639029 18300 ts_tablet_manager.cc:1403] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:19:44.639394 18392 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.641927 17924 catalog_manager.cc:5697] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.643079 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:44.645750 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:44.646081 18103 raft_consensus.cc:3060] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.646384 18177 raft_consensus.cc:3060] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.646713 17924 catalog_manager.cc:5697] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.653257 18177 raft_consensus.cc:2468] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:44.654709 17992 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:44.643446 18300 raft_consensus.cc:359] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.655582 18298 tablet_bootstrap.cc:492] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.645375 18303 raft_consensus.cc:359] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.656092 18303 raft_consensus.cc:385] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.656229 18298 ts_tablet_manager.cc:1403] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.006s
I20260709 13:19:44.656402 18303 raft_consensus.cc:740] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.656766 18300 raft_consensus.cc:385] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.657092 18300 raft_consensus.cc:740] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.657771 18300 consensus_queue.cc:260] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.658429 18303 consensus_queue.cc:260] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.659082 18298 raft_consensus.cc:359] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.659725 18298 raft_consensus.cc:385] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.660565 18303 ts_tablet_manager.cc:1434] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:44.660858 18300 ts_tablet_manager.cc:1434] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:19:44.645174 18392 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.643676 18297 tablet_bootstrap.cc:654] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.655534 18309 raft_consensus.cc:2804] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.661443 18303 tablet_bootstrap.cc:492] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.660003 18298 raft_consensus.cc:740] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.661875 18309 raft_consensus.cc:697] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:44.653333 18103 raft_consensus.cc:2468] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:44.663561 18300 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.665254 18104 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.662746 18309 consensus_queue.cc:237] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.662441 18298 consensus_queue.cc:260] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.670751 18303 tablet_bootstrap.cc:654] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.675097 18298 ts_tablet_manager.cc:1434] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:19:44.676227 18298 tablet_bootstrap.cc:492] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.676777 18381 consensus_queue.cc:1048] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.678026 18300 tablet_bootstrap.cc:654] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.681313 18348 consensus_queue.cc:1048] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.681658 18298 tablet_bootstrap.cc:654] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.693836 18300 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.696842 18300 ts_tablet_manager.cc:1403] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.005s
I20260709 13:19:44.698755 18348 raft_consensus.cc:493] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.699335 18348 raft_consensus.cc:515] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.702890 18300 raft_consensus.cc:359] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.703411 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.708086 18300 raft_consensus.cc:385] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.709370 18300 raft_consensus.cc:740] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
W20260709 13:19:44.709429 17992 leader_election.cc:343] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.709923 18348 leader_election.cc:290] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.710598 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.711650 18300 consensus_queue.cc:260] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:44.715435 17994 leader_election.cc:343] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.716022 17994 leader_election.cc:304] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.716858 18392 raft_consensus.cc:2749] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.718420 18300 ts_tablet_manager.cc:1434] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:44.697199 18298 tablet_bootstrap.cc:492] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.720880 18298 ts_tablet_manager.cc:1403] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:19:44.723568 18298 raft_consensus.cc:359] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.725839 18298 raft_consensus.cc:385] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.726934 18298 raft_consensus.cc:740] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.728389 18298 consensus_queue.cc:260] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.732803 18298 ts_tablet_manager.cc:1434] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:44.738049 18298 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.734001 18367 raft_consensus.cc:493] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.740507 18367 raft_consensus.cc:515] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.742554 18367 leader_election.cc:290] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.725014 18300 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.744485 18402 raft_consensus.cc:493] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.744688 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.745025 18402 raft_consensus.cc:515] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.746172 18251 raft_consensus.cc:2468] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:44.747352 18402 leader_election.cc:290] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.745021 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.749251 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.750437 18408 raft_consensus.cc:493] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.750924 18408 raft_consensus.cc:515] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
W20260709 13:19:44.751304 18215 leader_election.cc:343] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.753038 18408 leader_election.cc:290] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.753731 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8918d3a188f4572af4b584b200ba410" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.754390 18104 raft_consensus.cc:2468] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:44.755726 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8918d3a188f4572af4b584b200ba410" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
W20260709 13:19:44.750932 18067 leader_election.cc:343] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.756367 18300 tablet_bootstrap.cc:654] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.758664 18423 consensus_queue.cc:1048] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:44.760891 18070 leader_election.cc:304] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.761845 18367 raft_consensus.cc:2804] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.762229 18367 raft_consensus.cc:493] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.762565 18367 raft_consensus.cc:3060] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.764539 18297 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.765156 18297 ts_tablet_manager.cc:1403] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.018s
I20260709 13:19:44.767647 18297 raft_consensus.cc:359] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.763067 18298 tablet_bootstrap.cc:654] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.768290 18297 raft_consensus.cc:385] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.768716 18143 leader_election.cc:304] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:44.770699 18297 raft_consensus.cc:740] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.771113 18408 raft_consensus.cc:2804] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.771512 18408 raft_consensus.cc:493] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.772013 18408 raft_consensus.cc:3060] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.771687 18297 consensus_queue.cc:260] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.774264 18297 ts_tablet_manager.cc:1434] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:19:44.775297 18297 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.775795 18367 raft_consensus.cc:515] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.750437 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.783440 18356 raft_consensus.cc:493] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.786976 18356 raft_consensus.cc:515] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.787343 18297 tablet_bootstrap.cc:654] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.787317 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:44.788275 18252 raft_consensus.cc:3060] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.789196 18356 leader_election.cc:290] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.774247 17923 catalog_manager.cc:5697] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.770172 18300 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.790119 18300 ts_tablet_manager.cc:1403] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.001s
I20260709 13:19:44.792935 18300 raft_consensus.cc:359] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.793110 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.793313 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:44.787603 18298 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.793804 18250 raft_consensus.cc:2468] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:44.794060 18298 ts_tablet_manager.cc:1403] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:19:44.795512 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.796162 18177 raft_consensus.cc:2468] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:44.796892 18298 raft_consensus.cc:359] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.797240 18252 raft_consensus.cc:2468] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:44.788349 18102 raft_consensus.cc:2393] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 1: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
W20260709 13:19:44.797750 18067 leader_election.cc:343] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.756356 18251 raft_consensus.cc:2468] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:44.798513 18070 leader_election.cc:304] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:44.799888 18070 leader_election.cc:304] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.800263 18408 raft_consensus.cc:515] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.798738 18367 leader_election.cc:290] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.801797 18367 raft_consensus.cc:2804] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.803373 18367 raft_consensus.cc:493] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.803821 18367 raft_consensus.cc:3060] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.797576 18298 raft_consensus.cc:385] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.806937 18298 raft_consensus.cc:740] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.807634 18298 consensus_queue.cc:260] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.793593 18300 raft_consensus.cc:385] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.808349 18217 leader_election.cc:304] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:44.808727 18300 raft_consensus.cc:740] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.809617 18402 raft_consensus.cc:2749] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:44.812083 18070 consensus_peers.cc:597] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:44.812773 18423 raft_consensus.cc:2804] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.813524 18423 raft_consensus.cc:697] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:44.814672 18298 ts_tablet_manager.cc:1434] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:19:44.813930 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8918d3a188f4572af4b584b200ba410" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:44.815263 18102 raft_consensus.cc:3060] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.816309 18300 consensus_queue.cc:260] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.816015 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8918d3a188f4572af4b584b200ba410" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:44.817330 18252 raft_consensus.cc:3060] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.818440 18300 ts_tablet_manager.cc:1434] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 13:19:44.819411 18300 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.785066 18303 tablet_bootstrap.cc:492] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.815675 18298 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.815574 18423 consensus_queue.cc:237] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.824396 18303 ts_tablet_manager.cc:1403] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.163s	user 0.020s	sys 0.046s
I20260709 13:19:44.833552 18102 raft_consensus.cc:2468] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:44.834880 18143 leader_election.cc:304] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:44.836417 18351 raft_consensus.cc:2804] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.802577 18408 leader_election.cc:290] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.836898 18297 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.825367 18300 tablet_bootstrap.cc:654] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.837469 18297 ts_tablet_manager.cc:1403] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.012s
I20260709 13:19:44.836900 18351 raft_consensus.cc:697] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:44.839354 18303 raft_consensus.cc:359] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.831475 18298 tablet_bootstrap.cc:654] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.831904 18356 raft_consensus.cc:493] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.839885 18303 raft_consensus.cc:385] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.839839 18351 consensus_queue.cc:237] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.828158 18367 raft_consensus.cc:515] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.841862 18402 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.842340 18402 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.840283 18356 raft_consensus.cc:515] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.844442 18402 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:44.844873 18356 leader_election.cc:290] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:44.846441 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.848081 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ca0113f4654093a3524c8198661196" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.848870 18029 raft_consensus.cc:2393] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 830a192d6137410e8bd043588f0ed425 in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:44.850452 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ca0113f4654093a3524c8198661196" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
W20260709 13:19:44.848145 18218 leader_election.cc:343] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.852298 18070 leader_election.cc:304] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.853109 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.853600 18367 leader_election.cc:290] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.840267 18297 raft_consensus.cc:359] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.855312 18297 raft_consensus.cc:385] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.856002 18297 raft_consensus.cc:740] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
W20260709 13:19:44.857187 18217 leader_election.cc:343] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.857225 18297 consensus_queue.cc:260] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.857713 18217 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.859959 18402 raft_consensus.cc:2749] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.860874 18252 raft_consensus.cc:2468] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:44.861304 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:44.862046 18251 raft_consensus.cc:3060] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.858909 18300 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.855603 18367 raft_consensus.cc:3060] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.865811 18300 ts_tablet_manager.cc:1403] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.005s
I20260709 13:19:44.868564 18300 raft_consensus.cc:359] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.869201 18300 raft_consensus.cc:385] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.869447 18300 raft_consensus.cc:740] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.869935 18298 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:44.870113 18300 consensus_queue.cc:260] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.870434 18298 ts_tablet_manager.cc:1403] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.001s
I20260709 13:19:44.870463 17924 catalog_manager.cc:5697] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.872601 18300 ts_tablet_manager.cc:1434] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:44.840298 18303 raft_consensus.cc:740] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.873530 18300 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:44.875558 18298 raft_consensus.cc:359] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.876205 18298 raft_consensus.cc:385] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.876464 18298 raft_consensus.cc:740] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.879010 18303 consensus_queue.cc:260] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.879637 18300 tablet_bootstrap.cc:654] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.885185 18251 raft_consensus.cc:2468] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:44.886796 18070 leader_election.cc:304] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:44.888168 18408 raft_consensus.cc:493] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.888739 18408 raft_consensus.cc:515] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.886909 18303 ts_tablet_manager.cc:1434] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 13:19:44.881186 18297 ts_tablet_manager.cc:1434] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 13:19:44.891031 18297 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.893085 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a427d8aa884b3f98202c983c1292ab" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.893836 18029 raft_consensus.cc:2468] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:44.895176 18423 raft_consensus.cc:2804] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.895627 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a427d8aa884b3f98202c983c1292ab" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.885005 18367 raft_consensus.cc:2749] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.891033 18408 leader_election.cc:290] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:44.896337 18252 raft_consensus.cc:2468] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:44.896533 18303 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.896926 18144 leader_election.cc:304] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:44.904731 18408 raft_consensus.cc:2804] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:44.905094 18408 raft_consensus.cc:493] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.905416 18408 raft_consensus.cc:3060] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.895709 18423 raft_consensus.cc:697] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:44.907534 18423 consensus_queue.cc:237] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.909008 18303 tablet_bootstrap.cc:654] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.909345 18298 consensus_queue.cc:260] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.912751 18408 raft_consensus.cc:515] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:44.900341 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 59694us
I20260709 13:19:44.916330 18408 leader_election.cc:290] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:44.917456 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a427d8aa884b3f98202c983c1292ab" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:44.918032 18029 raft_consensus.cc:3060] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.918010 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:44.918854 18176 raft_consensus.cc:3060] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.918828 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a427d8aa884b3f98202c983c1292ab" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:44.919716 18252 raft_consensus.cc:3060] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.917950 18403 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.921202 18403 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.924747 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.925014 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:44.926347 18218 leader_election.cc:343] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:44.926911 18217 leader_election.cc:343] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.927368 18217 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:44.928244 18402 raft_consensus.cc:2749] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.929471 18176 raft_consensus.cc:2468] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:44.930596 18408 raft_consensus.cc:493] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.931214 18029 raft_consensus.cc:2468] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:44.931097 18408 raft_consensus.cc:515] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:44.932209 18303 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:44.932408 18144 leader_election.cc:304] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:44.933703 18408 leader_election.cc:290] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:44.924731 18403 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:44.935145 18252 raft_consensus.cc:2468] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:44.900211 18297 tablet_bootstrap.cc:654] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.932711 18303 ts_tablet_manager.cc:1403] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.000s
I20260709 13:19:44.941032 18298 ts_tablet_manager.cc:1434] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.003s
I20260709 13:19:44.935416 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.942453 18303 raft_consensus.cc:359] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.943215 18303 raft_consensus.cc:385] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.943481 18303 raft_consensus.cc:740] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.933917 18351 raft_consensus.cc:2804] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.944314 18303 consensus_queue.cc:260] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.942054 18298 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:44.945304 18351 raft_consensus.cc:697] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:44.946204 18351 consensus_queue.cc:237] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.946928 18300 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:44.947454 18300 ts_tablet_manager.cc:1403] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.022s
I20260709 13:19:44.947609 18303 ts_tablet_manager.cc:1434] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:44.948614 18303 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:44.950961 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c71a8d73a841e5840ba9d18aba7b58" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:44.951785 18252 raft_consensus.cc:2393] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
I20260709 13:19:44.953225 18300 raft_consensus.cc:359] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.953939 18300 raft_consensus.cc:385] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.954260 18300 raft_consensus.cc:740] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.955003 18356 raft_consensus.cc:493] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.955497 18356 raft_consensus.cc:515] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.956516 18298 tablet_bootstrap.cc:654] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.952839 18144 leader_election.cc:304] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:44.964763 18337 raft_consensus.cc:3060] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.965631 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:44.957546 18356 leader_election.cc:290] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:44.961067 17923 catalog_manager.cc:5697] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.957149 18303 tablet_bootstrap.cc:654] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:44.970295 18067 leader_election.cc:343] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:44.974515 18297 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:44.975023 18297 ts_tablet_manager.cc:1403] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.012s
I20260709 13:19:44.977443 18351 raft_consensus.cc:493] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.978065 18351 raft_consensus.cc:515] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:44.978261 18297 raft_consensus.cc:359] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.978960 18297 raft_consensus.cc:385] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.979245 18297 raft_consensus.cc:740] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.982661 18403 raft_consensus.cc:493] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.983309 18403 raft_consensus.cc:515] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.983566 18297 consensus_queue.cc:260] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.985896 18297 ts_tablet_manager.cc:1434] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:44.986855 18297 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:44.988154 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:44.989023 18102 raft_consensus.cc:2468] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:44.991320 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.993623 18337 raft_consensus.cc:2749] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:44.961061 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:44.997385 18029 raft_consensus.cc:2468] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:44.996107 18392 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.008459 18392 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:44.995384 17923 catalog_manager.cc:5697] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.009971 18070 leader_election.cc:304] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.011191 18392 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:45.011447 18303 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:45.011220 18356 raft_consensus.cc:2804] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.011960 18303 ts_tablet_manager.cc:1403] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.006s
I20260709 13:19:44.962276 18300 consensus_queue.cc:260] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:44.994205 18217 leader_election.cc:304] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:45.013127 18402 raft_consensus.cc:2804] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.013495 18402 raft_consensus.cc:493] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.013809 18402 raft_consensus.cc:3060] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.014447 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:45.014788 18303 raft_consensus.cc:359] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.015131 18102 raft_consensus.cc:2468] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:45.015523 18303 raft_consensus.cc:385] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.999327 18297 tablet_bootstrap.cc:654] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.015862 18303 raft_consensus.cc:740] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.012157 18356 raft_consensus.cc:493] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.016634 18303 consensus_queue.cc:260] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.017166 18356 raft_consensus.cc:3060] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.001415 18403 leader_election.cc:290] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:45.019011 18303 ts_tablet_manager.cc:1434] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:45.019968 18303 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:45.024791 18403 consensus_queue.cc:1048] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.025393 18303 tablet_bootstrap.cc:654] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.025735 18356 raft_consensus.cc:515] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.027845 18300 ts_tablet_manager.cc:1434] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 13:19:45.006631 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:45.031816 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
W20260709 13:19:45.032367 18144 leader_election.cc:343] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.031867 18356 leader_election.cc:290] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
W20260709 13:19:45.033532 18067 leader_election.cc:343] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.016537 17994 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:45.034719 18392 raft_consensus.cc:2804] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.035157 18392 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.035542 18392 raft_consensus.cc:3060] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.034842 18300 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:45.041141 18298 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:45.041782 18298 ts_tablet_manager.cc:1403] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.100s	user 0.034s	sys 0.011s
I20260709 13:19:45.045441 18356 raft_consensus.cc:493] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.015300 18218 leader_election.cc:343] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.046304 18356 raft_consensus.cc:515] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:45.047291 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 50285.7us
I20260709 13:19:45.049239 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.049628 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:45.049919 18028 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.050551 18027 raft_consensus.cc:2468] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:45.002194 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.007234 18351 leader_election.cc:290] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.028878 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:45.049919 18251 raft_consensus.cc:2468] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:45.052383 18070 leader_election.cc:304] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
W20260709 13:19:45.053136 18144 leader_election.cc:343] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.053378 18423 raft_consensus.cc:2804] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.052539 18029 raft_consensus.cc:3060] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.045249 18298 raft_consensus.cc:359] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.053637 18144 leader_election.cc:304] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.054474 18351 raft_consensus.cc:2749] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:45.054564 18423 raft_consensus.cc:493] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.029115 18402 raft_consensus.cc:515] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.055473 18423 raft_consensus.cc:3060] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.054100 18298 raft_consensus.cc:385] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.056249 18298 raft_consensus.cc:740] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.057129 18298 consensus_queue.cc:260] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.059465 17924 catalog_manager.cc:5697] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.060506 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
W20260709 13:19:45.062276 18218 leader_election.cc:343] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.069015 18356 leader_election.cc:290] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:45.067440 18423 raft_consensus.cc:515] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.069715 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:45.072829 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:45.073549 18027 raft_consensus.cc:3060] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:45.076105 18067 leader_election.cc:343] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.077476 18423 leader_election.cc:290] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:45.079409 18300 tablet_bootstrap.cc:654] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.081032 18403 consensus_queue.cc:1048] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.081125 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
W20260709 13:19:45.082753 18067 leader_election.cc:343] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.085536 18303 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:45.086184 18303 ts_tablet_manager.cc:1403] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.066s	user 0.035s	sys 0.024s
I20260709 13:19:45.089490 18297 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:45.090051 18297 ts_tablet_manager.cc:1403] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.007s
I20260709 13:19:45.092921 18297 raft_consensus.cc:359] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.093622 18297 raft_consensus.cc:385] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.093890 18297 raft_consensus.cc:740] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.087924 18392 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.094901 18297 consensus_queue.cc:260] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.096952 18392 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:45.097478 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:45.098110 18251 raft_consensus.cc:3060] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.105734 18297 ts_tablet_manager.cc:1434] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:45.106746 18297 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:45.110244 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:45.110932 18102 raft_consensus.cc:3060] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.114555 18297 tablet_bootstrap.cc:654] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.122876 18029 raft_consensus.cc:2468] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:45.124272 18070 leader_election.cc:304] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.125195 18423 raft_consensus.cc:2804] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.125773 18423 raft_consensus.cc:697] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:45.126740 18423 consensus_queue.cc:237] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.127957 18392 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.128530 18392 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.128747 18027 raft_consensus.cc:2468] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:45.131783 18298 ts_tablet_manager.cc:1434] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:19:45.130755 18392 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:45.133808 18298 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:45.136489 18070 leader_election.cc:304] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.142681 18402 leader_election.cc:290] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:45.143643 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:45.144052 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:45.148784 18356 raft_consensus.cc:2804] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.149322 18356 raft_consensus.cc:697] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:45.149827 18300 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:45.150398 18300 ts_tablet_manager.cc:1403] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.005s
I20260709 13:19:45.150187 18356 consensus_queue.cc:237] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.155274 18348 raft_consensus.cc:493] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.158320 18348 raft_consensus.cc:515] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.163385 18337 raft_consensus.cc:493] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.165105 18337 raft_consensus.cc:515] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.167265 18337 leader_election.cc:290] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.172667 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f57aae4fb06403aaac8a835763ff266" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:45.174520 18348 leader_election.cc:290] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:45.172744 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:45.177157 18104 raft_consensus.cc:3060] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.177938 18251 raft_consensus.cc:2468] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:45.182122 18300 raft_consensus.cc:359] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.183229 18300 raft_consensus.cc:385] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.183513 18300 raft_consensus.cc:740] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.186501 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f57aae4fb06403aaac8a835763ff266" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.187268 18252 raft_consensus.cc:2468] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:45.188478 18348 consensus_queue.cc:1048] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:45.188998 18144 leader_election.cc:343] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.186905 18300 consensus_queue.cc:260] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.191020 18300 ts_tablet_manager.cc:1434] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:19:45.191695 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698a6a9993674b4eae04bad2efa5485f" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:45.192529 17995 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:45.193851 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.193800 18392 raft_consensus.cc:2804] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.195931 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698a6a9993674b4eae04bad2efa5485f" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
W20260709 13:19:45.196354 17992 leader_election.cc:343] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.195295 18392 raft_consensus.cc:697] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:45.197510 18297 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:45.198182 18297 ts_tablet_manager.cc:1403] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.014s
I20260709 13:19:45.195319 18144 leader_election.cc:304] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.201813 18300 tablet_bootstrap.cc:492] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:45.203686 18303 raft_consensus.cc:359] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.204583 18303 raft_consensus.cc:385] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.204864 18303 raft_consensus.cc:740] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.189287 18102 raft_consensus.cc:2468] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:45.206228 18392 consensus_queue.cc:237] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.227291 18104 raft_consensus.cc:2468] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:45.206837 18340 raft_consensus.cc:2804] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.209908 17995 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.183662 18403 consensus_queue.cc:1048] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:19:45.208053 18402 consensus_queue.cc:1048] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:19:45.217219 18300 tablet_bootstrap.cc:654] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.220536 18309 consensus_queue.cc:1048] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.222324 18297 raft_consensus.cc:359] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.232626 18297 raft_consensus.cc:385] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.232944 18297 raft_consensus.cc:740] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.211640 18303 consensus_queue.cc:260] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.228036 18340 raft_consensus.cc:493] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.235185 18303 ts_tablet_manager.cc:1434] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.002s
I20260709 13:19:45.236460 18303 tablet_bootstrap.cc:492] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:45.239611 18297 consensus_queue.cc:260] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.228869 18448 consensus_queue.cc:1048] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:45.236079 18340 raft_consensus.cc:3060] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.238206 18348 raft_consensus.cc:2749] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:45.229151 18217 leader_election.cc:304] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.237741 18447 consensus_queue.cc:1048] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 13:19:45.252951 17995 leader_election.cc:343] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.262542 17995 leader_election.cc:304] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.250924 18351 raft_consensus.cc:493] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.261562 18297 ts_tablet_manager.cc:1434] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.006s
I20260709 13:19:45.268934 18297 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:45.265584 18309 raft_consensus.cc:2749] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:45.271126 18446 raft_consensus.cc:2804] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:45.293341 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 64293.1us
I20260709 13:19:45.296878 18297 tablet_bootstrap.cc:654] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.270483 18351 raft_consensus.cc:515] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.302724 18351 leader_election.cc:290] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.248953 17923 catalog_manager.cc:5697] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.304950 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698a6a9993674b4eae04bad2efa5485f" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:45.305713 18027 raft_consensus.cc:2468] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:45.307108 18144 leader_election.cc:304] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:45.308017 18351 raft_consensus.cc:2804] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.308393 18351 raft_consensus.cc:493] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.308727 18351 raft_consensus.cc:3060] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.313723 18423 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.314404 18423 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.316318 18351 raft_consensus.cc:515] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.316881 18423 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.319262 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:45.321126 18070 leader_election.cc:343] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.325296 18027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698a6a9993674b4eae04bad2efa5485f" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:45.325999 18027 raft_consensus.cc:3060] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.326524 18298 tablet_bootstrap.cc:654] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:45.330788 18452 log.cc:927] Time spent T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:45.292413 18446 raft_consensus.cc:697] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:45.332602 18446 consensus_queue.cc:237] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.341217 18351 leader_election.cc:290] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.368021 18337 consensus_queue.cc:1048] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:45.382079 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.382882 18250 raft_consensus.cc:2468] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
W20260709 13:19:45.388126 17994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 89009.8us
I20260709 13:19:45.409399 18027 raft_consensus.cc:2468] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:45.410046 18367 consensus_queue.cc:1048] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.415972 18402 raft_consensus.cc:493] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.416586 18402 raft_consensus.cc:515] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.419193 18402 leader_election.cc:290] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:45.420598 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:45.419246 17926 catalog_manager.cc:5697] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.322778 18340 raft_consensus.cc:515] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.435609 18144 leader_election.cc:304] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:45.436583 18297 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:45.436805 18351 raft_consensus.cc:2804] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.437361 18351 raft_consensus.cc:697] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
W20260709 13:19:45.437647 18217 leader_election.cc:343] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.438217 18351 consensus_queue.cc:237] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.438951 18297 ts_tablet_manager.cc:1403] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.000s
I20260709 13:19:45.440759 18300 tablet_bootstrap.cc:492] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:45.441255 18300 ts_tablet_manager.cc:1403] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.250s	user 0.028s	sys 0.060s
I20260709 13:19:45.441396 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:45.443116 18297 raft_consensus.cc:359] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.443842 18297 raft_consensus.cc:385] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.444144 18297 raft_consensus.cc:740] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.443989 18300 raft_consensus.cc:359] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
W20260709 13:19:45.444593 18218 leader_election.cc:343] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.444958 18300 raft_consensus.cc:385] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.445111 18297 consensus_queue.cc:260] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.446055 18300 raft_consensus.cc:740] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.444262 18337 consensus_queue.cc:1048] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:45.446832 18300 consensus_queue.cc:260] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.447732 18297 ts_tablet_manager.cc:1434] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
W20260709 13:19:45.448437 18451 log.cc:927] Time spent T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:19:45.449069 18300 ts_tablet_manager.cc:1434] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:45.450152 18300 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:45.451715 18297 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:45.452965 18303 tablet_bootstrap.cc:654] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.445943 18218 leader_election.cc:304] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.474478 18456 raft_consensus.cc:2749] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:45.465423 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698a6a9993674b4eae04bad2efa5485f" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.477244 18070 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.479171 18356 raft_consensus.cc:2804] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.479598 18356 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.479967 18356 raft_consensus.cc:3060] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.481770 18300 tablet_bootstrap.cc:654] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.490330 18298 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:45.491024 18298 ts_tablet_manager.cc:1403] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.357s	user 0.012s	sys 0.004s
I20260709 13:19:45.493098 18423 consensus_queue.cc:1048] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.502408 18298 raft_consensus.cc:359] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.503172 18298 raft_consensus.cc:385] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.503471 18298 raft_consensus.cc:740] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.504647 18298 consensus_queue.cc:260] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.506572 18303 tablet_bootstrap.cc:492] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:45.507375 18303 ts_tablet_manager.cc:1403] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.271s	user 0.011s	sys 0.003s
I20260709 13:19:45.496263 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698a6a9993674b4eae04bad2efa5485f" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:45.522789 18298 ts_tablet_manager.cc:1434] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:19:45.518867 18251 raft_consensus.cc:3060] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.537503 18303 raft_consensus.cc:359] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.508193 18340 leader_election.cc:290] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.532744 18428 consensus_queue.cc:1048] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:45.543341 18303 raft_consensus.cc:385] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.546958 18303 raft_consensus.cc:740] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
W20260709 13:19:45.545251 18144 leader_election.cc:343] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.506907 18337 consensus_queue.cc:1048] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:19:45.547968 18303 consensus_queue.cc:260] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.572868 18303 ts_tablet_manager.cc:1434] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:19:45.573727 18303 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:45.581024 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f57aae4fb06403aaac8a835763ff266" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
W20260709 13:19:45.579944 18467 log.cc:927] Time spent T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:45.587157 18298 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
W20260709 13:19:45.588328 18144 leader_election.cc:343] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.596263 18367 consensus_queue.cc:1048] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:45.602737 18472 log.cc:927] Time spent T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:19:45.602954 18462 log.cc:927] Time spent T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:19:45.595652 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f57aae4fb06403aaac8a835763ff266" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:45.603857 18250 raft_consensus.cc:3060] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.608422 18367 consensus_queue.cc:1048] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.609094 18348 consensus_queue.cc:1048] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.585134 18251 raft_consensus.cc:2468] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:45.619907 18309 raft_consensus.cc:493] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.631994 18309 raft_consensus.cc:515] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.634359 18309 leader_election.cc:290] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:45.661468 18303 tablet_bootstrap.cc:654] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.638411 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:45.668565 18300 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:45.669147 18300 ts_tablet_manager.cc:1403] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.219s	user 0.022s	sys 0.020s
I20260709 13:19:45.674477 18300 raft_consensus.cc:359] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.675340 18300 raft_consensus.cc:385] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.675623 18300 raft_consensus.cc:740] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.676370 18300 consensus_queue.cc:260] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.680509 18300 ts_tablet_manager.cc:1434] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:45.680259 18473 consensus_queue.cc:1048] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:19:45.681629 18300 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
W20260709 13:19:45.681895 18468 log.cc:927] Time spent T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 13:19:45.684386 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9163e7694071456bb2b68a6858e44443" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.684573 18348 raft_consensus.cc:493] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.689098 18297 tablet_bootstrap.cc:654] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.692842 18102 raft_consensus.cc:2393] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:45.691047 18348 raft_consensus.cc:515] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.699047 18348 leader_election.cc:290] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:45.702916 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fc415ccc6740a7ab53f700cb2a82c8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:45.704612 17994 leader_election.cc:343] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.704958 17995 leader_election.cc:304] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:45.705473 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fc415ccc6740a7ab53f700cb2a82c8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:45.706902 17992 leader_election.cc:343] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.707372 17992 leader_election.cc:304] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.708549 18348 raft_consensus.cc:2749] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:45.716112 18250 raft_consensus.cc:2468] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:45.717760 18348 raft_consensus.cc:3060] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.718945 18356 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.719324 18309 consensus_queue.cc:1048] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.721115 18356 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:45.722286 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:45.723487 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:45.724225 18251 raft_consensus.cc:3060] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:45.724391 18070 leader_election.cc:343] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.725227 17925 catalog_manager.cc:5697] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:45.732976 18067 consensus_peers.cc:597] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:45.735846 18144 leader_election.cc:304] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.739051 18300 tablet_bootstrap.cc:654] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:45.740554 18067 consensus_peers.cc:597] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:45.745914 18348 raft_consensus.cc:2749] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:45.752734 18473 raft_consensus.cc:2804] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.753930 18473 raft_consensus.cc:697] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:45.766494 18298 tablet_bootstrap.cc:654] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.767987 18367 consensus_queue.cc:1048] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:45.768329 18337 raft_consensus.cc:493] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.780678 18337 raft_consensus.cc:515] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.788872 18356 raft_consensus.cc:493] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.789572 18356 raft_consensus.cc:515] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.794811 18337 leader_election.cc:290] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:45.796204 17926 catalog_manager.cc:5697] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.797400 18356 leader_election.cc:290] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:45.804080 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:45.804841 18103 raft_consensus.cc:2468] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:45.808156 18143 leader_election.cc:304] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:45.754823 18473 consensus_queue.cc:237] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.813632 18297 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:45.814180 18297 ts_tablet_manager.cc:1403] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.363s	user 0.011s	sys 0.009s
I20260709 13:19:45.810580 18337 raft_consensus.cc:2804] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:45.819676 18337 raft_consensus.cc:493] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.820080 18337 raft_consensus.cc:3060] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.822139 17923 catalog_manager.cc:5697] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.818902 18297 raft_consensus.cc:359] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.827327 18297 raft_consensus.cc:385] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.827718 18297 raft_consensus.cc:740] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.828606 18297 consensus_queue.cc:260] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.829075 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.831138 18297 ts_tablet_manager.cc:1434] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:19:45.833108 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:45.833225 18070 leader_election.cc:343] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.834654 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:45.836421 18297 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:45.837165 18300 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:45.837770 18300 ts_tablet_manager.cc:1403] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.156s	user 0.001s	sys 0.012s
I20260709 13:19:45.842310 18251 raft_consensus.cc:2468] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:45.888051 18070 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:45.889071 18356 raft_consensus.cc:2804] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.889833 18356 raft_consensus.cc:697] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:45.890746 18356 consensus_queue.cc:237] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.897461 18447 consensus_queue.cc:1048] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:45.901051 18144 leader_election.cc:343] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:45.901942 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 58622.8us
I20260709 13:19:45.903623 18303 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:45.904209 18303 ts_tablet_manager.cc:1403] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.331s	user 0.006s	sys 0.017s
I20260709 13:19:45.905957 18300 raft_consensus.cc:359] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.906523 18300 raft_consensus.cc:385] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.906736 18300 raft_consensus.cc:740] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
W20260709 13:19:45.908262 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 56881.3us
I20260709 13:19:45.910264 18337 raft_consensus.cc:515] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.913524 18351 consensus_queue.cc:1048] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:45.914444 18178 raft_consensus.cc:2393] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 830a192d6137410e8bd043588f0ed425 in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:45.907330 18300 consensus_queue.cc:260] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:45.906883 18303 raft_consensus.cc:359] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.918056 18303 raft_consensus.cc:385] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.918408 18303 raft_consensus.cc:740] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.920836 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:45.921792 18297 tablet_bootstrap.cc:654] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.923038 18303 consensus_queue.cc:260] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:45.924546 18067 leader_election.cc:304] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:45.926049 18303 ts_tablet_manager.cc:1434] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:19:45.927091 18303 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:45.926544 17925 catalog_manager.cc:5697] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.921478 18102 raft_consensus.cc:3060] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:45.923830 18300 ts_tablet_manager.cc:1434] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.086s	user 0.002s	sys 0.016s
I20260709 13:19:45.936314 18300 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:45.937415 18298 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:45.938045 18298 ts_tablet_manager.cc:1403] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.351s	user 0.008s	sys 0.011s
I20260709 13:19:45.940892 18408 consensus_queue.cc:1048] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:45.943202 18337 leader_election.cc:290] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:45.943775 18298 raft_consensus.cc:359] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.944566 18298 raft_consensus.cc:385] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.944835 18298 raft_consensus.cc:740] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.948007 18102 raft_consensus.cc:2468] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:45.952976 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:45.954607 18303 tablet_bootstrap.cc:654] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.954276 18367 raft_consensus.cc:2749] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:45.960582 18144 leader_election.cc:343] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:45.966747 18448 consensus_queue.cc:1048] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:45.967595 18143 leader_election.cc:304] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc
I20260709 13:19:45.968787 18408 raft_consensus.cc:2804] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:45.969314 18408 raft_consensus.cc:697] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:45.970170 18408 consensus_queue.cc:237] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:45.994400 18298 consensus_queue.cc:260] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:45.996747 18298 ts_tablet_manager.cc:1434] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:19:45.997785 18298 tablet_bootstrap.cc:492] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:45.997870 18303 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:45.998432 18303 ts_tablet_manager.cc:1403] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.005s
I20260709 13:19:46.005115 18300 tablet_bootstrap.cc:654] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.028921 18297 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:46.027545 18298 tablet_bootstrap.cc:654] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.034742 18297 ts_tablet_manager.cc:1403] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.193s	user 0.022s	sys 0.021s
I20260709 13:19:46.033556 18303 raft_consensus.cc:359] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.045302 18303 raft_consensus.cc:385] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.045668 18303 raft_consensus.cc:740] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.046387 18303 consensus_queue.cc:260] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.048955 18303 ts_tablet_manager.cc:1434] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.004s
I20260709 13:19:46.049985 18303 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:46.052489 18300 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:46.053593 18300 ts_tablet_manager.cc:1403] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.000s
I20260709 13:19:46.055729 18303 tablet_bootstrap.cc:654] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.056566 18300 raft_consensus.cc:359] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.055243 18297 raft_consensus.cc:359] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.059998 18297 raft_consensus.cc:385] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.057278 18300 raft_consensus.cc:385] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.060438 18300 raft_consensus.cc:740] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.061283 18300 consensus_queue.cc:260] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.063606 18300 ts_tablet_manager.cc:1434] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:46.065150 18300 tablet_bootstrap.cc:492] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:46.071290 18300 tablet_bootstrap.cc:654] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.074630 18367 raft_consensus.cc:493] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.075299 18367 raft_consensus.cc:515] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.076118 18303 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:46.076705 18303 ts_tablet_manager.cc:1403] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.006s
I20260709 13:19:46.077544 18367 leader_election.cc:290] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.077843 18300 tablet_bootstrap.cc:492] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:46.078325 18300 ts_tablet_manager.cc:1403] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:19:46.076102 17924 catalog_manager.cc:5697] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.079592 18303 raft_consensus.cc:359] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.080121 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fc415ccc6740a7ab53f700cb2a82c8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.080377 18303 raft_consensus.cc:385] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.080704 18303 raft_consensus.cc:740] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.080844 18298 tablet_bootstrap.cc:492] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:46.080811 18176 raft_consensus.cc:2468] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:46.081466 18298 ts_tablet_manager.cc:1403] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.011s
I20260709 13:19:46.080554 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fc415ccc6740a7ab53f700cb2a82c8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:46.082499 18067 leader_election.cc:304] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:46.083413 18367 raft_consensus.cc:2804] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.083896 18367 raft_consensus.cc:493] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.084247 18367 raft_consensus.cc:3060] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.084412 18303 consensus_queue.cc:260] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.086138 18300 raft_consensus.cc:359] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.086867 18303 ts_tablet_manager.cc:1434] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:19:46.086838 18300 raft_consensus.cc:385] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.087441 18300 raft_consensus.cc:740] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.088020 18303 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:46.082494 18026 raft_consensus.cc:2468] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:46.088369 18300 consensus_queue.cc:260] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.091444 18300 ts_tablet_manager.cc:1434] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:19:46.092803 18300 tablet_bootstrap.cc:492] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:46.094762 18303 tablet_bootstrap.cc:654] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.060287 18297 raft_consensus.cc:740] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.097630 18297 consensus_queue.cc:260] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.084223 18298 raft_consensus.cc:359] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.100260 18298 raft_consensus.cc:385] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.100569 18298 raft_consensus.cc:740] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.102846 18297 ts_tablet_manager.cc:1434] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:19:46.102165 17927 catalog_manager.cc:5697] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.104658 18297 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:46.107534 18300 tablet_bootstrap.cc:654] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.109848 18367 raft_consensus.cc:515] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.112182 18367 leader_election.cc:290] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.112751 18298 consensus_queue.cc:260] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.113250 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fc415ccc6740a7ab53f700cb2a82c8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:46.113435 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fc415ccc6740a7ab53f700cb2a82c8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:46.114691 18176 raft_consensus.cc:3060] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.114374 18026 raft_consensus.cc:3060] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.120360 18428 raft_consensus.cc:493] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.120906 18428 raft_consensus.cc:515] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.123183 18428 leader_election.cc:290] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.124014 18297 tablet_bootstrap.cc:654] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.124249 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:46.125815 18070 leader_election.cc:343] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.128223 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.128940 18178 raft_consensus.cc:2468] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:46.129846 18446 raft_consensus.cc:493] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.130445 18446 raft_consensus.cc:515] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.132808 18176 raft_consensus.cc:2468] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:46.135244 18067 leader_election.cc:304] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.136466 18067 leader_election.cc:304] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:46.137226 18423 raft_consensus.cc:2804] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.137789 18423 raft_consensus.cc:493] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.138005 18428 raft_consensus.cc:2804] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.139925 18423 raft_consensus.cc:3060] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.140151 18428 raft_consensus.cc:697] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:46.140858 18446 leader_election.cc:290] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.141700 18428 consensus_queue.cc:237] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.142786 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.143625 18102 raft_consensus.cc:2393] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:46.150394 18423 raft_consensus.cc:515] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.153244 18298 ts_tablet_manager.cc:1434] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:19:46.154676 18298 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:46.156836 18297 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:46.157502 18297 ts_tablet_manager.cc:1403] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.006s
I20260709 13:19:46.162376 18297 raft_consensus.cc:359] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.163116 18297 raft_consensus.cc:385] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.163488 18297 raft_consensus.cc:740] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.164281 18297 consensus_queue.cc:260] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.164623 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab3b20d1eec4e5c93ec3223184a53d3" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.165148 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:46.166502 18297 ts_tablet_manager.cc:1434] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:46.168480 18297 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:46.162974 18356 raft_consensus.cc:493] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.169901 18070 leader_election.cc:343] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.174090 18026 raft_consensus.cc:2468] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:46.175966 18356 raft_consensus.cc:515] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.171502 18215 leader_election.cc:304] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:46.182417 18367 raft_consensus.cc:493] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.183432 18367 raft_consensus.cc:515] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.184538 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.185252 18250 raft_consensus.cc:2468] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:46.185720 18423 leader_election.cc:290] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.186671 18298 tablet_bootstrap.cc:654] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.187390 18070 leader_election.cc:304] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:46.187865 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:46.188503 18176 raft_consensus.cc:3060] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.189160 18303 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:46.182061 18356 leader_election.cc:290] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:46.190057 18356 raft_consensus.cc:2804] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.190420 18356 raft_consensus.cc:493] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.190794 18356 raft_consensus.cc:3060] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.191681 18303 ts_tablet_manager.cc:1403] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.022s
I20260709 13:19:46.187299 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:46.193625 18067 leader_election.cc:343] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.194823 18367 leader_election.cc:290] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:46.194664 18303 raft_consensus.cc:359] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.184017 18446 raft_consensus.cc:3060] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.201972 18303 raft_consensus.cc:385] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.202337 18303 raft_consensus.cc:740] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.202713 18176 raft_consensus.cc:2468] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:46.201083 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.203094 18303 consensus_queue.cc:260] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.208817 18446 raft_consensus.cc:2749] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.210170 18300 tablet_bootstrap.cc:492] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:46.210407 18303 ts_tablet_manager.cc:1434] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.008s
I20260709 13:19:46.210743 18300 ts_tablet_manager.cc:1403] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.004s
I20260709 13:19:46.210927 18297 tablet_bootstrap.cc:654] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.211431 18303 tablet_bootstrap.cc:492] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:46.214457 18356 raft_consensus.cc:515] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.216264 18356 leader_election.cc:290] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:46.257583 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:46.262820 18070 leader_election.cc:343] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.266436 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
W20260709 13:19:46.269302 18070 leader_election.cc:343] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.281702 18300 raft_consensus.cc:359] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.283558 18300 raft_consensus.cc:385] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.284036 18300 raft_consensus.cc:740] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.285327 18300 consensus_queue.cc:260] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.288582 18300 ts_tablet_manager.cc:1434] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.001s
I20260709 13:19:46.290836 18300 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:46.295008 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:46.296168 18252 raft_consensus.cc:3060] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.300498 18300 tablet_bootstrap.cc:654] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.300781 18067 leader_election.cc:304] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
W20260709 13:19:46.303529 18070 leader_election.cc:343] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.304275 18070 leader_election.cc:304] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:46.320050 18455 raft_consensus.cc:493] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.321413 18392 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.321134 18455 raft_consensus.cc:515] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.322176 18392 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.324530 18455 leader_election.cc:290] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.336366 18348 raft_consensus.cc:493] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.338044 18473 raft_consensus.cc:493] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.338923 18473 raft_consensus.cc:515] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.340863 18298 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:46.341888 18298 ts_tablet_manager.cc:1403] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.187s	user 0.010s	sys 0.014s
I20260709 13:19:46.343840 18392 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:46.337625 18348 raft_consensus.cc:515] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.345450 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.345980 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:46.347083 18348 leader_election.cc:290] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:46.347559 18340 raft_consensus.cc:493] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.347956 18473 leader_election.cc:290] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:46.348390 18340 raft_consensus.cc:515] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.350592 18252 raft_consensus.cc:2468] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:46.351051 18340 leader_election.cc:290] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:46.350895 18144 leader_election.cc:304] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.356177 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.357519 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0918ff57517a4193add2df7b454631f8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.358546 18356 raft_consensus.cc:2749] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.359403 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f57aae4fb06403aaac8a835763ff266" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.360430 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f57aae4fb06403aaac8a835763ff266" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.360955 18356 raft_consensus.cc:493] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.362602 18248 raft_consensus.cc:2393] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:46.372221 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.372954 18408 raft_consensus.cc:2749] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.373565 18251 raft_consensus.cc:2393] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
I20260709 13:19:46.376956 17923 catalog_manager.cc:5697] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:46.384148 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 83745.3us
W20260709 13:19:46.381592 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 78214us
I20260709 13:19:46.388674 18070 leader_election.cc:304] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.389268 18028 raft_consensus.cc:3060] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.390909 18102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0918ff57517a4193add2df7b454631f8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.393050 18446 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.393877 18446 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.395288 18367 raft_consensus.cc:2804] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.396647 18446 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:46.385960 18303 tablet_bootstrap.cc:654] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.403154 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:46.405231 18215 leader_election.cc:343] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.364892 18356 raft_consensus.cc:515] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.410282 18356 leader_election.cc:290] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:46.412453 18367 raft_consensus.cc:697] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:46.414886 18298 raft_consensus.cc:359] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.415361 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c950171fa2384c128706fe4e1cc5c562" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.419675 18298 raft_consensus.cc:385] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.421743 18298 raft_consensus.cc:740] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
W20260709 13:19:46.423256 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 48981.1us
I20260709 13:19:46.424374 17992 leader_election.cc:304] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:46.428730 18309 raft_consensus.cc:3060] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.426343 18298 consensus_queue.cc:260] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.439335 18514 raft_consensus.cc:2804] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.440130 18514 raft_consensus.cc:697] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:46.440397 18026 raft_consensus.cc:3060] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.440605 18298 ts_tablet_manager.cc:1434] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.002s
I20260709 13:19:46.441305 18514 consensus_queue.cc:237] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.444321 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c950171fa2384c128706fe4e1cc5c562" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.442174 18298 tablet_bootstrap.cc:492] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:46.444352 17994 leader_election.cc:304] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
W20260709 13:19:46.449242 18067 leader_election.cc:343] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.450572 18473 consensus_queue.cc:1048] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.453374 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.463205 18298 tablet_bootstrap.cc:654] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.437709 18367 consensus_queue.cc:237] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.462962 17994 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
W20260709 13:19:46.476449 18070 leader_election.cc:343] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.477054 18070 leader_election.cc:304] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:46.478137 18512 raft_consensus.cc:2749] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:46.486152 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:46.496045 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 71780.6us
I20260709 13:19:46.498768 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:46.502996 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:46.521893 18473 consensus_queue.cc:1048] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.533977 18303 tablet_bootstrap.cc:492] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:46.534821 18303 ts_tablet_manager.cc:1403] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.324s	user 0.011s	sys 0.005s
W20260709 13:19:46.537672 18218 leader_election.cc:343] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.538262 18218 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.543098 18448 raft_consensus.cc:2749] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.548692 18515 raft_consensus.cc:2749] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.558557 18297 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:46.559428 18297 ts_tablet_manager.cc:1403] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.392s	user 0.035s	sys 0.031s
I20260709 13:19:46.560446 18300 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:46.561115 18300 ts_tablet_manager.cc:1403] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.271s	user 0.022s	sys 0.010s
I20260709 13:19:46.555965 18511 raft_consensus.cc:2749] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.550079 18144 leader_election.cc:304] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.563839 18473 raft_consensus.cc:2749] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.566577 18512 consensus_queue.cc:1048] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.572893 18512 consensus_queue.cc:1048] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:46.580988 18298 tablet_bootstrap.cc:492] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:46.581668 18298 ts_tablet_manager.cc:1403] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.004s
I20260709 13:19:46.580971 18297 raft_consensus.cc:359] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.584141 18473 consensus_queue.cc:1048] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:46.586191 18297 raft_consensus.cc:385] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.586557 18297 raft_consensus.cc:740] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.603724 18297 consensus_queue.cc:260] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.607372 18297 ts_tablet_manager.cc:1434] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.004s
I20260709 13:19:46.617301 18297 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:46.594427 18303 raft_consensus.cc:359] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.619726 18303 raft_consensus.cc:385] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.620136 18303 raft_consensus.cc:740] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.622851 18512 consensus_queue.cc:1048] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.623186 18303 consensus_queue.cc:260] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.625412 18300 raft_consensus.cc:359] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.626243 18300 raft_consensus.cc:385] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.626543 18300 raft_consensus.cc:740] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.630932 18298 raft_consensus.cc:359] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.631793 18298 raft_consensus.cc:385] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.632068 18298 raft_consensus.cc:740] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.633358 18298 consensus_queue.cc:260] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.636385 18298 ts_tablet_manager.cc:1434] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
W20260709 13:19:46.636688 18522 log.cc:927] Time spent T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
I20260709 13:19:46.627313 18300 consensus_queue.cc:260] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.640669 18298 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:46.644731 18303 ts_tablet_manager.cc:1434] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.110s	user 0.011s	sys 0.000s
I20260709 13:19:46.646346 18303 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:46.650475 18309 raft_consensus.cc:2749] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.654062 18303 tablet_bootstrap.cc:654] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.665946 18178 raft_consensus.cc:3060] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.666240 18177 raft_consensus.cc:3060] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.674218 18473 consensus_queue.cc:1048] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.674286 18300 ts_tablet_manager.cc:1434] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.001s
I20260709 13:19:46.682658 18300 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:46.723802 18514 consensus_queue.cc:1048] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:46.736477 18297 tablet_bootstrap.cc:654] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.743717 18300 tablet_bootstrap.cc:654] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.786087 18298 tablet_bootstrap.cc:654] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.807245 18448 raft_consensus.cc:493] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.810282 18448 raft_consensus.cc:515] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.832006 18512 raft_consensus.cc:493] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.832692 18512 raft_consensus.cc:515] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:46.833087 18448 leader_election.cc:290] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:46.836336 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:46.843665 18218 leader_election.cc:343] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.857273 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.858194 18174 raft_consensus.cc:2468] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:46.869153 18337 raft_consensus.cc:493] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.869808 18337 raft_consensus.cc:515] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.872557 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.874358 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:46.879388 18303 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:46.880050 18303 ts_tablet_manager.cc:1403] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.234s	user 0.019s	sys 0.017s
W20260709 13:19:46.880466 18070 leader_election.cc:343] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.869338 18512 leader_election.cc:290] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
W20260709 13:19:46.885198 18067 leader_election.cc:343] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.886691 18215 leader_election.cc:304] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.851425 17923 catalog_manager.cc:5697] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.889015 18297 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:46.889235 18448 raft_consensus.cc:2804] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.889575 18297 ts_tablet_manager.cc:1403] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.273s	user 0.013s	sys 0.024s
I20260709 13:19:46.889675 18448 raft_consensus.cc:493] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.890317 18448 raft_consensus.cc:3060] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.891276 18300 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:46.876262 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.891829 18300 ts_tablet_manager.cc:1403] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.210s	user 0.015s	sys 0.004s
I20260709 13:19:46.891871 18100 raft_consensus.cc:2468] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:46.892690 18297 raft_consensus.cc:359] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.893447 18297 raft_consensus.cc:385] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.893740 18297 raft_consensus.cc:740] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.893656 18143 leader_election.cc:304] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:46.894624 18340 raft_consensus.cc:2804] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.890427 18067 leader_election.cc:304] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:46.895097 18340 raft_consensus.cc:493] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.895987 18512 raft_consensus.cc:2749] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.895434 18297 consensus_queue.cc:260] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.874843 18337 leader_election.cc:290] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
W20260709 13:19:46.890201 18070 consensus_peers.cc:597] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.902623 18298 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:46.902829 18309 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.903203 18298 ts_tablet_manager.cc:1403] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.266s	user 0.031s	sys 0.032s
I20260709 13:19:46.903322 18309 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.883584 18303 raft_consensus.cc:359] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.904965 18303 raft_consensus.cc:385] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.905243 18303 raft_consensus.cc:740] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.895098 18300 raft_consensus.cc:359] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.905752 18300 raft_consensus.cc:385] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.888569 17923 catalog_manager.cc:5697] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.899250 18340 raft_consensus.cc:3060] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.906054 18300 raft_consensus.cc:740] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.906064 18303 consensus_queue.cc:260] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.907070 18300 consensus_queue.cc:260] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.908336 18309 leader_election.cc:290] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:46.901013 18297 ts_tablet_manager.cc:1434] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:19:46.908783 18303 ts_tablet_manager.cc:1434] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:19:46.906121 18298 raft_consensus.cc:359] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.912433 18298 raft_consensus.cc:385] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.913276 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:46.913929 18101 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:46.914705 18297 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:46.912727 18298 raft_consensus.cc:740] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.917503 18303 tablet_bootstrap.cc:492] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:46.920607 17994 leader_election.cc:304] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:46.914208 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.923436 18297 tablet_bootstrap.cc:654] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.924371 18309 raft_consensus.cc:2804] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.924794 18309 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.925137 18309 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.926741 18303 tablet_bootstrap.cc:654] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.931145 18298 consensus_queue.cc:260] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:46.937551 18252 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:46.948573 18340 raft_consensus.cc:515] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.951047 18340 leader_election.cc:290] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:46.951838 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
W20260709 13:19:46.953753 18070 consensus_peers.cc:597] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.957911 18300 ts_tablet_manager.cc:1434] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:19:46.960351 18446 raft_consensus.cc:493] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.960947 18446 raft_consensus.cc:515] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:46.966048 18448 raft_consensus.cc:515] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.964114 18101 raft_consensus.cc:3060] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.972034 18515 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.972599 18515 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.973511 18448 leader_election.cc:290] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:46.974756 18515 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:46.975791 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:46.976365 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:46.977072 18252 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
W20260709 13:19:46.977290 18218 leader_election.cc:343] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.978610 17995 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:46.979405 18515 raft_consensus.cc:2804] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.967670 18446 leader_election.cc:290] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:46.979837 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:46.979810 18515 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.980854 18515 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.981226 18178 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:46.981410 18298 ts_tablet_manager.cc:1434] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.078s	user 0.002s	sys 0.005s
I20260709 13:19:46.984177 18298 tablet_bootstrap.cc:492] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:46.989866 18515 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:46.993224 18300 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.000983 18298 tablet_bootstrap.cc:654] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.007643 18303 tablet_bootstrap.cc:492] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:47.009065 18303 ts_tablet_manager.cc:1403] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.001s
I20260709 13:19:47.007997 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:47.010162 18177 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.012418 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.000700 18101 raft_consensus.cc:2468] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:47.013314 18175 raft_consensus.cc:2393] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:47.014315 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:47.014927 18174 raft_consensus.cc:3060] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.016009 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.008102 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.016803 18101 raft_consensus.cc:2393] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:47.016949 18252 raft_consensus.cc:2468] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:47.018797 18297 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.019320 18297 ts_tablet_manager.cc:1403] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.026s
I20260709 13:19:47.012619 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:47.020175 18250 raft_consensus.cc:3060] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.020835 18300 tablet_bootstrap.cc:654] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.021763 18143 leader_election.cc:304] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:47.022105 18297 raft_consensus.cc:359] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.022699 18340 raft_consensus.cc:2804] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.023276 18340 raft_consensus.cc:697] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:47.024428 18340 consensus_queue.cc:237] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.022856 18297 raft_consensus.cc:385] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.029407 18297 raft_consensus.cc:740] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.030196 18297 consensus_queue.cc:260] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.019395 18516 consensus_queue.cc:1048] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:19:47.032967 18297 ts_tablet_manager.cc:1434] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:19:47.034204 18297 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.034471 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:47.035122 18252 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.992969 18309 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.024453 18515 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:47.050963 18303 raft_consensus.cc:359] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.056980 18297 tablet_bootstrap.cc:654] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.051913 18303 raft_consensus.cc:385] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.060101 18303 raft_consensus.cc:740] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.060935 18303 consensus_queue.cc:260] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.064339 18250 raft_consensus.cc:2468] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:47.090878 18303 ts_tablet_manager.cc:1434] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.001s
I20260709 13:19:47.067150 18215 leader_election.cc:304] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:47.092964 18300 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:47.093745 18300 ts_tablet_manager.cc:1403] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.102s	user 0.031s	sys 0.015s
I20260709 13:19:47.095654 18548 raft_consensus.cc:2749] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.096707 18300 raft_consensus.cc:359] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.097409 18300 raft_consensus.cc:385] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.097667 18300 raft_consensus.cc:740] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.098321 18300 consensus_queue.cc:260] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.108325 18252 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:47.108830 18174 raft_consensus.cc:2468] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:47.104039 18177 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:47.110008 18309 leader_election.cc:290] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:47.112191 18298 tablet_bootstrap.cc:492] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:47.112478 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:47.112727 18298 ts_tablet_manager.cc:1403] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.004s
I20260709 13:19:47.113170 18101 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.115967 18298 raft_consensus.cc:359] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.116693 18298 raft_consensus.cc:385] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.116964 18298 raft_consensus.cc:740] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.110265 17995 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:47.117621 18298 consensus_queue.cc:260] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.118654 18348 raft_consensus.cc:2804] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.119201 18348 raft_consensus.cc:697] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:47.120519 18300 ts_tablet_manager.cc:1434] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:19:47.121691 18300 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.120106 18348 consensus_queue.cc:237] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.121945 18297 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.122468 18297 ts_tablet_manager.cc:1403] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.005s
I20260709 13:19:47.123126 17927 catalog_manager.cc:5697] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.125478 18297 raft_consensus.cc:359] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.126245 18297 raft_consensus.cc:385] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.126513 18297 raft_consensus.cc:740] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.127180 18297 consensus_queue.cc:260] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.127856 18300 tablet_bootstrap.cc:654] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.119300 18298 ts_tablet_manager.cc:1434] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:19:47.131469 18298 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:47.144215 18297 ts_tablet_manager.cc:1434] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:19:47.145481 18297 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.148039 18303 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:47.151942 18297 tablet_bootstrap.cc:654] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.152182 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:47.152805 18252 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.184350 18303 tablet_bootstrap.cc:654] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.186771 18516 consensus_queue.cc:1048] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.188196 18215 leader_election.cc:304] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:47.194103 18548 raft_consensus.cc:2804] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.194644 18548 raft_consensus.cc:697] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:47.195369 18300 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:47.195973 18300 ts_tablet_manager.cc:1403] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.028s
I20260709 13:19:47.195467 18548 consensus_queue.cc:237] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.198455 17923 catalog_manager.cc:5697] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.197470 18252 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:47.203657 18101 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:47.205054 18297 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.204963 17994 leader_election.cc:304] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:47.205600 18297 ts_tablet_manager.cc:1403] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.014s
I20260709 13:19:47.205881 18348 raft_consensus.cc:2804] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.206401 18348 raft_consensus.cc:697] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:47.207211 18348 consensus_queue.cc:237] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.210528 18300 raft_consensus.cc:359] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.211207 18300 raft_consensus.cc:385] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.211469 18300 raft_consensus.cc:740] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.212164 18300 consensus_queue.cc:260] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.213261 18297 raft_consensus.cc:359] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.213933 18297 raft_consensus.cc:385] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.214186 18297 raft_consensus.cc:740] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.214946 18297 consensus_queue.cc:260] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.217078 18297 ts_tablet_manager.cc:1434] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:19:47.218116 18297 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.228513 18300 ts_tablet_manager.cc:1434] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:19:47.232616 18300 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.235428 18298 tablet_bootstrap.cc:654] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.238282 18297 tablet_bootstrap.cc:654] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.239916 18303 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:47.241155 18303 ts_tablet_manager.cc:1403] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.011s
I20260709 13:19:47.254359 18300 tablet_bootstrap.cc:654] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.250345 18303 raft_consensus.cc:359] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.260131 18303 raft_consensus.cc:385] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.260682 18303 raft_consensus.cc:740] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.261641 18303 consensus_queue.cc:260] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.261538 17923 catalog_manager.cc:5697] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.274463 18300 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:47.275054 18300 ts_tablet_manager.cc:1403] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.015s
I20260709 13:19:47.275336 18297 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.275887 18297 ts_tablet_manager.cc:1403] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.006s
I20260709 13:19:47.277184 18298 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:47.277710 18298 ts_tablet_manager.cc:1403] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.008s
I20260709 13:19:47.278412 18303 ts_tablet_manager.cc:1434] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:19:47.280690 18300 raft_consensus.cc:359] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.281720 18300 raft_consensus.cc:385] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.281989 18300 raft_consensus.cc:740] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.282219 17924 catalog_manager.cc:5697] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.282765 18300 consensus_queue.cc:260] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.285491 18300 ts_tablet_manager.cc:1434] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:19:47.285856 18298 raft_consensus.cc:359] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.286573 18298 raft_consensus.cc:385] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.286893 18298 raft_consensus.cc:740] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.287103 18300 tablet_bootstrap.cc:492] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.287798 18298 consensus_queue.cc:260] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.291388 18298 ts_tablet_manager.cc:1434] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:47.292968 18298 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:47.285353 18297 raft_consensus.cc:359] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.293529 18297 raft_consensus.cc:385] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.293859 18297 raft_consensus.cc:740] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.294616 18297 consensus_queue.cc:260] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.296723 18297 ts_tablet_manager.cc:1434] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:19:47.297860 18297 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.301182 18300 tablet_bootstrap.cc:654] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.302471 18337 raft_consensus.cc:493] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.303007 18337 raft_consensus.cc:515] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.303541 18297 tablet_bootstrap.cc:654] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.305179 18337 leader_election.cc:290] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:47.310676 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c950171fa2384c128706fe4e1cc5c562" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.311460 18101 raft_consensus.cc:2468] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:47.312943 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c950171fa2384c128706fe4e1cc5c562" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.313632 18251 raft_consensus.cc:2468] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:47.318643 18143 leader_election.cc:304] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:47.319629 18298 tablet_bootstrap.cc:654] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.321337 18348 raft_consensus.cc:493] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.322362 18303 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:47.321947 18348 raft_consensus.cc:515] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.326210 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.326799 18348 leader_election.cc:290] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:47.326375 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.329463 18303 tablet_bootstrap.cc:654] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.329726 17994 leader_election.cc:304] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:47.332135 18428 raft_consensus.cc:493] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.332720 18428 raft_consensus.cc:515] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.334987 18428 leader_election.cc:290] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:47.332597 18309 raft_consensus.cc:2749] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.340835 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fc24e67dd34b168bc7110e7b8bdfa3" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.357105 18297 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.357700 18297 ts_tablet_manager.cc:1403] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.029s
I20260709 13:19:47.358397 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fc24e67dd34b168bc7110e7b8bdfa3" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.359841 18251 raft_consensus.cc:2468] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:47.360524 18297 raft_consensus.cc:359] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.359172 18337 raft_consensus.cc:2804] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.367293 18337 raft_consensus.cc:493] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.367784 18337 raft_consensus.cc:3060] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.369268 18298 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:47.369735 18298 ts_tablet_manager.cc:1403] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.007s
W20260709 13:19:47.362691 18070 leader_election.cc:343] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.377451 18298 raft_consensus.cc:359] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.378783 18298 raft_consensus.cc:385] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.379076 18298 raft_consensus.cc:740] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.377988 18070 leader_election.cc:304] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:47.380209 18516 raft_consensus.cc:2804] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.380615 18516 raft_consensus.cc:493] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.380937 18516 raft_consensus.cc:3060] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.388374 18298 consensus_queue.cc:260] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.391454 18298 ts_tablet_manager.cc:1434] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:19:47.387428 18516 raft_consensus.cc:515] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.393263 18298 tablet_bootstrap.cc:492] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:47.394630 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fc24e67dd34b168bc7110e7b8bdfa3" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:47.395293 18251 raft_consensus.cc:3060] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.397516 18297 raft_consensus.cc:385] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.397832 18297 raft_consensus.cc:740] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.398561 18297 consensus_queue.cc:260] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.408281 18512 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.408891 18512 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.410892 18300 tablet_bootstrap.cc:492] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:47.411495 18512 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:47.411969 18251 raft_consensus.cc:2468] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:47.412081 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.387326 18337 raft_consensus.cc:515] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.415233 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:47.415719 18067 leader_election.cc:343] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.412437 18300 ts_tablet_manager.cc:1403] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.001s
I20260709 13:19:47.418151 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c950171fa2384c128706fe4e1cc5c562" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:47.418651 18473 raft_consensus.cc:493] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.418764 18101 raft_consensus.cc:3060] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.419176 18300 raft_consensus.cc:359] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.419229 18473 raft_consensus.cc:515] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.421875 18473 leader_election.cc:290] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:47.422549 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.423246 18028 raft_consensus.cc:2468] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
W20260709 13:19:47.424861 18070 leader_election.cc:343] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.425261 18144 leader_election.cc:304] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:47.425285 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.425740 18516 leader_election.cc:290] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:47.426280 18473 raft_consensus.cc:2804] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.426236 18100 raft_consensus.cc:2468] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:47.426831 18473 raft_consensus.cc:493] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.427287 18473 raft_consensus.cc:3060] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.428200 18298 tablet_bootstrap.cc:654] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.420054 18300 raft_consensus.cc:385] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.428602 18300 raft_consensus.cc:740] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.429513 18300 consensus_queue.cc:260] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.428329 18297 ts_tablet_manager.cc:1434] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.004s
I20260709 13:19:47.432021 18101 raft_consensus.cc:2468] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:47.434846 18297 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.425367 18070 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:47.436029 18337 leader_election.cc:290] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:47.437230 18143 leader_election.cc:304] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:47.438604 18340 raft_consensus.cc:2804] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.445231 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c950171fa2384c128706fe4e1cc5c562" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:47.450207 18251 raft_consensus.cc:3060] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.453356 18473 raft_consensus.cc:515] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.447890 18516 raft_consensus.cc:2749] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.447212 18070 leader_election.cc:304] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:47.450650 18297 tablet_bootstrap.cc:654] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.447954 18300 ts_tablet_manager.cc:1434] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:19:47.456317 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:47.456318 18512 raft_consensus.cc:2804] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.457072 18101 raft_consensus.cc:3060] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.457190 18512 raft_consensus.cc:697] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:47.458256 18512 consensus_queue.cc:237] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.451375 18303 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:47.460646 18303 ts_tablet_manager.cc:1403] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.139s	user 0.039s	sys 0.040s
I20260709 13:19:47.458312 18300 tablet_bootstrap.cc:492] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.466964 18300 tablet_bootstrap.cc:654] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.469624 18303 raft_consensus.cc:359] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.470326 18303 raft_consensus.cc:385] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.470499 18303 raft_consensus.cc:740] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.471053 18303 consensus_queue.cc:260] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.473313 18303 ts_tablet_manager.cc:1434] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:19:47.473486 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fc24e67dd34b168bc7110e7b8bdfa3" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:47.474151 18025 raft_consensus.cc:3060] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.474368 18303 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:47.476320 18570 consensus_queue.cc:1048] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.478528 18300 tablet_bootstrap.cc:492] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:47.479082 18300 ts_tablet_manager.cc:1403] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:19:47.455211 18473 leader_election.cc:290] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:47.456065 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:47.483672 18297 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.493736 18340 raft_consensus.cc:697] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:47.498226 18297 ts_tablet_manager.cc:1403] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:19:47.490276 18300 raft_consensus.cc:359] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.499054 18300 raft_consensus.cc:385] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.499372 18300 raft_consensus.cc:740] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.500376 18300 consensus_queue.cc:260] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.504032 18300 ts_tablet_manager.cc:1434] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.004s
I20260709 13:19:47.501356 18297 raft_consensus.cc:359] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.501667 18340 consensus_queue.cc:237] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.496799 17927 catalog_manager.cc:5697] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.507263 18309 raft_consensus.cc:493] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.495855 18298 tablet_bootstrap.cc:492] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:47.508121 18298 ts_tablet_manager.cc:1403] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.115s	user 0.023s	sys 0.021s
I20260709 13:19:47.497438 18025 raft_consensus.cc:2468] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:47.507843 18309 raft_consensus.cc:515] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.501799 18101 raft_consensus.cc:2468] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:47.511260 18309 leader_election.cc:290] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:47.493840 18251 raft_consensus.cc:2468] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:47.496858 18028 raft_consensus.cc:3060] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.506250 18300 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.519237 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.519629 18297 raft_consensus.cc:385] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.523928 18297 raft_consensus.cc:740] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.520666 18569 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.514760 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27094133c5bd4d54ae86e99d83396dec" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.521308 18143 leader_election.cc:304] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:47.525224 18297 consensus_queue.cc:260] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.527519 18297 ts_tablet_manager.cc:1434] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:19:47.527902 17995 leader_election.cc:304] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:47.528538 18569 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.540017 18297 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.541675 18569 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:47.528716 18028 raft_consensus.cc:2468] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:47.514789 18298 raft_consensus.cc:359] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.543232 18298 raft_consensus.cc:385] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.542438 17924 catalog_manager.cc:5697] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.542281 18309 raft_consensus.cc:2749] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.535519 18340 raft_consensus.cc:2804] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.544404 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.543521 18298 raft_consensus.cc:740] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.545657 18298 consensus_queue.cc:260] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.546926 18297 tablet_bootstrap.cc:654] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:47.547899 18144 leader_election.cc:343] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.554057 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.560478 18298 ts_tablet_manager.cc:1434] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260709 13:19:47.544543 18340 raft_consensus.cc:697] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:47.562692 18298 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:47.562671 18309 consensus_queue.cc:1048] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:47.561182 18144 leader_election.cc:343] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.538868 18300 tablet_bootstrap.cc:654] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.567027 18348 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.567628 18348 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.570155 18348 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:47.561239 18028 raft_consensus.cc:3060] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.572294 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.573022 18103 raft_consensus.cc:2468] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:47.573567 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.574398 17994 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
W20260709 13:19:47.575367 17992 leader_election.cc:343] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.576725 18348 raft_consensus.cc:2804] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.577196 18348 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.577569 18348 raft_consensus.cc:3060] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.563383 18340 consensus_queue.cc:237] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.583241 18144 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:47.587296 18570 raft_consensus.cc:2749] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.588184 18570 consensus_queue.cc:1048] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.597891 18298 tablet_bootstrap.cc:654] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.535533 18303 tablet_bootstrap.cc:654] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.620695 18548 raft_consensus.cc:493] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.621296 18548 raft_consensus.cc:515] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.622208 18511 consensus_queue.cc:1048] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.624938 18348 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.625481 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.628199 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:47.628808 18100 raft_consensus.cc:3060] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.630369 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.623500 18548 leader_election.cc:290] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:47.608172 18309 raft_consensus.cc:493] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.639267 18218 leader_election.cc:343] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.641167 18309 raft_consensus.cc:515] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.676347 18298 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:47.677721 18298 ts_tablet_manager.cc:1403] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.005s
I20260709 13:19:47.677910 18309 leader_election.cc:290] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:47.679163 18356 raft_consensus.cc:493] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.679797 18356 raft_consensus.cc:515] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.655927 18512 raft_consensus.cc:493] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.655427 18215 leader_election.cc:343] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.681797 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.682194 18512 raft_consensus.cc:515] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.656584 18348 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:47.673943 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
W20260709 13:19:47.701099 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:47.698814 18100 raft_consensus.cc:2468] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:47.702798 18512 leader_election.cc:290] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:47.703907 18356 leader_election.cc:290] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:47.705567 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a010bb50f906431fa93244db273529cb" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.706455 18175 raft_consensus.cc:2393] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:47.700776 18215 leader_election.cc:304] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
W20260709 13:19:47.713516 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 68136.5us
I20260709 13:19:47.716012 18548 raft_consensus.cc:2749] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.717959 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:47.722050 18067 leader_election.cc:343] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.725907 17995 leader_election.cc:304] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
W20260709 13:19:47.726027 17992 leader_election.cc:343] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.729947 18300 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:47.730571 18300 ts_tablet_manager.cc:1403] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.225s	user 0.022s	sys 0.014s
I20260709 13:19:47.723973 17924 catalog_manager.cc:5697] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.727406 18511 raft_consensus.cc:3060] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.743436 18356 raft_consensus.cc:493] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.744190 18356 raft_consensus.cc:515] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.745405 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.733855 18582 consensus_queue.cc:1048] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:19:47.749735 18300 raft_consensus.cc:359] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.752024 18300 raft_consensus.cc:385] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.752435 18300 raft_consensus.cc:740] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.752568 18298 raft_consensus.cc:359] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.754310 18298 raft_consensus.cc:385] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.754563 18298 raft_consensus.cc:740] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.755594 18300 consensus_queue.cc:260] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.757881 18025 raft_consensus.cc:3060] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.756409 18298 consensus_queue.cc:260] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.762755 18300 ts_tablet_manager.cc:1434] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:19:47.766580 18300 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:47.754905 18448 raft_consensus.cc:493] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.760567 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c73929e277490a8d8e29869c87f676" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.767958 18448 raft_consensus.cc:515] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
W20260709 13:19:47.769101 18067 leader_election.cc:343] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.770087 18448 leader_election.cc:290] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:47.749198 18356 leader_election.cc:290] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:47.771826 18298 ts_tablet_manager.cc:1434] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.001s
I20260709 13:19:47.784742 18303 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:47.785749 18303 ts_tablet_manager.cc:1403] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.312s	user 0.051s	sys 0.020s
I20260709 13:19:47.780443 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:47.793247 18300 tablet_bootstrap.cc:654] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.793604 18298 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:47.794189 18297 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:47.795130 18297 ts_tablet_manager.cc:1403] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.255s	user 0.055s	sys 0.072s
I20260709 13:19:47.790364 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.764606 17994 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:47.797400 18100 raft_consensus.cc:2468] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:47.800876 18217 leader_election.cc:304] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:47.788600 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.802151 18250 raft_consensus.cc:2468] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:47.808393 18303 raft_consensus.cc:359] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.809158 18303 raft_consensus.cc:385] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.809412 18303 raft_consensus.cc:740] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.804948 18548 raft_consensus.cc:2804] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.810076 18303 consensus_queue.cc:260] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.810562 18548 raft_consensus.cc:493] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.811018 18548 raft_consensus.cc:3060] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.797372 18516 raft_consensus.cc:493] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.811791 18348 raft_consensus.cc:2804] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.819114 18348 raft_consensus.cc:697] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:47.814558 18516 raft_consensus.cc:515] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:47.821965 18516 leader_election.cc:290] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
W20260709 13:19:47.822216 18070 leader_election.cc:343] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.824820 18348 consensus_queue.cc:237] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:47.828487 18297 raft_consensus.cc:359] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.829216 18297 raft_consensus.cc:385] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.829923 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c73929e277490a8d8e29869c87f676" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:47.843888 18303 ts_tablet_manager.cc:1434] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.058s	user 0.002s	sys 0.006s
I20260709 13:19:47.845208 18303 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
W20260709 13:19:47.849786 18583 log.cc:927] Time spent T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:47.850795 18297 raft_consensus.cc:740] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.851687 18297 consensus_queue.cc:260] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.853955 18297 ts_tablet_manager.cc:1434] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:19:47.855020 18297 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:47.872718 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.875397 18548 raft_consensus.cc:515] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:47.876474 18511 raft_consensus.cc:2749] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.876956 18297 tablet_bootstrap.cc:654] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:47.816583 17994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 56952.8us
I20260709 13:19:47.883549 18446 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.894989 18446 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:47.894942 18582 consensus_queue.cc:1048] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:47.900445 18303 tablet_bootstrap.cc:654] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.902295 18446 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:47.903246 18298 tablet_bootstrap.cc:654] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:47.893775 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 65410.5us
I20260709 13:19:47.906010 18446 consensus_queue.cc:1048] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.907145 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:47.907833 18101 raft_consensus.cc:3060] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.895102 18548 leader_election.cc:290] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:47.917569 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:47.918331 18025 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:47.919473 18218 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:47.923141 18548 raft_consensus.cc:2804] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.923520 18548 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.923863 18548 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:47.893945 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 63135.1us
I20260709 13:19:47.944941 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.959533 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
W20260709 13:19:47.929752 18070 leader_election.cc:343] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.975513 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:47.985809 18570 consensus_queue.cc:1048] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.998019 18175 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:47.988492 18473 consensus_queue.cc:1048] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.992611 18101 raft_consensus.cc:2468] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:47.993831 18446 consensus_queue.cc:1048] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:47.999063 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 71056.5us
I20260709 13:19:48.000540 18548 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:48.002426 18070 leader_election.cc:343] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.002928 18070 leader_election.cc:304] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.004104 18590 raft_consensus.cc:2749] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.003377 18217 leader_election.cc:304] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:48.004588 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:48.005321 18070 leader_election.cc:304] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:48.006196 18590 raft_consensus.cc:2764] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:19:48.005450 18446 raft_consensus.cc:2804] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.007117 18446 raft_consensus.cc:697] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:48.005352 18025 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:48.006758 18070 leader_election.cc:343] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.008453 18070 leader_election.cc:304] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:48.009188 18356 raft_consensus.cc:2749] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:47.995672 18215 leader_election.cc:343] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.996546 18303 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:48.013839 18303 ts_tablet_manager.cc:1403] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.031s
W20260709 13:19:48.018049 18215 leader_election.cc:343] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.020340 18303 raft_consensus.cc:359] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.021178 18303 raft_consensus.cc:385] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.021445 18303 raft_consensus.cc:740] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.008246 18446 consensus_queue.cc:237] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.025331 18300 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:48.025956 18300 ts_tablet_manager.cc:1403] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.260s	user 0.016s	sys 0.027s
I20260709 13:19:48.022183 18303 consensus_queue.cc:260] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.025715 18025 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:48.035677 18218 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:48.039374 18356 consensus_queue.cc:1048] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.040323 18303 ts_tablet_manager.cc:1434] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:19:48.041469 18303 tablet_bootstrap.cc:492] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:48.045431 18593 raft_consensus.cc:2804] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.048274 18548 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:48.051705 18300 raft_consensus.cc:359] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.057626 18300 raft_consensus.cc:385] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.057911 18300 raft_consensus.cc:740] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.058439 18297 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:48.059254 18473 consensus_queue.cc:1048] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.060133 18300 consensus_queue.cc:260] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.061687 18297 ts_tablet_manager.cc:1403] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.005s
I20260709 13:19:48.064271 18300 ts_tablet_manager.cc:1434] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:19:48.065501 18300 tablet_bootstrap.cc:492] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:48.065292 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.069090 18297 raft_consensus.cc:359] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.070595 18593 raft_consensus.cc:697] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:48.072089 18593 consensus_queue.cc:237] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.078938 18570 raft_consensus.cc:493] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.079640 18570 raft_consensus.cc:515] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.089872 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:48.091724 18570 leader_election.cc:290] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:48.094110 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.096889 18250 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:48.102797 18303 tablet_bootstrap.cc:654] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.111054 18297 raft_consensus.cc:385] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.111435 18297 raft_consensus.cc:740] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.112215 18297 consensus_queue.cc:260] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.113166 18298 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.105916 17923 catalog_manager.cc:5697] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.110642 18300 tablet_bootstrap.cc:654] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.113432 18029 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:48.120358 18473 consensus_queue.cc:1048] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.122429 18144 leader_election.cc:304] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:48.123839 18337 raft_consensus.cc:2804] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.124256 18337 raft_consensus.cc:493] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.124629 18337 raft_consensus.cc:3060] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.113806 18298 ts_tablet_manager.cc:1403] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.322s	user 0.015s	sys 0.026s
I20260709 13:19:48.129285 18298 raft_consensus.cc:359] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.130122 18298 raft_consensus.cc:385] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.130466 18298 raft_consensus.cc:740] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.115547 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:48.131449 18175 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.132064 18298 consensus_queue.cc:260] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.135169 18298 ts_tablet_manager.cc:1434] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:19:48.137079 18337 raft_consensus.cc:515] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.144165 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:48.144888 18029 raft_consensus.cc:3060] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.145380 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:48.146132 18248 raft_consensus.cc:3060] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.147145 18298 tablet_bootstrap.cc:492] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:48.149731 18175 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:48.151405 18593 raft_consensus.cc:493] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.152071 18593 raft_consensus.cc:515] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.153585 18298 tablet_bootstrap.cc:654] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.153622 18029 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:48.154186 18248 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:48.155192 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:48.156107 18593 leader_election.cc:290] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.117849 18297 ts_tablet_manager.cc:1434] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
W20260709 13:19:48.117044 18070 leader_election.cc:343] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:48.157071 18218 leader_election.cc:343] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.157258 18070 leader_election.cc:304] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.158540 18144 leader_election.cc:304] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:48.159466 18570 raft_consensus.cc:2804] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.160307 18570 raft_consensus.cc:697] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:48.160893 18337 leader_election.cc:290] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:48.161222 18570 consensus_queue.cc:237] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.164057 18356 raft_consensus.cc:2749] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.164677 18590 consensus_queue.cc:1048] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.166518 18298 tablet_bootstrap.cc:492] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.167063 18298 ts_tablet_manager.cc:1403] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.008s
I20260709 13:19:48.167466 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.168351 18100 raft_consensus.cc:2468] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:48.159651 18297 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:48.169427 18217 leader_election.cc:304] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.170749 18548 raft_consensus.cc:2804] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.171140 18548 raft_consensus.cc:493] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.171468 18548 raft_consensus.cc:3060] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.176625 18298 raft_consensus.cc:359] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.177448 18298 raft_consensus.cc:385] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.177704 18298 raft_consensus.cc:740] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.178423 18298 consensus_queue.cc:260] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.181191 18590 raft_consensus.cc:493] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.181768 18590 raft_consensus.cc:515] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.185247 18298 ts_tablet_manager.cc:1434] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:48.185606 18590 leader_election.cc:290] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:48.186199 18303 tablet_bootstrap.cc:492] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:48.186488 18298 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:48.186715 18303 ts_tablet_manager.cc:1403] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.008s
I20260709 13:19:48.187934 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:48.189553 18303 raft_consensus.cc:359] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.190330 18303 raft_consensus.cc:385] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.190578 18303 raft_consensus.cc:740] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
W20260709 13:19:48.191257 18067 leader_election.cc:343] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.198113 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:48.200634 18298 tablet_bootstrap.cc:654] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.191284 18303 consensus_queue.cc:260] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
W20260709 13:19:48.210253 18070 leader_election.cc:343] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.210867 18070 leader_election.cc:304] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.210465 18303 ts_tablet_manager.cc:1434] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:19:48.211702 18590 raft_consensus.cc:2749] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.216318 18303 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:48.216023 17926 catalog_manager.cc:5697] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.220707 17926 catalog_manager.cc:5697] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.229837 18303 tablet_bootstrap.cc:654] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.241271 18303 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:48.241859 18303 ts_tablet_manager.cc:1403] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.007s
I20260709 13:19:48.245029 18303 raft_consensus.cc:359] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.245841 18303 raft_consensus.cc:385] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.246124 18303 raft_consensus.cc:740] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.247112 18303 consensus_queue.cc:260] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.218365 18298 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.250052 18298 ts_tablet_manager.cc:1403] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:19:48.254026 18511 consensus_queue.cc:1048] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.254709 18303 ts_tablet_manager.cc:1434] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:19:48.255961 18303 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:48.256721 18298 raft_consensus.cc:359] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.257412 18298 raft_consensus.cc:385] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.257699 18298 raft_consensus.cc:740] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.198282 18548 raft_consensus.cc:515] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.261933 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:48.263321 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
W20260709 13:19:48.263535 18218 leader_election.cc:343] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.264058 18101 raft_consensus.cc:3060] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.269253 18548 leader_election.cc:290] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.271212 18300 tablet_bootstrap.cc:492] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:48.272934 18300 ts_tablet_manager.cc:1403] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.208s	user 0.051s	sys 0.019s
I20260709 13:19:48.274664 18101 raft_consensus.cc:2468] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:48.275946 18300 raft_consensus.cc:359] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.276281 18217 leader_election.cc:304] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.276674 18300 raft_consensus.cc:385] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.277002 18300 raft_consensus.cc:740] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.277607 18593 raft_consensus.cc:2804] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.278185 18593 raft_consensus.cc:697] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:48.278580 17924 catalog_manager.cc:5697] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.279026 18593 consensus_queue.cc:237] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.282909 18303 tablet_bootstrap.cc:654] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.288232 18303 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:48.288820 18303 ts_tablet_manager.cc:1403] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.007s
I20260709 13:19:48.289232 18175 raft_consensus.cc:3060] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.291703 18303 raft_consensus.cc:359] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.292461 18303 raft_consensus.cc:385] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.292711 18303 raft_consensus.cc:740] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.293351 18303 consensus_queue.cc:260] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.295779 18303 ts_tablet_manager.cc:1434] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:48.296871 18303 tablet_bootstrap.cc:492] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:48.300976 18511 consensus_queue.cc:1048] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.304368 18303 tablet_bootstrap.cc:654] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.305218 18300 consensus_queue.cc:260] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.309423 18300 ts_tablet_manager.cc:1434] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 13:19:48.311957 18300 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:48.316088 18297 tablet_bootstrap.cc:654] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.318184 18300 tablet_bootstrap.cc:654] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.337574 18298 consensus_queue.cc:260] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.338718 18548 raft_consensus.cc:493] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.339398 18548 raft_consensus.cc:515] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.345552 18548 leader_election.cc:290] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.346505 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.348151 18548 raft_consensus.cc:493] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.348798 18548 raft_consensus.cc:515] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.353366 18548 leader_election.cc:290] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:48.354084 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c73929e277490a8d8e29869c87f676" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.354856 18101 raft_consensus.cc:2468] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:48.355371 18337 raft_consensus.cc:493] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.355895 18337 raft_consensus.cc:515] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.356556 18298 ts_tablet_manager.cc:1434] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 13:19:48.357887 18298 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:48.358414 18217 leader_election.cc:304] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:48.354092 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:48.360350 18548 raft_consensus.cc:2804] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.360770 18548 raft_consensus.cc:493] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:48.360823 18218 leader_election.cc:343] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.361193 18548 raft_consensus.cc:3060] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.347371 18100 raft_consensus.cc:2468] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:48.363358 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c73929e277490a8d8e29869c87f676" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:48.373147 18356 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.378538 18297 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:48.379196 18297 ts_tablet_manager.cc:1403] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.220s	user 0.014s	sys 0.002s
I20260709 13:19:48.379258 18303 tablet_bootstrap.cc:492] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:48.379989 18217 leader_election.cc:304] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.380982 18570 raft_consensus.cc:493] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.380017 18356 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.381340 18606 raft_consensus.cc:2804] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.382411 18606 raft_consensus.cc:493] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.382764 18606 raft_consensus.cc:3060] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.383771 18356 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:48.386003 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:48.371969 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:48.387883 18067 leader_election.cc:343] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.391875 18303 ts_tablet_manager.cc:1403] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.028s
W20260709 13:19:48.392787 18215 leader_election.cc:343] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:48.394752 18144 leader_election.cc:343] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.398519 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.402673 18337 leader_election.cc:290] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.403807 18570 raft_consensus.cc:515] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.406317 18570 leader_election.cc:290] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:48.410012 18606 raft_consensus.cc:515] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:48.411149 18070 leader_election.cc:343] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.411692 18070 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:48.413092 18356 raft_consensus.cc:2749] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.415723 18298 tablet_bootstrap.cc:654] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.421482 17924 catalog_manager.cc:5697] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.417503 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.429024 18606 leader_election.cc:290] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.431655 18297 raft_consensus.cc:359] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.432441 18297 raft_consensus.cc:385] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.432744 18297 raft_consensus.cc:740] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.411558 18548 raft_consensus.cc:515] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.433481 18297 consensus_queue.cc:260] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.435092 18297 ts_tablet_manager.cc:1434] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.001s
I20260709 13:19:48.436141 18297 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:48.436606 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.422008 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:48.437292 18103 raft_consensus.cc:2468] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:48.438285 18300 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
W20260709 13:19:48.438251 18218 leader_election.cc:343] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.439002 18300 ts_tablet_manager.cc:1403] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.127s	user 0.033s	sys 0.058s
I20260709 13:19:48.439631 18548 leader_election.cc:290] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:48.441807 18300 raft_consensus.cc:359] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.442510 18300 raft_consensus.cc:385] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.442775 18300 raft_consensus.cc:740] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.443845 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:48.444482 18100 raft_consensus.cc:3060] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.444680 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c73929e277490a8d8e29869c87f676" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:48.445327 18103 raft_consensus.cc:3060] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.443378 18303 raft_consensus.cc:359] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.446139 18303 raft_consensus.cc:385] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.446414 18303 raft_consensus.cc:740] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.447077 18303 consensus_queue.cc:260] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.448899 18143 leader_election.cc:304] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.443588 18300 consensus_queue.cc:260] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.455003 18356 raft_consensus.cc:493] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.455494 18356 raft_consensus.cc:515] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.456398 18300 ts_tablet_manager.cc:1434] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:48.451120 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88eab1bc51e48fc9f75286f06f31b2d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.457602 18101 raft_consensus.cc:2393] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:48.458146 18300 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:48.458801 18340 raft_consensus.cc:2804] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.459226 18340 raft_consensus.cc:493] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.459533 18340 raft_consensus.cc:3060] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.465202 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.465415 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:48.468791 18070 leader_election.cc:343] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.472545 18103 raft_consensus.cc:2468] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:48.473942 18217 leader_election.cc:304] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:48.474891 18548 raft_consensus.cc:2804] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.475404 18548 raft_consensus.cc:697] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:48.476287 18548 consensus_queue.cc:237] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.478962 18356 leader_election.cc:290] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:48.485788 18300 tablet_bootstrap.cc:654] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.487169 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c73929e277490a8d8e29869c87f676" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:48.487776 18177 raft_consensus.cc:3060] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.487879 18174 raft_consensus.cc:3060] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.492200 18297 tablet_bootstrap.cc:654] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.498723 18298 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.499289 18298 ts_tablet_manager.cc:1403] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.016s
I20260709 13:19:48.500720 18174 raft_consensus.cc:2468] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:48.502239 18298 raft_consensus.cc:359] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.503014 18298 raft_consensus.cc:385] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.503295 18298 raft_consensus.cc:740] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.504081 18298 consensus_queue.cc:260] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.507663 18298 ts_tablet_manager.cc:1434] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:48.508826 18298 tablet_bootstrap.cc:492] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:48.514783 18298 tablet_bootstrap.cc:654] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.528604 18298 tablet_bootstrap.cc:492] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.529201 18298 ts_tablet_manager.cc:1403] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:19:48.532202 18298 raft_consensus.cc:359] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.533097 18298 raft_consensus.cc:385] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.533454 18298 raft_consensus.cc:740] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.533692 18340 raft_consensus.cc:515] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.449879 18303 ts_tablet_manager.cc:1434] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:19:48.547775 18303 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
W20260709 13:19:48.482095 18070 leader_election.cc:343] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.556018 18070 leader_election.cc:304] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.534272 18298 consensus_queue.cc:260] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.534819 18473 raft_consensus.cc:493] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.557508 18473 raft_consensus.cc:515] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.558295 18298 ts_tablet_manager.cc:1434] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:19:48.559508 18298 tablet_bootstrap.cc:492] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:48.561600 18473 leader_election.cc:290] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:48.544811 17924 catalog_manager.cc:5697] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.556836 18356 raft_consensus.cc:2749] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.562430 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.563822 18250 raft_consensus.cc:2468] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:48.567205 18303 tablet_bootstrap.cc:654] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.569839 18298 tablet_bootstrap.cc:654] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:48.556998 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 74960.9us
W20260709 13:19:48.582695 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 46739.3us
I20260709 13:19:48.583915 18143 leader_election.cc:304] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:48.584798 18337 raft_consensus.cc:2749] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.591101 18340 leader_election.cc:290] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.591427 18144 leader_election.cc:304] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:48.592592 18340 raft_consensus.cc:2804] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.593014 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:48.593032 18340 raft_consensus.cc:493] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.593950 18340 raft_consensus.cc:3060] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.594551 18548 consensus_queue.cc:1048] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.594005 18298 tablet_bootstrap.cc:492] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.595528 18298 ts_tablet_manager.cc:1403] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
W20260709 13:19:48.598750 18144 leader_election.cc:343] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.604669 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:48.606607 18144 leader_election.cc:343] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.609261 18297 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:48.609818 18297 ts_tablet_manager.cc:1403] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.174s	user 0.061s	sys 0.045s
I20260709 13:19:48.610019 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:48.610344 18340 raft_consensus.cc:515] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.610841 18103 raft_consensus.cc:3060] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.612583 18340 leader_election.cc:290] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:48.612950 18297 raft_consensus.cc:359] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.613534 18297 raft_consensus.cc:385] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.613736 18297 raft_consensus.cc:740] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.614324 18297 consensus_queue.cc:260] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.616358 18297 ts_tablet_manager.cc:1434] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:48.617699 18297 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:48.620822 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:48.621600 18250 raft_consensus.cc:3060] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.623669 18297 tablet_bootstrap.cc:654] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.625809 18586 raft_consensus.cc:493] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.626339 18586 raft_consensus.cc:515] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.629822 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:48.452205 18100 raft_consensus.cc:2468] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:48.637240 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:48.641922 18548 consensus_queue.cc:1048] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:19:48.631628 18250 raft_consensus.cc:2468] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
W20260709 13:19:48.660543 18144 leader_election.cc:343] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.661689 18144 leader_election.cc:304] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.633725 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926766f358784880a482cc7ea6052052" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.634002 18586 leader_election.cc:290] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:48.663645 18104 raft_consensus.cc:2393] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:48.665004 17994 leader_election.cc:304] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:48.666181 18217 leader_election.cc:304] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.667488 18029 raft_consensus.cc:3060] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.667601 18606 raft_consensus.cc:2804] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.668715 18606 raft_consensus.cc:697] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:48.670462 18606 consensus_queue.cc:237] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.663082 18473 raft_consensus.cc:2804] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.675448 18473 raft_consensus.cc:697] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:48.676448 18473 consensus_queue.cc:237] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:48.678871 18103 raft_consensus.cc:2468] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:48.606370 18298 raft_consensus.cc:359] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.714548 18586 raft_consensus.cc:2749] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.724076 18143 leader_election.cc:304] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:48.725630 18632 raft_consensus.cc:2804] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.715972 18606 consensus_queue.cc:1048] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:48.687117 18303 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:48.730824 18303 ts_tablet_manager.cc:1403] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.183s	user 0.009s	sys 0.006s
I20260709 13:19:48.735201 18303 raft_consensus.cc:359] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.735901 18303 raft_consensus.cc:385] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.736166 18303 raft_consensus.cc:740] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.736774 18303 consensus_queue.cc:260] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.722329 17927 catalog_manager.cc:5697] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.689296 18298 raft_consensus.cc:385] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.743019 18298 raft_consensus.cc:740] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.743713 18298 consensus_queue.cc:260] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.701650 18593 consensus_queue.cc:1048] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:19:48.707340 18340 consensus_queue.cc:1048] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:19:48.749248 18446 consensus_queue.cc:1048] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.755920 18473 consensus_queue.cc:1048] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.758724 17924 catalog_manager.cc:5697] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.767120 18300 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:48.767764 18300 ts_tablet_manager.cc:1403] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.310s	user 0.063s	sys 0.078s
I20260709 13:19:48.782987 18298 ts_tablet_manager.cc:1434] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.183s	user 0.000s	sys 0.008s
I20260709 13:19:48.744086 18303 ts_tablet_manager.cc:1434] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:19:48.789769 18300 raft_consensus.cc:359] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.794545 18300 raft_consensus.cc:385] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.827901 18300 raft_consensus.cc:740] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.810901 18298 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
W20260709 13:19:48.822242 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:48.842501 18300 consensus_queue.cc:260] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.860708 18298 tablet_bootstrap.cc:654] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.774461 18548 consensus_queue.cc:1048] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.087s
I20260709 13:19:48.866338 18586 raft_consensus.cc:493] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.875545 18586 raft_consensus.cc:515] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.878077 18586 leader_election.cc:290] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:48.879930 18297 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:48.867506 18300 ts_tablet_manager.cc:1434] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:19:48.880545 18297 ts_tablet_manager.cc:1403] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.263s	user 0.051s	sys 0.082s
I20260709 13:19:48.880427 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.881309 18300 tablet_bootstrap.cc:492] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:48.871769 18632 raft_consensus.cc:697] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:48.881428 18101 raft_consensus.cc:2393] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:48.882234 18632 consensus_queue.cc:237] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:48.886344 18297 raft_consensus.cc:359] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.887141 18297 raft_consensus.cc:385] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.887439 18297 raft_consensus.cc:740] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.886718 18642 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.888206 18642 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:48.890596 18642 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:48.891036 18446 consensus_queue.cc:1048] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.888224 18297 consensus_queue.cc:260] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.894335 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:48.895020 18300 tablet_bootstrap.cc:654] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.898180 18297 ts_tablet_manager.cc:1434] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:48.899243 18297 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:48.902983 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:48.906126 18297 tablet_bootstrap.cc:654] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.899317 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:48.911427 17992 leader_election.cc:304] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:48.917165 18582 raft_consensus.cc:3060] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.895037 18103 raft_consensus.cc:2468] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:48.926410 18217 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
W20260709 13:19:48.927634 18215 leader_election.cc:343] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.929044 18593 raft_consensus.cc:2804] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.929581 18593 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.929930 18593 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.933786 18303 tablet_bootstrap.cc:492] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:48.953035 18298 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:48.975929 18606 consensus_queue.cc:1048] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.934041 18582 raft_consensus.cc:2749] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.959909 18586 raft_consensus.cc:493] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.978518 18586 raft_consensus.cc:515] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:48.979597 18298 ts_tablet_manager.cc:1403] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.000s
I20260709 13:19:48.986450 18303 tablet_bootstrap.cc:654] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.995849 17924 catalog_manager.cc:5697] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.028350 18298 raft_consensus.cc:359] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.031032 18298 raft_consensus.cc:385] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.017745 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:49.031575 18298 raft_consensus.cc:740] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.034961 18298 consensus_queue.cc:260] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.050733 18297 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:49.034375 18586 leader_election.cc:290] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.056219 18297 ts_tablet_manager.cc:1403] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.157s	user 0.051s	sys 0.051s
I20260709 13:19:49.059062 18298 ts_tablet_manager.cc:1434] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 13:19:49.064196 18548 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.064792 18548 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.067031 18548 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.067970 18593 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.068380 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.070353 18593 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
W20260709 13:19:49.070605 18217 leader_election.cc:343] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.071462 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:49.073390 18337 raft_consensus.cc:493] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.080374 18298 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
W20260709 13:19:49.081846 18215 leader_election.cc:343] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.081511 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.083241 18297 raft_consensus.cc:359] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.084038 18297 raft_consensus.cc:385] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.084304 18297 raft_consensus.cc:740] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.085491 18297 consensus_queue.cc:260] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.090385 18300 tablet_bootstrap.cc:492] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:49.083400 18101 raft_consensus.cc:2393] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:49.090956 18300 ts_tablet_manager.cc:1403] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.210s	user 0.020s	sys 0.002s
I20260709 13:19:49.093997 18606 raft_consensus.cc:493] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.095633 18582 raft_consensus.cc:493] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.081559 18337 raft_consensus.cc:515] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.096167 18582 raft_consensus.cc:515] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.096376 17994 leader_election.cc:304] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:49.097477 18297 ts_tablet_manager.cc:1434] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:19:49.092846 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:49.093834 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:49.095647 18606 raft_consensus.cc:515] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.101356 18511 raft_consensus.cc:3060] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.101506 18103 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:49.103087 18218 leader_election.cc:343] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.103600 18218 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:49.104643 18606 leader_election.cc:290] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:49.120683 18297 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:49.119805 18606 raft_consensus.cc:2749] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.124825 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348515f468ae48c3a679e082be5ba35d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.126150 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348515f468ae48c3a679e082be5ba35d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:49.127477 18215 leader_election.cc:343] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.127933 18300 raft_consensus.cc:359] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.128677 18300 raft_consensus.cc:385] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.128950 18300 raft_consensus.cc:740] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.129405 18298 tablet_bootstrap.cc:654] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.129639 18300 consensus_queue.cc:260] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.124811 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de96e0eff148aa92357ccf945a3a9d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:49.143445 18297 tablet_bootstrap.cc:654] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.142396 18303 tablet_bootstrap.cc:492] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:49.148650 18303 ts_tablet_manager.cc:1403] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.215s	user 0.021s	sys 0.010s
W20260709 13:19:49.149801 18144 leader_election.cc:343] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.154215 18103 raft_consensus.cc:2468] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:49.158417 18300 ts_tablet_manager.cc:1434] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:19:49.136508 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:49.133986 18337 leader_election.cc:290] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.135129 18582 leader_election.cc:290] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:49.172297 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:49.176285 18303 raft_consensus.cc:359] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.177105 18303 raft_consensus.cc:385] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.177402 18303 raft_consensus.cc:740] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.178227 18303 consensus_queue.cc:260] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.141096 18340 consensus_queue.cc:1048] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
W20260709 13:19:49.179702 18217 leader_election.cc:343] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.180321 18217 leader_election.cc:304] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.181222 18250 raft_consensus.cc:2393] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:49.181479 18217 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.181915 18606 raft_consensus.cc:2749] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.182463 18446 raft_consensus.cc:2804] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.185205 17995 leader_election.cc:304] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.187232 18303 ts_tablet_manager.cc:1434] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:19:49.191118 18303 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:49.187907 18446 raft_consensus.cc:697] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:49.190078 18586 raft_consensus.cc:3060] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.199606 18446 consensus_queue.cc:237] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.194432 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de96e0eff148aa92357ccf945a3a9d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.213914 18100 raft_consensus.cc:2468] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:49.204262 18300 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:49.229669 18356 raft_consensus.cc:493] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.230327 18356 raft_consensus.cc:515] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.234270 18511 raft_consensus.cc:2749] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.234793 18298 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:49.235340 18298 ts_tablet_manager.cc:1403] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.155s	user 0.018s	sys 0.004s
I20260709 13:19:49.241966 18356 leader_election.cc:290] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:49.244426 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348515f468ae48c3a679e082be5ba35d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:49.244786 18298 raft_consensus.cc:359] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.245488 18298 raft_consensus.cc:385] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.245754 18298 raft_consensus.cc:740] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.245997 18606 consensus_queue.cc:1048] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.248749 18303 tablet_bootstrap.cc:654] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.246469 18298 consensus_queue.cc:260] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.253613 18548 raft_consensus.cc:493] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.254125 18548 raft_consensus.cc:515] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.254530 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348515f468ae48c3a679e082be5ba35d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:49.254845 18606 consensus_queue.cc:1048] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.255227 18250 raft_consensus.cc:2468] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
W20260709 13:19:49.262622 18067 leader_election.cc:343] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.263360 18070 leader_election.cc:304] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.269246 18298 ts_tablet_manager.cc:1434] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.003s
I20260709 13:19:49.273725 18143 leader_election.cc:304] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:49.274994 18548 leader_election.cc:290] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.275357 18632 raft_consensus.cc:2804] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.275826 18632 raft_consensus.cc:493] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.276154 18632 raft_consensus.cc:3060] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.274188 18298 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:49.280378 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:49.282934 18218 leader_election.cc:343] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.272943 18664 raft_consensus.cc:2804] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.284204 18664 raft_consensus.cc:493] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.284549 18664 raft_consensus.cc:3060] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.296351 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.297302 18103 raft_consensus.cc:2468] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:49.300182 18217 leader_election.cc:304] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:49.301100 18548 raft_consensus.cc:2804] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.301491 18548 raft_consensus.cc:493] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.301815 18548 raft_consensus.cc:3060] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.327209 18548 raft_consensus.cc:515] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.329458 18548 leader_election.cc:290] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.330665 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:49.331310 18103 raft_consensus.cc:3060] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.333287 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
W20260709 13:19:49.339170 18218 leader_election.cc:343] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.341988 18300 tablet_bootstrap.cc:654] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.344941 18632 raft_consensus.cc:515] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.346601 18340 consensus_queue.cc:1048] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.348469 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de96e0eff148aa92357ccf945a3a9d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:49.344985 18298 tablet_bootstrap.cc:654] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.350369 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de96e0eff148aa92357ccf945a3a9d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:49.351024 18101 raft_consensus.cc:3060] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.347571 18632 leader_election.cc:290] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.353888 17923 catalog_manager.cc:5697] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.351213 18664 raft_consensus.cc:515] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.366006 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348515f468ae48c3a679e082be5ba35d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:49.374437 18297 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:49.375032 18297 ts_tablet_manager.cc:1403] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.006s
I20260709 13:19:49.376770 18103 raft_consensus.cc:2468] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:49.377568 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348515f468ae48c3a679e082be5ba35d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
W20260709 13:19:49.380956 18144 leader_election.cc:343] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.377981 18297 raft_consensus.cc:359] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.382686 18664 leader_election.cc:290] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:49.383685 18297 raft_consensus.cc:385] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.384260 18297 raft_consensus.cc:740] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
W20260709 13:19:49.383337 18067 leader_election.cc:343] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.386161 18297 consensus_queue.cc:260] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.388239 18303 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:49.388937 18303 ts_tablet_manager.cc:1403] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.198s	user 0.033s	sys 0.028s
I20260709 13:19:49.385293 18248 raft_consensus.cc:3060] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.391216 18297 ts_tablet_manager.cc:1434] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:19:49.379554 18586 raft_consensus.cc:2749] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.408955 18640 consensus_queue.cc:1048] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.390036 18217 leader_election.cc:304] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:49.416656 18446 raft_consensus.cc:2804] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.417188 18446 raft_consensus.cc:697] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:49.417985 18446 consensus_queue.cc:237] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.432013 18473 consensus_queue.cc:1048] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.437224 18300 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:49.437916 18300 ts_tablet_manager.cc:1403] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.246s	user 0.017s	sys 0.000s
I20260709 13:19:49.438287 18297 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:49.444875 18101 raft_consensus.cc:2468] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:49.448976 18143 leader_election.cc:304] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:49.449314 18298 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:49.450264 18298 ts_tablet_manager.cc:1403] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.003s
I20260709 13:19:49.452276 18337 raft_consensus.cc:2804] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.452884 18337 raft_consensus.cc:697] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:49.453922 18337 consensus_queue.cc:237] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.455971 18297 tablet_bootstrap.cc:654] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.465787 18248 raft_consensus.cc:2468] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:49.469185 18070 leader_election.cc:304] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.470340 18664 raft_consensus.cc:2804] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.471060 18664 raft_consensus.cc:697] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:49.471963 18664 consensus_queue.cc:237] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.475379 18298 raft_consensus.cc:359] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.476147 18298 raft_consensus.cc:385] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.476310 18303 raft_consensus.cc:359] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.476961 17924 catalog_manager.cc:5697] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.478168 18303 raft_consensus.cc:385] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.478533 18303 raft_consensus.cc:740] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.480559 18300 raft_consensus.cc:359] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.476409 18298 raft_consensus.cc:740] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.481292 18300 raft_consensus.cc:385] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.479557 18297 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:49.481909 18300 raft_consensus.cc:740] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.482370 18297 ts_tablet_manager.cc:1403] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.083s	user 0.005s	sys 0.008s
I20260709 13:19:49.482455 18303 consensus_queue.cc:260] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.483125 18298 consensus_queue.cc:260] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.501178 18300 consensus_queue.cc:260] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.503966 18303 ts_tablet_manager.cc:1434] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.000s
I20260709 13:19:49.511126 17925 catalog_manager.cc:5697] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.519579 18298 ts_tablet_manager.cc:1434] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:19:49.542505 18297 raft_consensus.cc:359] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.544153 18297 raft_consensus.cc:385] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.544544 18297 raft_consensus.cc:740] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.543447 18298 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:49.542717 18300 ts_tablet_manager.cc:1434] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.000s
I20260709 13:19:49.549605 18297 consensus_queue.cc:260] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.550086 18300 tablet_bootstrap.cc:492] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:49.557261 18303 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:49.561398 18297 ts_tablet_manager.cc:1434] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
I20260709 13:19:49.562577 18297 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:49.566373 17925 catalog_manager.cc:5697] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.567685 18298 tablet_bootstrap.cc:654] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.567348 18300 tablet_bootstrap.cc:654] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.578832 18297 tablet_bootstrap.cc:654] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.588166 18298 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:49.588955 18298 ts_tablet_manager.cc:1403] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.003s
I20260709 13:19:49.591363 18582 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.592041 18582 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.592228 18298 raft_consensus.cc:359] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.592914 18298 raft_consensus.cc:385] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.593168 18298 raft_consensus.cc:740] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.593891 18664 raft_consensus.cc:493] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.593686 18298 consensus_queue.cc:260] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.594357 18664 raft_consensus.cc:515] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.596434 18664 leader_election.cc:290] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:49.597527 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2891e8255e0b4398a034d1bc7f353332" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:49.597913 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:49.598570 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.598585 18248 raft_consensus.cc:2468] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:49.600180 18298 ts_tablet_manager.cc:1434] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:19:49.601238 18298 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:49.601766 18026 raft_consensus.cc:2468] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:49.604242 18070 leader_election.cc:304] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:49.601310 17995 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:49.605816 18586 raft_consensus.cc:2804] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.606178 18586 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.606601 18586 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.608031 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2891e8255e0b4398a034d1bc7f353332" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:49.609261 18548 consensus_queue.cc:1048] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:49.609541 18067 leader_election.cc:343] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.612653 18582 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.615559 18298 tablet_bootstrap.cc:654] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.615198 18586 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.612697 18664 raft_consensus.cc:2804] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.616359 18664 raft_consensus.cc:493] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.616730 18664 raft_consensus.cc:3060] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.617962 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:49.618734 18248 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:49.606040 17994 leader_election.cc:343] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.631090 18298 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:49.631660 18298 ts_tablet_manager.cc:1403] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.031s	user 0.003s	sys 0.012s
I20260709 13:19:49.635499 18172 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.671689 18473 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.636607 18664 raft_consensus.cc:515] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.639520 18303 tablet_bootstrap.cc:654] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.636953 18586 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:49.659972 18297 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:49.677342 18473 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.678820 18297 ts_tablet_manager.cc:1403] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.022s
I20260709 13:19:49.642135 18248 raft_consensus.cc:2468] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:49.681277 18473 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:49.644259 18548 consensus_queue.cc:1048] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:19:49.682634 18297 raft_consensus.cc:359] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.683389 18297 raft_consensus.cc:385] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.683719 18297 raft_consensus.cc:740] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.681859 17995 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:49.684384 18297 consensus_queue.cc:260] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.638034 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:49.685803 18582 raft_consensus.cc:2804] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.686264 18582 raft_consensus.cc:697] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:49.687036 18582 consensus_queue.cc:237] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.635499 18298 raft_consensus.cc:359] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.645162 18300 tablet_bootstrap.cc:492] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
W20260709 13:19:49.690488 17994 leader_election.cc:343] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.690497 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2891e8255e0b4398a034d1bc7f353332" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:49.690747 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:49.690884 18298 raft_consensus.cc:385] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.706082 18298 raft_consensus.cc:740] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.692252 18300 ts_tablet_manager.cc:1403] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.142s	user 0.026s	sys 0.032s
I20260709 13:19:49.691313 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:49.706893 18298 consensus_queue.cc:260] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.708693 18297 ts_tablet_manager.cc:1434] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.005s
I20260709 13:19:49.709388 18298 ts_tablet_manager.cc:1434] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.007s
I20260709 13:19:49.709998 18297 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:49.710426 18298 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:49.710708 18300 raft_consensus.cc:359] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.711382 18300 raft_consensus.cc:385] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.689687 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2891e8255e0b4398a034d1bc7f353332" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:49.711680 18300 raft_consensus.cc:740] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.711475 18144 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:49.712929 18300 consensus_queue.cc:260] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
W20260709 13:19:49.713940 18067 leader_election.cc:343] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.712373 18026 raft_consensus.cc:3060] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.727963 18297 tablet_bootstrap.cc:654] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.730921 18300 ts_tablet_manager.cc:1434] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:19:49.732069 18300 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:49.732807 18298 tablet_bootstrap.cc:654] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.740005 18337 raft_consensus.cc:493] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.740779 17923 catalog_manager.cc:5697] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.740567 18337 raft_consensus.cc:515] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.744290 18337 leader_election.cc:290] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:49.748406 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:49.749097 18252 raft_consensus.cc:2468] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:49.749042 18303 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:49.750633 18303 ts_tablet_manager.cc:1403] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.002s
I20260709 13:19:49.751852 18144 leader_election.cc:304] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:49.752959 18337 raft_consensus.cc:2804] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.753334 18337 raft_consensus.cc:493] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.753636 18337 raft_consensus.cc:3060] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.748435 18632 raft_consensus.cc:2749] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:49.766167 18026 raft_consensus.cc:2468] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:49.688244 18664 leader_election.cc:290] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:49.774669 18548 raft_consensus.cc:493] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.775218 18548 raft_consensus.cc:515] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.775612 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:49.773768 18337 raft_consensus.cc:515] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.778700 18337 leader_election.cc:290] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:49.778888 18548 leader_election.cc:290] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:49.780740 18070 leader_election.cc:304] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.781881 18356 raft_consensus.cc:2804] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.782325 18356 raft_consensus.cc:697] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:49.783074 18356 consensus_queue.cc:237] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.783867 18300 tablet_bootstrap.cc:654] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:49.778757 18144 leader_election.cc:343] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.795305 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:49.797916 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b6d4d69b644b7a7c5ec7b137eef7f" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:49.796000 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:49.812088 18297 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:49.812728 18297 ts_tablet_manager.cc:1403] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.023s
I20260709 13:19:49.799072 18248 raft_consensus.cc:3060] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.819027 18297 raft_consensus.cc:359] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.826629 18297 raft_consensus.cc:385] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.828531 18297 raft_consensus.cc:740] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.803848 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b6d4d69b644b7a7c5ec7b137eef7f" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:49.826114 18144 leader_election.cc:343] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:49.832190 18215 leader_election.cc:343] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.838894 18297 consensus_queue.cc:260] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:49.845271 18297 ts_tablet_manager.cc:1434] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:19:49.854786 18026 raft_consensus.cc:2468] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
W20260709 13:19:49.872859 18067 consensus_peers.cc:597] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:49.880611 18218 leader_election.cc:304] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.882476 18642 raft_consensus.cc:2804] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.882906 18642 raft_consensus.cc:493] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.883234 18642 raft_consensus.cc:3060] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.885172 18303 raft_consensus.cc:359] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:49.886479 18144 consensus_peers.cc:597] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:49.886811 18297 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:49.889043 18303 raft_consensus.cc:385] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.892529 18303 raft_consensus.cc:740] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.896330 18642 raft_consensus.cc:515] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.900640 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b6d4d69b644b7a7c5ec7b137eef7f" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:49.901307 18025 raft_consensus.cc:3060] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.901397 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b6d4d69b644b7a7c5ec7b137eef7f" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:49.901127 17923 catalog_manager.cc:5697] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.893187 18303 consensus_queue.cc:260] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:49.905416 18215 leader_election.cc:343] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.907709 18297 tablet_bootstrap.cc:654] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.910789 18303 ts_tablet_manager.cc:1434] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.160s	user 0.004s	sys 0.003s
I20260709 13:19:49.915220 18356 raft_consensus.cc:493] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.915621 18356 raft_consensus.cc:515] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:49.922001 18356 leader_election.cc:290] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:49.922484 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39309f26ab25439e8503252118d584d0" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:49.923269 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39309f26ab25439e8503252118d584d0" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
W20260709 13:19:49.923887 18067 leader_election.cc:343] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:49.924858 18070 leader_election.cc:343] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.925267 18070 leader_election.cc:304] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.926573 18664 raft_consensus.cc:2749] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.916268 18642 leader_election.cc:290] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
W20260709 13:19:49.936173 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 49305.9us
I20260709 13:19:49.945111 18303 tablet_bootstrap.cc:492] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
W20260709 13:19:49.948011 18691 log.cc:927] Time spent T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:19:49.951223 18298 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:49.951820 18298 ts_tablet_manager.cc:1403] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.242s	user 0.009s	sys 0.007s
I20260709 13:19:49.954806 18446 consensus_queue.cc:1048] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.959913 18248 raft_consensus.cc:2468] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:49.962365 18144 leader_election.cc:304] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:49.962601 18300 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:49.963076 18300 ts_tablet_manager.cc:1403] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.231s	user 0.074s	sys 0.078s
I20260709 13:19:49.963672 18337 raft_consensus.cc:2804] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.964171 18337 raft_consensus.cc:697] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:49.964931 18337 consensus_queue.cc:237] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.967329 18025 raft_consensus.cc:2468] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:49.967571 18298 raft_consensus.cc:359] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.968451 18298 raft_consensus.cc:385] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.969779 18298 raft_consensus.cc:740] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.973191 18303 tablet_bootstrap.cc:654] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.972806 18298 consensus_queue.cc:260] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:49.977094 18218 leader_election.cc:304] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:49.981254 18298 ts_tablet_manager.cc:1434] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
W20260709 13:19:49.990587 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:49.985754 18693 raft_consensus.cc:2804] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.992537 18300 raft_consensus.cc:359] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:49.993047 18300 raft_consensus.cc:385] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.993249 18300 raft_consensus.cc:740] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.997211 17925 catalog_manager.cc:5697] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.999897 18298 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:50.000654 18693 raft_consensus.cc:697] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:50.001119 18300 consensus_queue.cc:260] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.001605 18693 consensus_queue.cc:237] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.003490 18297 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:50.003789 18300 ts_tablet_manager.cc:1434] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.040s	user 0.002s	sys 0.007s
I20260709 13:19:50.004060 18297 ts_tablet_manager.cc:1403] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.003s
I20260709 13:19:50.004952 18300 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:50.008008 18297 raft_consensus.cc:359] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.008850 18297 raft_consensus.cc:385] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.009168 18297 raft_consensus.cc:740] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
W20260709 13:19:50.011000 18218 consensus_peers.cc:597] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:50.016477 18300 tablet_bootstrap.cc:654] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.019594 18297 consensus_queue.cc:260] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.021102 18582 raft_consensus.cc:493] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.021582 18303 tablet_bootstrap.cc:492] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:50.021535 18582 raft_consensus.cc:515] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.022126 18303 ts_tablet_manager.cc:1403] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.000s
I20260709 13:19:50.021813 18297 ts_tablet_manager.cc:1434] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:19:50.025031 18303 raft_consensus.cc:359] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.025573 18297 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:50.029194 18582 leader_election.cc:290] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:50.025681 18303 raft_consensus.cc:385] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.030148 18303 raft_consensus.cc:740] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.031324 18303 consensus_queue.cc:260] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.031680 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:50.033198 17994 leader_election.cc:343] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.035056 18300 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:50.035543 18300 ts_tablet_manager.cc:1403] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 13:19:50.037675 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:50.038107 18300 raft_consensus.cc:359] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.038790 18300 raft_consensus.cc:385] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:50.038796 17992 leader_election.cc:343] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.039397 17992 leader_election.cc:304] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:50.040755 18582 raft_consensus.cc:2749] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.041352 18300 raft_consensus.cc:740] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.042878 18300 consensus_queue.cc:260] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.044795 18300 ts_tablet_manager.cc:1434] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:50.045804 18300 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:50.033457 18303 ts_tablet_manager.cc:1434] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:50.051414 18303 tablet_bootstrap.cc:492] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:50.058876 18298 tablet_bootstrap.cc:654] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.068310 18303 tablet_bootstrap.cc:654] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.076376 18297 tablet_bootstrap.cc:654] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.076813 18632 consensus_queue.cc:1048] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.069531 17924 catalog_manager.cc:5697] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.080449 18300 tablet_bootstrap.cc:654] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.083524 18104 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.085845 18298 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:50.086309 18298 ts_tablet_manager.cc:1403] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.010s
I20260709 13:19:50.089059 18298 raft_consensus.cc:359] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.089789 18298 raft_consensus.cc:385] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.090065 18298 raft_consensus.cc:740] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.090837 18298 consensus_queue.cc:260] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.093134 18298 ts_tablet_manager.cc:1434] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:50.094169 18298 tablet_bootstrap.cc:492] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:50.096282 18632 raft_consensus.cc:493] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.096834 18632 raft_consensus.cc:515] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.099900 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39309f26ab25439e8503252118d584d0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:50.100445 18298 tablet_bootstrap.cc:654] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.101112 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39309f26ab25439e8503252118d584d0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:50.101357 18144 leader_election.cc:343] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.101775 18100 raft_consensus.cc:2468] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:50.104586 18300 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:50.104624 18632 leader_election.cc:290] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:50.105154 18300 ts_tablet_manager.cc:1403] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.002s
I20260709 13:19:50.106366 18143 leader_election.cc:304] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc
I20260709 13:19:50.107931 18340 raft_consensus.cc:2804] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.108351 18340 raft_consensus.cc:493] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.108667 18340 raft_consensus.cc:3060] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.109020 18582 raft_consensus.cc:493] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.109545 18582 raft_consensus.cc:515] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.111658 18582 leader_election.cc:290] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:50.111616 18298 tablet_bootstrap.cc:492] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:50.112535 18298 ts_tablet_manager.cc:1403] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:19:50.112557 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:50.115386 18298 raft_consensus.cc:359] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.112713 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:50.116068 18298 raft_consensus.cc:385] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.116518 18298 raft_consensus.cc:740] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.117439 17994 leader_election.cc:304] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:50.118459 18582 raft_consensus.cc:2749] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.108665 18300 raft_consensus.cc:359] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.119468 18300 raft_consensus.cc:385] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.119838 18300 raft_consensus.cc:740] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.119972 18298 consensus_queue.cc:260] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.122423 18298 ts_tablet_manager.cc:1434] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:19:50.123301 18297 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:50.123514 18298 tablet_bootstrap.cc:492] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:50.123821 18297 ts_tablet_manager.cc:1403] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.011s
I20260709 13:19:50.126266 18340 raft_consensus.cc:515] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.130028 18298 tablet_bootstrap.cc:654] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.132086 18297 raft_consensus.cc:359] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.120810 18300 consensus_queue.cc:260] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.135169 18664 consensus_queue.cc:1048] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.135708 18300 ts_tablet_manager.cc:1434] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:19:50.136745 18300 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:50.139259 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39309f26ab25439e8503252118d584d0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:50.139969 18248 raft_consensus.cc:3060] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.132735 18297 raft_consensus.cc:385] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.141413 18297 raft_consensus.cc:740] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.142186 18297 consensus_queue.cc:260] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.147956 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39309f26ab25439e8503252118d584d0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:50.149813 18101 raft_consensus.cc:3060] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.144546 18297 ts_tablet_manager.cc:1434] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:50.151073 18300 tablet_bootstrap.cc:654] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.151479 18297 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:50.157753 18297 tablet_bootstrap.cc:654] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.162566 18693 raft_consensus.cc:493] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.163055 18693 raft_consensus.cc:515] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.165901 18693 leader_election.cc:290] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:50.165974 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:50.167662 18218 leader_election.cc:343] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.174309 18606 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.174850 18606 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.165994 18300 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:50.176385 18300 ts_tablet_manager.cc:1403] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.000s
I20260709 13:19:50.176828 18606 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:50.178628 18025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:50.180233 18218 leader_election.cc:343] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.170743 18101 raft_consensus.cc:2468] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:50.183549 18297 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:50.179217 18300 raft_consensus.cc:359] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.184394 18300 raft_consensus.cc:385] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.185379 18300 raft_consensus.cc:740] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.184360 18297 ts_tablet_manager.cc:1403] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 13:19:50.186609 18300 consensus_queue.cc:260] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.190681 18300 ts_tablet_manager.cc:1434] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:19:50.190162 18297 raft_consensus.cc:359] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.192178 18297 raft_consensus.cc:385] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.192493 18297 raft_consensus.cc:740] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.193266 18297 consensus_queue.cc:260] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.194952 18586 consensus_queue.cc:1048] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.195384 18297 ts_tablet_manager.cc:1434] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:19:50.196587 18297 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:50.199102 18300 tablet_bootstrap.cc:492] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:50.204385 18297 tablet_bootstrap.cc:654] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.211992 18300 tablet_bootstrap.cc:654] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.221560 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:50.223942 18143 leader_election.cc:304] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
W20260709 13:19:50.225627 18215 leader_election.cc:343] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.226152 18215 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:50.270478 18298 tablet_bootstrap.cc:492] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:50.271013 18298 ts_tablet_manager.cc:1403] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.148s	user 0.018s	sys 0.033s
I20260709 13:19:50.218078 18340 leader_election.cc:290] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:50.293377 18337 raft_consensus.cc:493] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.262840 18693 raft_consensus.cc:2749] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.267174 18473 raft_consensus.cc:2804] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.295485 18337 raft_consensus.cc:515] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.313714 18337 leader_election.cc:290] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:50.316146 18298 raft_consensus.cc:359] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.316958 18298 raft_consensus.cc:385] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.317265 18298 raft_consensus.cc:740] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.317970 18298 consensus_queue.cc:260] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.310811 18473 raft_consensus.cc:697] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:50.450745 18298 ts_tablet_manager.cc:1434] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.000s
I20260709 13:19:50.466480 18300 tablet_bootstrap.cc:492] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:50.467077 18300 ts_tablet_manager.cc:1403] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.268s	user 0.006s	sys 0.009s
I20260709 13:19:50.471431 18297 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:50.471944 18297 ts_tablet_manager.cc:1403] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.276s	user 0.015s	sys 0.057s
I20260709 13:19:50.472126 18300 raft_consensus.cc:359] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.472797 18300 raft_consensus.cc:385] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.473210 18300 raft_consensus.cc:740] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.469684 18473 consensus_queue.cc:237] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.473874 18300 consensus_queue.cc:260] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.474720 18297 raft_consensus.cc:359] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.475364 18297 raft_consensus.cc:385] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.476102 18298 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: Bootstrap starting.
I20260709 13:19:50.476310 18300 ts_tablet_manager.cc:1434] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:19:50.477455 18300 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425: Bootstrap starting.
I20260709 13:19:50.483274 18300 tablet_bootstrap.cc:654] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.483960 18298 tablet_bootstrap.cc:654] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.475631 18297 raft_consensus.cc:740] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.486965 18297 consensus_queue.cc:260] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.501283 18297 ts_tablet_manager.cc:1434] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:19:50.495425 18548 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.514912 18303 tablet_bootstrap.cc:492] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:50.509387 18548 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.561039 18548 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
W20260709 13:19:50.566044 18710 log.cc:927] Time spent T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:50.579650 18356 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.580219 18356 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.582016 18356 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:50.586683 18297 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:50.633481 18297 tablet_bootstrap.cc:654] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.707826 18693 raft_consensus.cc:493] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.708459 18693 raft_consensus.cc:515] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.710987 18693 leader_election.cc:290] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
W20260709 13:19:50.723631 18215 consensus_peers.cc:597] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:50.726589 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:50.730110 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e89b6eefa04beea2f707a0208c3268" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:50.730868 18104 raft_consensus.cc:2468] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:50.736443 18217 leader_election.cc:304] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:50.737995 18719 raft_consensus.cc:2804] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.738430 18719 raft_consensus.cc:493] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.738762 18719 raft_consensus.cc:3060] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.761363 18303 ts_tablet_manager.cc:1403] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.710s	user 0.036s	sys 0.054s
W20260709 13:19:50.794663 18248 consensus_meta.cc:287] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.000s
I20260709 13:19:50.795408 18248 raft_consensus.cc:2468] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:50.797672 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e89b6eefa04beea2f707a0208c3268" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:50.799149 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:50.810902 18586 raft_consensus.cc:493] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.811535 18586 raft_consensus.cc:515] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:50.826331 18023 raft_consensus.cc:3060] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.834203 18303 raft_consensus.cc:359] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.835171 18303 raft_consensus.cc:385] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.835440 18303 raft_consensus.cc:740] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.836169 18303 consensus_queue.cc:260] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.837579 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:50.845197 18215 leader_election.cc:343] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:50.846283 18215 leader_election.cc:343] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.851567 18303 ts_tablet_manager.cc:1434] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.004s
I20260709 13:19:50.843523 18719 raft_consensus.cc:515] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.860167 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:50.861809 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e89b6eefa04beea2f707a0208c3268" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:50.862591 18098 raft_consensus.cc:3060] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.881268 18303 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:50.878528 18586 leader_election.cc:290] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
W20260709 13:19:50.903891 18218 leader_election.cc:343] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.904517 18218 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:50.904781 18300 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425: No bootstrap required, opened a new log
I20260709 13:19:50.905373 18300 ts_tablet_manager.cc:1403] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425: Time spent bootstrapping tablet: real 0.428s	user 0.039s	sys 0.030s
I20260709 13:19:50.893900 18719 leader_election.cc:290] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:50.909783 18298 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: No bootstrap required, opened a new log
I20260709 13:19:50.910363 18298 ts_tablet_manager.cc:1403] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: Time spent bootstrapping tablet: real 0.446s	user 0.032s	sys 0.020s
I20260709 13:19:50.911217 18300 raft_consensus.cc:359] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.911983 18300 raft_consensus.cc:385] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.912267 18300 raft_consensus.cc:740] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.912955 18300 consensus_queue.cc:260] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:50.919636 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:50.919916 18548 raft_consensus.cc:2749] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.920539 18248 raft_consensus.cc:2393] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:50.924697 18300 ts_tablet_manager.cc:1434] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:19:50.927320 17995 leader_election.cc:304] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:50.931316 18303 tablet_bootstrap.cc:654] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.933847 18586 raft_consensus.cc:3060] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.934883 18298 raft_consensus.cc:359] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.941924 18298 raft_consensus.cc:385] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.942219 18298 raft_consensus.cc:740] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.942935 18298 consensus_queue.cc:260] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.924739 18098 raft_consensus.cc:2468] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:50.949465 18217 leader_election.cc:304] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:50.950526 18716 raft_consensus.cc:2804] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.951076 18716 raft_consensus.cc:697] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:50.952030 18716 consensus_queue.cc:237] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:50.963727 18297 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:50.964473 18297 ts_tablet_manager.cc:1403] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.378s	user 0.025s	sys 0.004s
I20260709 13:19:50.972473 18298 ts_tablet_manager.cc:1434] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:19:50.977666 18717 raft_consensus.cc:493] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.978614 18717 raft_consensus.cc:515] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.980808 18586 raft_consensus.cc:2749] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.981371 18297 raft_consensus.cc:359] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.982177 18297 raft_consensus.cc:385] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.982496 18297 raft_consensus.cc:740] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.984486 18297 consensus_queue.cc:260] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:50.985528 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:50.983644 18717 leader_election.cc:290] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:19:50.987136 18218 leader_election.cc:343] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.987550 18297 ts_tablet_manager.cc:1434] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:19:50.988657 18297 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:50.995929 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:50.996788 18101 raft_consensus.cc:2468] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:50.998431 18217 leader_election.cc:304] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.000281 18719 raft_consensus.cc:2804] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.000669 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2891e8255e0b4398a034d1bc7f353332" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.000711 18719 raft_consensus.cc:493] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.002429 18719 raft_consensus.cc:3060] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.007675 18297 tablet_bootstrap.cc:654] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.023640 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2891e8255e0b4398a034d1bc7f353332" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.034819 18178 raft_consensus.cc:3060] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.034663 18174 raft_consensus.cc:3060] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.038566 18724 raft_consensus.cc:493] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.039188 18724 raft_consensus.cc:515] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.026669 18026 raft_consensus.cc:2393] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
I20260709 13:19:51.043587 18724 leader_election.cc:290] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:51.033170 18664 raft_consensus.cc:493] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.048627 18664 raft_consensus.cc:515] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.068435 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:51.069180 18252 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:51.082130 18664 leader_election.cc:290] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:51.082626 18586 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.083189 18586 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.085386 18586 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:51.094264 18719 raft_consensus.cc:515] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.097378 18719 leader_election.cc:290] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.218381 18731 raft_consensus.cc:493] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 830a192d6137410e8bd043588f0ed425)
I20260709 13:19:51.219105 18731 raft_consensus.cc:515] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.221495 18731 leader_election.cc:290] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:51.231616 18731 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 830a192d6137410e8bd043588f0ed425)
I20260709 13:19:51.232383 18731 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.239270 18731 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.240316 18724 consensus_queue.cc:1048] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.269460 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.275913 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de96e0eff148aa92357ccf945a3a9d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.276571 18100 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 0.
I20260709 13:19:51.277262 18100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47860 (request call id 88) took 1107 ms. Trace:
I20260709 13:19:51.277658 18100 rpcz_store.cc:276] 0709 13:19:50.170457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.269088 (+1098631us) service_pool.cc:224] Handling call
0709 13:19:51.277165 (+  8077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.288826 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.292181 18729 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23853b156a904ba6a31afa79977f3adc)
I20260709 13:19:51.292459 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.293262 18729 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:51.293249 18024 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:51.295207 18734 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:51.295831 18734 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.299105 18734 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.300400 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:51.301680 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.295722 18729 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
W20260709 13:19:51.314322 18218 leader_election.cc:343] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.317195 18070 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.320050 18729 raft_consensus.cc:2749] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.320191 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.323495 18250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:51.324254 18250 raft_consensus.cc:2468] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:51.328807 17995 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:51.323200 18741 raft_consensus.cc:493] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.329463 18070 leader_election.cc:304] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:51.336316 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.329943 18731 raft_consensus.cc:2804] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.342597 18741 raft_consensus.cc:515] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.349706 18606 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 830a192d6137410e8bd043588f0ed425)
I20260709 13:19:51.350361 18606 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.347452 18731 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.352242 18731 raft_consensus.cc:3060] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.352809 18606 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.350339 18742 raft_consensus.cc:2804] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.357517 18716 consensus_queue.cc:1048] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.356366 18742 raft_consensus.cc:493] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.358889 18742 raft_consensus.cc:3060] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.360644 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.365139 18716 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:51.365406 18729 consensus_queue.cc:1048] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.365842 18716 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.365182 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.370139 18029 raft_consensus.cc:2468] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 0.
I20260709 13:19:51.372117 18716 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.373008 18070 leader_election.cc:304] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:51.373937 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:51.375799 18742 raft_consensus.cc:515] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.376266 18729 raft_consensus.cc:2804] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.376765 18729 raft_consensus.cc:493] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.377101 18729 raft_consensus.cc:3060] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.378160 18742 leader_election.cc:290] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:51.381672 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:51.382442 18023 raft_consensus.cc:3060] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.385718 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.388455 18741 leader_election.cc:290] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:51.398969 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:51.407153 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:51.410516 18252 raft_consensus.cc:3060] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.418715 18252 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:51.399428 17923 catalog_manager.cc:5697] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.408188 18023 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:51.407475 18731 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.427716 18731 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:51.429976 18729 raft_consensus.cc:515] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:51.437186 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 410828us
I20260709 13:19:51.437641 18070 leader_election.cc:304] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:51.453912 17995 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:51.455410 18755 raft_consensus.cc:493] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.456302 18724 raft_consensus.cc:2749] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.456738 18755 raft_consensus.cc:515] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.459815 18606 raft_consensus.cc:493] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:51.460981 18606 raft_consensus.cc:515] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.462723 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:51.463111 18606 leader_election.cc:290] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:51.463368 18252 raft_consensus.cc:3060] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.469579 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:51.470995 18070 leader_election.cc:343] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.471269 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.471603 18252 raft_consensus.cc:2468] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:51.472750 18632 raft_consensus.cc:493] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 830a192d6137410e8bd043588f0ed425)
I20260709 13:19:51.473466 17995 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:51.473354 18632 raft_consensus.cc:515] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.474373 18754 raft_consensus.cc:2804] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.476253 18632 leader_election.cc:290] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.466125 18755 leader_election.cc:290] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:51.480238 18726 raft_consensus.cc:2804] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.489121 18726 raft_consensus.cc:697] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:51.489809 18297 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:51.490336 18297 ts_tablet_manager.cc:1403] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.502s	user 0.024s	sys 0.015s
I20260709 13:19:51.490025 18726 consensus_queue.cc:237] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.482019 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:51.492281 18023 raft_consensus.cc:3060] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.494674 18340 raft_consensus.cc:493] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 830a192d6137410e8bd043588f0ed425)
I20260709 13:19:51.498203 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.484961 18729 leader_election.cc:290] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:51.488237 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e89b6eefa04beea2f707a0208c3268" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:51.477727 18754 raft_consensus.cc:697] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:51.508704 18754 consensus_queue.cc:237] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.509533 18303 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:51.510143 18303 ts_tablet_manager.cc:1403] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.629s	user 0.017s	sys 0.021s
I20260709 13:19:51.512089 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.512897 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.495256 18340 raft_consensus.cc:515] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.516017 18340 leader_election.cc:290] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.517335 18023 raft_consensus.cc:2468] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:51.521291 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.522776 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:51.523540 18100 raft_consensus.cc:3060] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.526403 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.532313 18734 raft_consensus.cc:493] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:51.532960 18473 consensus_queue.cc:1048] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.534744 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.537107 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.537499 18718 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:51.538103 18718 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.540061 18070 leader_election.cc:304] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:51.540823 18718 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.532950 18734 raft_consensus.cc:515] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:51.539975 18144 leader_election.cc:304] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.543222 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e40c116d0e4d4a9c87a0a4c8daf709" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.544066 18736 raft_consensus.cc:2749] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.548059 18734 leader_election.cc:290] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
W20260709 13:19:51.553159 17975 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:51.554375 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3de96e0eff148aa92357ccf945a3a9d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.555222 18718 consensus_queue.cc:1048] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.555956 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:51.519626 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.541020 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.565166 18303 raft_consensus.cc:359] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.566166 18303 raft_consensus.cc:385] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.566279 18217 leader_election.cc:304] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.596994 18067 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:51.567183 18356 raft_consensus.cc:2804] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.598196 18755 raft_consensus.cc:2749] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.598623 18356 raft_consensus.cc:697] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:51.598716 18717 raft_consensus.cc:2764] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:19:51.599489 18356 consensus_queue.cc:237] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.565297 17925 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33078 (request call id 82) took 1393 ms. Trace:
I20260709 13:19:51.602743 17925 rpcz_store.cc:276] 0709 13:19:50.171817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.268694 (+ 96877us) service_pool.cc:224] Handling call
0709 13:19:51.565206 (+1296512us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2848,"reported_tablets":3}
W20260709 13:19:51.603281 18067 leader_election.cc:343] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.570273 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:51.605432 18217 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.605443 18717 consensus_queue.cc:1048] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.606897 18217 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.607395 18717 raft_consensus.cc:2749] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.571552 17992 leader_election.cc:304] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:51.608723 18586 raft_consensus.cc:2749] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.610872 18029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1380a01d5ea6449a8d7cf0fef7a4bf60" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.611575 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.579223 18743 raft_consensus.cc:493] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:51.586220 18742 consensus_queue.cc:1048] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.613176 18743 raft_consensus.cc:515] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.588068 18215 leader_election.cc:304] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.614537 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.590910 18756 consensus_queue.cc:1048] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.592638 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e90ea9c973f4fcdbbd047a3346e4639" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:51.615464 18215 leader_election.cc:343] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.616016 18606 raft_consensus.cc:2749] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:51.616879 18215 consensus_peers.cc:597] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.615315 18743 leader_election.cc:290] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:51.620589 18217 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.621320 18606 raft_consensus.cc:2749] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:51.607999 18067 leader_election.cc:343] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.610877 18023 raft_consensus.cc:3060] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.596587 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.622576 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.624264 18026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.623142 18067 leader_election.cc:304] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.625694 18743 raft_consensus.cc:2749] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.628547 18734 raft_consensus.cc:2749] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.576665 18297 raft_consensus.cc:359] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.630532 18297 raft_consensus.cc:385] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.630841 18297 raft_consensus.cc:740] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.633376 17992 leader_election.cc:304] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
W20260709 13:19:51.635408 18067 leader_election.cc:343] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.637212 18303 raft_consensus.cc:740] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.638046 18303 consensus_queue.cc:260] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.635733 18548 raft_consensus.cc:493] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.640072 18548 raft_consensus.cc:515] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.641942 18548 leader_election.cc:290] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:51.645581 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98540bdb13d84727be4be8cd6b851140" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.649713 18067 leader_election.cc:304] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.650545 18743 raft_consensus.cc:2749] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.654606 18756 consensus_queue.cc:1048] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.665915 18297 consensus_queue.cc:260] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.668030 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab14946ec96453d983b98de84b5a104" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:51.686543 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 53261us
I20260709 13:19:51.693367 18100 raft_consensus.cc:2468] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:51.707240 18172 raft_consensus.cc:3060] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.662804 17925 catalog_manager.cc:5697] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.708458 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.711881 18303 ts_tablet_manager.cc:1434] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.201s	user 0.006s	sys 0.003s
I20260709 13:19:51.742631 18303 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:51.753227 18303 tablet_bootstrap.cc:654] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.717139 18217 leader_election.cc:304] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:51.721298 18297 ts_tablet_manager.cc:1434] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.231s	user 0.009s	sys 0.000s
I20260709 13:19:51.729133 18586 raft_consensus.cc:2749] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:51.690697 17992 leader_election.cc:343] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.758500 17992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 67844.4us
I20260709 13:19:51.761175 18717 raft_consensus.cc:2749] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:51.761920 17992 leader_election.cc:343] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.764153 18144 leader_election.cc:304] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.765425 18144 leader_election.cc:304] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.766844 18144 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
W20260709 13:19:51.756618 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 47243.8us
I20260709 13:19:51.769665 18473 raft_consensus.cc:2749] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.770249 18718 raft_consensus.cc:2749] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.773936 18756 raft_consensus.cc:2749] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.778966 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4511aae3d2a140fc8941166745d82fe3" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.780815 18218 leader_election.cc:304] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.781975 18717 raft_consensus.cc:2749] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.783109 18297 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:51.783288 17923 catalog_manager.cc:5697] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:51.788856 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 71828.9us
I20260709 13:19:51.790052 18303 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:51.790585 18303 ts_tablet_manager.cc:1403] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.001s
I20260709 13:19:51.799576 18217 leader_election.cc:304] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.801775 18303 raft_consensus.cc:359] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.802645 18303 raft_consensus.cc:385] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.802906 18303 raft_consensus.cc:740] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.807054 18297 tablet_bootstrap.cc:654] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.810923 18606 raft_consensus.cc:2804] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.811602 18606 raft_consensus.cc:697] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:51.812506 18606 consensus_queue.cc:237] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.828702 18756 raft_consensus.cc:493] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23853b156a904ba6a31afa79977f3adc)
I20260709 13:19:51.816834 18303 consensus_queue.cc:260] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.829408 18756 raft_consensus.cc:515] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.842200 18756 leader_election.cc:290] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:51.844606 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b6d4d69b644b7a7c5ec7b137eef7f" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:51.848213 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b6d4d69b644b7a7c5ec7b137eef7f" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.850749 18144 leader_election.cc:304] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.855659 18736 raft_consensus.cc:2749] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.857364 18303 ts_tablet_manager.cc:1434] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.002s
I20260709 13:19:51.868155 17927 catalog_manager.cc:5697] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.869628 18717 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:51.870301 18717 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.872965 18717 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:51.873822 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:51.875280 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.877231 18218 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.879778 18717 raft_consensus.cc:2749] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.881024 18731 raft_consensus.cc:493] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.881616 18731 raft_consensus.cc:515] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:51.884788 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:51.889568 18303 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:51.892339 18731 leader_election.cc:290] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.894138 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.895150 18097 raft_consensus.cc:2393] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8fdca3eaa0547d08fd840005216e2da in current term 1: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:51.897763 17994 leader_election.cc:304] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:51.897874 18718 raft_consensus.cc:493] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.899201 18718 raft_consensus.cc:515] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.902045 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:51.903704 18738 raft_consensus.cc:3060] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.905951 18023 raft_consensus.cc:2393] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
I20260709 13:19:51.912722 18303 tablet_bootstrap.cc:654] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.924328 18738 raft_consensus.cc:2749] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.901506 18718 leader_election.cc:290] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:51.926671 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ae0e2b2834f4fc0bd95acb2401862ed" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:51.928395 18143 leader_election.cc:304] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:51.929016 18718 raft_consensus.cc:3060] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.931792 18297 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:51.937268 18303 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:51.937901 18303 ts_tablet_manager.cc:1403] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.005s
I20260709 13:19:51.938241 18718 raft_consensus.cc:2749] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.944859 18754 consensus_queue.cc:1048] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:51.943414 18303 raft_consensus.cc:359] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.950069 18303 raft_consensus.cc:385] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.950359 18303 raft_consensus.cc:740] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.951025 18303 consensus_queue.cc:260] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:51.953238 18303 ts_tablet_manager.cc:1434] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:19:51.954501 18303 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:51.955982 18297 ts_tablet_manager.cc:1403] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.173s	user 0.018s	sys 0.005s
I20260709 13:19:51.960141 18297 raft_consensus.cc:359] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.960871 18297 raft_consensus.cc:385] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.961191 18303 tablet_bootstrap.cc:654] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.961148 18297 raft_consensus.cc:740] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.958645 17927 catalog_manager.cc:5697] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.962697 18297 consensus_queue.cc:260] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:51.964886 18297 ts_tablet_manager.cc:1434] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:51.966224 18297 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:51.975392 18754 consensus_queue.cc:1048] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.982318 18297 tablet_bootstrap.cc:654] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.011337 18303 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:52.011890 18303 ts_tablet_manager.cc:1403] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.007s
I20260709 13:19:52.012934 17925 catalog_manager.cc:5697] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 1 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.014604 18303 raft_consensus.cc:359] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:52.015290 18303 raft_consensus.cc:385] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.015573 18303 raft_consensus.cc:740] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.016402 18303 consensus_queue.cc:260] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:52.018836 18303 ts_tablet_manager.cc:1434] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:52.019829 18303 tablet_bootstrap.cc:492] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:52.027226 18303 tablet_bootstrap.cc:654] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.029592 18297 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: No bootstrap required, opened a new log
I20260709 13:19:52.030265 18297 ts_tablet_manager.cc:1403] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.018s
I20260709 13:19:52.033159 18297 raft_consensus.cc:359] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.038033 18297 raft_consensus.cc:385] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.038395 18297 raft_consensus.cc:740] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.039233 18297 consensus_queue.cc:260] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.045282 18743 consensus_queue.cc:1048] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.050383 18297 ts_tablet_manager.cc:1434] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:52.061338 18726 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.061873 18726 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.064235 18726 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:52.065033 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:52.067240 17992 leader_election.cc:343] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.069968 18726 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:52.070569 18726 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.074296 18726 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:52.076582 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:52.077332 18252 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:52.077992 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:52.078383 17995 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:52.079427 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:52.088109 18246 raft_consensus.cc:2468] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 0.
I20260709 13:19:52.089282 17995 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:52.090229 18731 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:52.090615 18731 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:52.090992 18731 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:52.091544 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08002b21e0 after lost signal to thread 8942
W20260709 13:19:52.093130 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab580 after lost signal to thread 17961
W20260709 13:19:52.094856 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08001b15a0 after lost signal to thread 18053
W20260709 13:19:52.099248 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08001fdd60 after lost signal to thread 18128
I20260709 13:19:52.102501 18738 raft_consensus.cc:2804] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.103067 18738 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.103412 18738 raft_consensus.cc:3060] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.110989 18731 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.112680 18175 raft_consensus.cc:3060] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.118916 18742 consensus_queue.cc:1048] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.121188 18303 tablet_bootstrap.cc:492] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:52.121855 18303 ts_tablet_manager.cc:1403] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.039s
W20260709 13:19:52.125025 18125 debug-util.cc:398] Leaking SignalData structure 0x7b0800243c60 after lost signal to thread 18202
I20260709 13:19:52.124925 18303 raft_consensus.cc:359] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:52.125818 18303 raft_consensus.cc:385] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.126164 18303 raft_consensus.cc:740] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
W20260709 13:19:52.126572 18125 debug-util.cc:398] Leaking SignalData structure 0x7b080020d8e0 after lost signal to thread 18276
I20260709 13:19:52.127074 18303 consensus_queue.cc:260] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:19:52.129052 18303 ts_tablet_manager.cc:1434] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:52.130148 18303 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91: Bootstrap starting.
I20260709 13:19:52.132654 18586 consensus_queue.cc:1048] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.136260 18303 tablet_bootstrap.cc:654] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.145161 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:52.151997 18738 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.159941 18726 consensus_queue.cc:1048] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.177170 18738 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:52.173365 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
W20260709 13:19:52.181010 17992 leader_election.cc:343] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.182952 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:52.183511 18246 raft_consensus.cc:3060] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.190083 18731 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:52.197120 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:52.198580 18246 raft_consensus.cc:2468] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 1.
I20260709 13:19:52.204007 17995 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:52.205319 17995 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:52.206231 18586 raft_consensus.cc:2804] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.205622 18738 raft_consensus.cc:2749] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:52.206826 18586 raft_consensus.cc:697] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:19:52.207733 18586 consensus_queue.cc:237] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.216938 18303 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91: No bootstrap required, opened a new log
I20260709 13:19:52.221436 18303 ts_tablet_manager.cc:1403] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.005s
I20260709 13:19:52.222776 17927 catalog_manager.cc:5697] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 0 to 1, leader changed from <none> to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 1 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.224334 18303 raft_consensus.cc:359] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.225059 18303 raft_consensus.cc:385] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.225584 18303 raft_consensus.cc:740] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.228852 18303 consensus_queue.cc:260] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.239116 18303 ts_tablet_manager.cc:1434] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:19:52.284606 18548 consensus_queue.cc:1048] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.290453 18632 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.291117 18632 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.294106 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:52.294886 18252 raft_consensus.cc:2393] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 1: Already voted for candidate e8fdca3eaa0547d08fd840005216e2da in this term.
I20260709 13:19:52.296955 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:52.299293 18144 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:52.300246 18718 raft_consensus.cc:3060] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.304468 18632 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:52.311475 18718 raft_consensus.cc:2749] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.313194 18717 consensus_queue.cc:1048] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.322613 18718 raft_consensus.cc:493] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.323237 18718 raft_consensus.cc:515] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:52.327725 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:52.327978 18718 leader_election.cc:290] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:52.329540 18028 raft_consensus.cc:2468] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:52.330942 18144 leader_election.cc:304] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:19:52.330972 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:52.331887 18718 raft_consensus.cc:2804] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.331950 18097 raft_consensus.cc:2468] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 0.
I20260709 13:19:52.332346 18718 raft_consensus.cc:493] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.332723 18718 raft_consensus.cc:3060] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.340755 18718 raft_consensus.cc:515] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:52.343214 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:52.343607 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:52.344316 18100 raft_consensus.cc:3060] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.355116 18100 raft_consensus.cc:2468] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:52.358808 18028 raft_consensus.cc:3060] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.361428 18143 leader_election.cc:304] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:52.362378 18736 raft_consensus.cc:2804] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.362885 18736 raft_consensus.cc:697] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:52.363788 18736 consensus_queue.cc:237] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:52.367017 18028 raft_consensus.cc:2468] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:52.396162 18718 leader_election.cc:290] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 1 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:52.408556 17927 catalog_manager.cc:5697] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.505479 18174 raft_consensus.cc:3060] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.597513 18731 consensus_queue.cc:1048] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.600502 18028 raft_consensus.cc:1240] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Rejecting Update request from peer e6e16b9214a1403293e3eeb06be25a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:52.602156 18736 consensus_queue.cc:1059] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.603209 18736 raft_consensus.cc:3055] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.603557 18736 raft_consensus.cc:740] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:52.604403 18736 consensus_queue.cc:260] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:52.605783 18736 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.656046 18726 consensus_queue.cc:1048] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.949317 18718 consensus_queue.cc:1048] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.950771 18718 consensus_queue.cc:1048] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.653367 18548 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:53.653892 18548 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:53.670459 18548 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:53.671247 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:53.671545 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:53.672156 18174 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:19:53.672627 18028 raft_consensus.cc:2393] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 2: Already voted for candidate e8fdca3eaa0547d08fd840005216e2da in this term.
I20260709 13:19:53.673573 18215 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:53.674695 18548 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:53.675048 18548 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6e16b9214a1403293e3eeb06be25a91)
I20260709 13:19:53.675349 18548 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.686762 18548 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:53.688753 18548 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:53.689734 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:53.692095 18028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:53.692749 18028 raft_consensus.cc:2393] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 2: Already voted for candidate e8fdca3eaa0547d08fd840005216e2da in this term.
I20260709 13:19:53.697660 18174 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:19:53.698901 18215 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:53.699563 18548 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:53.700030 18548 raft_consensus.cc:697] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:53.700753 18548 consensus_queue.cc:237] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:53.711416 17923 catalog_manager.cc:5697] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.983944  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
W20260709 13:19:54.003216 18070 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 640 similar messages]
W20260709 13:19:54.032073 18070 consensus_peers.cc:597] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.033991 18144 consensus_peers.cc:597] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.036453 18070 consensus_peers.cc:597] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.041571 18070 consensus_peers.cc:597] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.054105 18070 consensus_peers.cc:597] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.064229 18218 consensus_peers.cc:597] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.065132 18218 consensus_peers.cc:597] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.073475 18070 consensus_peers.cc:597] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.076936 18144 consensus_peers.cc:597] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.092648 18144 consensus_peers.cc:597] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.099239 18144 consensus_peers.cc:597] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.104328  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:54.105329  8939 tablet_replica.cc:333] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.106446  8939 raft_consensus.cc:2243] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.107060  8939 raft_consensus.cc:2272] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.109062  8939 tablet_replica.cc:333] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.109654  8939 raft_consensus.cc:2243] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.110064  8939 raft_consensus.cc:2272] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.111917  8939 tablet_replica.cc:333] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.112500  8939 raft_consensus.cc:2243] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.113355  8939 raft_consensus.cc:2272] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.115438  8939 tablet_replica.cc:333] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.116211  8939 raft_consensus.cc:2243] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.116616  8939 raft_consensus.cc:2272] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.118404  8939 tablet_replica.cc:333] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.118984  8939 raft_consensus.cc:2243] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.119796  8939 raft_consensus.cc:2272] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.121944  8939 tablet_replica.cc:333] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.122612  8939 raft_consensus.cc:2243] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.123116  8939 raft_consensus.cc:2272] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.125044  8939 tablet_replica.cc:333] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.125633  8939 raft_consensus.cc:2243] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.126068  8939 raft_consensus.cc:2272] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.127941  8939 tablet_replica.cc:333] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.128516  8939 raft_consensus.cc:2243] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.128937  8939 raft_consensus.cc:2272] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.131399  8939 tablet_replica.cc:333] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.132272  8939 raft_consensus.cc:2243] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.132879  8939 raft_consensus.cc:2272] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.135375  8939 tablet_replica.cc:333] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.136101  8939 raft_consensus.cc:2243] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.136569  8939 raft_consensus.cc:2272] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.139221  8939 tablet_replica.cc:333] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.139861  8939 raft_consensus.cc:2243] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.140280  8939 raft_consensus.cc:2272] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.142112  8939 tablet_replica.cc:333] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.142699  8939 raft_consensus.cc:2243] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.143143  8939 raft_consensus.cc:2272] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.145009  8939 tablet_replica.cc:333] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.145663  8939 raft_consensus.cc:2243] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.146195  8939 raft_consensus.cc:2272] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.148689  8939 tablet_replica.cc:333] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.149513  8939 raft_consensus.cc:2243] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.150045  8939 raft_consensus.cc:2272] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.150609 18070 consensus_peers.cc:597] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.152617  8939 tablet_replica.cc:333] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.153543  8939 raft_consensus.cc:2243] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.154541  8939 raft_consensus.cc:2272] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.156419 18070 consensus_peers.cc:597] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.156939  8939 tablet_replica.cc:333] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.157611  8939 raft_consensus.cc:2243] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.158030  8939 raft_consensus.cc:2272] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.159989  8939 tablet_replica.cc:333] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.160570  8939 raft_consensus.cc:2243] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.161012  8939 raft_consensus.cc:2272] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.162879  8939 tablet_replica.cc:333] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.163558  8939 raft_consensus.cc:2243] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.164012  8939 raft_consensus.cc:2272] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.166323  8939 tablet_replica.cc:333] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.167119  8939 raft_consensus.cc:2243] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.167516  8939 raft_consensus.cc:2272] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.169389  8939 tablet_replica.cc:333] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.169945  8939 raft_consensus.cc:2243] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.170341  8939 raft_consensus.cc:2272] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.172199  8939 tablet_replica.cc:333] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.172767  8939 raft_consensus.cc:2243] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.173177  8939 raft_consensus.cc:2272] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.175266  8939 tablet_replica.cc:333] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.175889  8939 raft_consensus.cc:2243] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.176837  8939 raft_consensus.cc:2272] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.179353  8939 tablet_replica.cc:333] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.180192  8939 raft_consensus.cc:2243] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:54.180261 18144 consensus_peers.cc:597] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.180655  8939 raft_consensus.cc:2272] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.182792  8939 tablet_replica.cc:333] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.183373  8939 raft_consensus.cc:2243] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.184183  8939 raft_consensus.cc:2272] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.186017  8939 tablet_replica.cc:333] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.186579  8939 raft_consensus.cc:2243] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.187000  8939 raft_consensus.cc:2272] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.189217  8939 tablet_replica.cc:333] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.189913  8939 raft_consensus.cc:2243] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.190455 18175 raft_consensus.cc:1275] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:54.190773  8939 raft_consensus.cc:2272] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.193670  8939 tablet_replica.cc:333] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.194528  8939 raft_consensus.cc:2243] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.194381 18548 consensus_queue.cc:1048] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:54.195147  8939 raft_consensus.cc:2272] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.198331  8939 tablet_replica.cc:333] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.199198  8939 raft_consensus.cc:2243] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.200343  8939 raft_consensus.cc:2272] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.200459 18218 consensus_peers.cc:597] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.203557  8939 tablet_replica.cc:333] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.204260  8939 raft_consensus.cc:2243] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.204706  8939 raft_consensus.cc:2272] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.207201  8939 tablet_replica.cc:333] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.208050  8939 raft_consensus.cc:2243] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.208581  8939 raft_consensus.cc:2272] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.210582 18218 consensus_peers.cc:597] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.211341  8939 tablet_replica.cc:333] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.212293  8939 raft_consensus.cc:2243] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.212847  8939 raft_consensus.cc:2272] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.215842  8939 tablet_replica.cc:333] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
W20260709 13:19:54.216600 18070 consensus_peers.cc:597] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.216693  8939 raft_consensus.cc:2243] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.217531  8939 raft_consensus.cc:2272] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.220448  8939 tablet_replica.cc:333] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.221258  8939 raft_consensus.cc:2243] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.222325  8939 raft_consensus.cc:2272] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.225219  8939 tablet_replica.cc:333] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.225975  8939 raft_consensus.cc:2243] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.226471  8939 raft_consensus.cc:2272] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.227845 18144 consensus_peers.cc:597] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.229266  8939 tablet_replica.cc:333] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.230206  8939 raft_consensus.cc:2243] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.230742  8939 raft_consensus.cc:2272] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.234951  8939 tablet_replica.cc:333] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.235795  8939 raft_consensus.cc:2243] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.236346  8939 raft_consensus.cc:2272] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.239243  8939 tablet_replica.cc:333] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
W20260709 13:19:54.239696 18144 consensus_peers.cc:597] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.240188  8939 raft_consensus.cc:2243] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.240734  8939 raft_consensus.cc:2272] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.243396  8939 tablet_replica.cc:333] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.244211  8939 raft_consensus.cc:2243] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.244724  8939 raft_consensus.cc:2272] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.247450  8939 tablet_replica.cc:333] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.248260  8939 raft_consensus.cc:2243] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.248788  8939 raft_consensus.cc:2272] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.251700  8939 tablet_replica.cc:333] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.252506  8939 raft_consensus.cc:2243] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.253511  8939 raft_consensus.cc:2272] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.255520  8939 tablet_replica.cc:333] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.256291  8939 raft_consensus.cc:2243] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.256801  8939 raft_consensus.cc:2272] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.258875 18070 consensus_peers.cc:597] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.259336  8939 tablet_replica.cc:333] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.260109  8939 raft_consensus.cc:2243] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.260686  8939 raft_consensus.cc:2272] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.263338  8939 tablet_replica.cc:333] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.264087  8939 raft_consensus.cc:2243] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.265234  8939 raft_consensus.cc:2272] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.268203  8939 tablet_replica.cc:333] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.268903  8939 raft_consensus.cc:2243] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.269407  8939 raft_consensus.cc:2272] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.272037  8939 tablet_replica.cc:333] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: stopping tablet replica
I20260709 13:19:54.272670  8939 raft_consensus.cc:2243] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.273763  8939 raft_consensus.cc:2272] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.303936 18218 consensus_peers.cc:597] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.315026 18144 consensus_peers.cc:597] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.315887 18070 consensus_peers.cc:597] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.367022  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
W20260709 13:19:54.371057 18218 consensus_peers.cc:597] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.371812 18218 consensus_peers.cc:597] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.375252 18218 consensus_peers.cc:597] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.375865 18218 consensus_peers.cc:597] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.381160 18144 consensus_peers.cc:597] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.451478 18218 consensus_peers.cc:597] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.463343  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:54.485133 18218 consensus_peers.cc:597] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.486807 18144 consensus_peers.cc:597] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.489219 18816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:54.490260 18817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:54.499969 18218 consensus_peers.cc:597] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.500662  8939 server_base.cc:1061] running on GCE node
W20260709 13:19:54.501682 18070 consensus_peers.cc:597] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.502928 18820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:54.505468  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:54.505716  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:54.505970  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603194505950 us; error 0 us; skew 500 ppm
I20260709 13:19:54.506759  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:19:54.509521 18070 consensus_peers.cc:597] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.510279  8939 webserver.cc:533] Webserver started at http://127.8.186.193:43847/ using document root <none> and password file <none>
I20260709 13:19:54.510874  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:54.511075  8939 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:54.516054  8939 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:19:54.524917 18824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:54.525831  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:19:54.526216  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "e8fdca3eaa0547d08fd840005216e2da"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-mq27"
I20260709 13:19:54.526749  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:54.558748  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:54.560292  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:54.569922  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:54.607167 18831 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:19:54.665838 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 63074.3us
I20260709 13:19:55.061533  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:19:55.061976  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.471s	user 0.007s	sys 0.013s
I20260709 13:19:55.062340  8939 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:19:55.069116 18831 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:55.089208 18831 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.090189 18831 tablet_bootstrap.cc:492] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.090831 18831 ts_tablet_manager.cc:1403] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.016s
I20260709 13:19:55.093500 18831 raft_consensus.cc:359] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.094242 18831 raft_consensus.cc:740] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.095005 18831 consensus_queue.cc:260] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.129079 18831 ts_tablet_manager.cc:1434] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.038s	user 0.024s	sys 0.007s
I20260709 13:19:55.129843 18831 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:55.146562 18831 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.147284 18831 tablet_bootstrap.cc:492] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.147843 18831 ts_tablet_manager.cc:1403] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:19:55.149761 18831 raft_consensus.cc:359] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.150241 18831 raft_consensus.cc:740] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.150817 18831 consensus_queue.cc:260] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.152210 18831 ts_tablet_manager.cc:1434] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:55.152807 18831 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:55.162408 18736 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.162982 18736 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.164945 18736 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.169476 18831 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.170506 18831 tablet_bootstrap.cc:492] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.170857 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.171214 18831 ts_tablet_manager.cc:1403] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:19:55.173682 18831 raft_consensus.cc:359] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.174314 18831 raft_consensus.cc:740] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.175005 18831 consensus_queue.cc:260] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.177304 18831 ts_tablet_manager.cc:1434] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:55.178050 18831 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:55.189232 18144 leader_election.cc:336] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.206211 18144 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.212802 18718 raft_consensus.cc:2749] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.276976 18834 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.277612 18834 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.286540 18718 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.287086 18718 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.288757 18718 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.295678 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.279641 18834 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.289227 18718 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.315863 18718 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.317831 18718 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.338099 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.342243 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.345006 18736 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.345592 18736 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.360428 18846 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.361020 18846 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.364056 18797 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.364580 18797 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.366905 18797 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:55.367334 18846 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:19:55.367852 18218 leader_election.cc:336] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.347510 18736 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.381182 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.393657 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.394284 18100 raft_consensus.cc:2468] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.399147 18834 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.399760 18834 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.402073 18797 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.402634 18797 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.404855 18797 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
W20260709 13:19:55.405563 18143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 52620.4us
I20260709 13:19:55.415664 18834 leader_election.cc:290] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.421662 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:55.426445 18834 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.427115 18834 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:55.433681 18070 leader_election.cc:336] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.435894 18070 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.437867 18797 raft_consensus.cc:2749] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.441612 18834 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
W20260709 13:19:55.440912 18144 leader_election.cc:336] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.442395 18144 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.446312 18793 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.446938 18793 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.449270 18838 raft_consensus.cc:2749] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.455565 18217 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.459724 18831 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:55.460400 18218 leader_election.cc:336] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.460527 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.460816 18831 tablet_bootstrap.cc:492] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.461624 18831 ts_tablet_manager.cc:1403] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.284s	user 0.088s	sys 0.065s
I20260709 13:19:55.462155 18846 raft_consensus.cc:2804] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.462586 18846 raft_consensus.cc:493] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.462955 18846 raft_consensus.cc:3060] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:55.463362 18144 leader_election.cc:336] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.463850 18144 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.464498 18793 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.465431 18834 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.465982 18834 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.467478 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:55.468007 18834 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.468181 18172 raft_consensus.cc:2468] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
W20260709 13:19:55.470045 18070 leader_election.cc:336] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.470489 18070 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
W20260709 13:19:55.470636 18144 leader_election.cc:336] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.471089 18144 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.471788 18718 raft_consensus.cc:2749] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.473163 18067 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.473624 18834 raft_consensus.cc:2749] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.474009 18836 raft_consensus.cc:2804] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.474462 18836 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.474874 18836 raft_consensus.cc:3060] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.478138 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.474503 18831 raft_consensus.cc:359] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.479004 18103 raft_consensus.cc:2468] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.479012 18831 raft_consensus.cc:740] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.480825 18831 consensus_queue.cc:260] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.482990 18831 ts_tablet_manager.cc:1434] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:19:55.483827 18831 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:55.485589 18070 leader_election.cc:336] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.486075 18070 leader_election.cc:304] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.486840  8939 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:19:55.487210  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.425s	user 0.274s	sys 0.004s
I20260709 13:19:55.486687 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.488325 18248 raft_consensus.cc:2468] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:55.485493 18217 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.489419 18834 raft_consensus.cc:2749] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:55.491181 18070 leader_election.cc:336] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.491691 18070 leader_election.cc:336] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.492178 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.493503 18070 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.503218 18834 raft_consensus.cc:2804] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.503645 18834 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.504053 18834 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.511538 18718 raft_consensus.cc:493] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.499598 18836 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.512281 18718 raft_consensus.cc:515] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.464533 18736 raft_consensus.cc:2749] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.519492 18719 raft_consensus.cc:2804] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.519999 18719 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.520364 18719 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.521175 18834 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.527659 18836 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:55.528771 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:55.529596 18172 raft_consensus.cc:3060] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.531798 18846 raft_consensus.cc:515] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.534005 18846 leader_election.cc:290] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.541312 18836 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.544137 18831 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.545485 18836 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:55.547894 18218 leader_election.cc:336] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.549182 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:55.550009 18174 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:55.553258 18834 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:55.554147 18846 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.554725 18846 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.554988 18067 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
W20260709 13:19:55.554651 18070 leader_election.cc:336] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.555922 18070 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.557206 18846 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.528771 18793 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.555347 18836 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.560055 18836 raft_consensus.cc:2749] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.561416 18718 leader_election.cc:290] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.562235 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:55.563118 18070 leader_election.cc:336] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.563683 18070 leader_election.cc:336] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.559434 18831 tablet_bootstrap.cc:492] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.560071 18852 raft_consensus.cc:2804] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.565001 18831 ts_tablet_manager.cc:1403] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.000s
I20260709 13:19:55.565248 18852 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.565652 18852 raft_consensus.cc:3060] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.567921 18831 raft_consensus.cc:359] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.568670 18831 raft_consensus.cc:740] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.572013 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec6c104c96c43e5848ec45b8cf9c36d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:55.572749 18103 raft_consensus.cc:3060] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.572587 18831 consensus_queue.cc:260] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.573835 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.574501 18101 raft_consensus.cc:2468] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.580090 18831 ts_tablet_manager.cc:1434] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:55.581095 18831 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:55.582304 18103 raft_consensus.cc:2468] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:19:55.583863 18845 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
W20260709 13:19:55.586195 18070 leader_election.cc:336] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.592134 18845 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.594159 18845 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.586854 18852 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.596700 18847 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.597590 18847 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.599891 18847 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
W20260709 13:19:55.600883 18144 leader_election.cc:336] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.601382 18144 leader_election.cc:304] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.603438 18736 raft_consensus.cc:2749] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.605798 18852 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.608659 18845 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.609797 18845 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:55.610634 18070 leader_election.cc:336] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.612100 18845 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.559517 18793 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.617609 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:55.585361 18217 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:55.619366 18845 raft_consensus.cc:2804] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.619853 18845 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.620503 18845 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.619601 18831 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.621670 18831 tablet_bootstrap.cc:492] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.621840 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:55.622394 18831 ts_tablet_manager.cc:1403] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.006s
I20260709 13:19:55.622526 18175 raft_consensus.cc:2468] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.625316 18831 raft_consensus.cc:359] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.626185 18831 raft_consensus.cc:740] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.628130 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:19:55.628693 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 43654.4us
I20260709 13:19:55.629710 18846 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.630210 18846 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.628871 18175 raft_consensus.cc:2468] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.632268 18846 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.632929 18719 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.634301 18246 raft_consensus.cc:2393] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 830a192d6137410e8bd043588f0ed425 in current term 2: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:55.634362 18831 consensus_queue.cc:260] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.539335 18172 raft_consensus.cc:2468] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 2.
I20260709 13:19:55.639338 18831 ts_tablet_manager.cc:1434] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:19:55.640268 18831 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:55.642786 18215 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.644151 18846 raft_consensus.cc:2804] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.644225 18215 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.644606 18846 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.645002 18846 raft_consensus.cc:3060] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.648630 18814 raft_consensus.cc:2804] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.649080 18814 raft_consensus.cc:493] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.649420 18814 raft_consensus.cc:3060] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.653731 18846 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.655938 18846 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.663690 18070 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 830a192d6137410e8bd043588f0ed425; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.664279 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:55.665196 18852 raft_consensus.cc:2749] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:55.665835 18793 leader_election.cc:290] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.669241 18814 raft_consensus.cc:515] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.670550 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:55.696105 18172 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.631438 18217 leader_election.cc:304] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.672035 18067 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.665314 18246 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:55.677436 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:55.698873 18175 raft_consensus.cc:3060] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:55.699620 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 68290.4us
I20260709 13:19:55.701450 18846 raft_consensus.cc:2804] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.701939 18846 raft_consensus.cc:697] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:55.702827 18846 consensus_queue.cc:237] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.706288 18847 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.706966 18847 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.709257 18847 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.698359 18797 raft_consensus.cc:2804] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.711112 18100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.711079 18797 raft_consensus.cc:697] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:55.712687 18100 raft_consensus.cc:2468] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 1.
I20260709 13:19:55.712605 18797 consensus_queue.cc:237] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.714546 18143 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.715613 18736 raft_consensus.cc:2804] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.716033 18736 raft_consensus.cc:493] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.716401 18736 raft_consensus.cc:3060] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.717041 18852 raft_consensus.cc:493] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.717685 18852 raft_consensus.cc:515] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.684253 18719 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:19:55.686441 18218 leader_election.cc:336] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.720582 18218 leader_election.cc:336] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.709445 18175 raft_consensus.cc:2468] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 2.
I20260709 13:19:55.726471 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:55.727335 18172 raft_consensus.cc:3060] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.728509 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f2c770ec624cb48eb6dc2e7007437d" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:55.729229 18174 raft_consensus.cc:3060] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:55.729628 18144 leader_election.cc:336] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.733865 18814 leader_election.cc:290] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.693723 18845 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.737452 18174 raft_consensus.cc:2468] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:19:55.740298 18067 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.741664 18853 raft_consensus.cc:2804] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.742245 18853 raft_consensus.cc:697] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:55.744164 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:55.745227 18101 raft_consensus.cc:2393] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 2: Already voted for candidate 830a192d6137410e8bd043588f0ed425 in this term.
I20260709 13:19:55.743155 18853 consensus_queue.cc:237] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.744252 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:55.746790 18103 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 1.
I20260709 13:19:55.749125 18852 leader_election.cc:290] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:55.728212 18215 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.753002 18719 raft_consensus.cc:2804] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.753626 18719 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.754081 18719 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:55.725685 18218 leader_election.cc:336] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.752351 18215 leader_election.cc:304] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.764750 18844 raft_consensus.cc:2804] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.765318 18844 raft_consensus.cc:697] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:55.766268 18844 consensus_queue.cc:237] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.776664 18845 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.784405 18217 leader_election.cc:304] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:55.786104 18793 raft_consensus.cc:2804] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.786489 18831 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.786608 18793 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.775532 18736 raft_consensus.cc:515] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.789570 18793 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.797364 17927 catalog_manager.cc:5697] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:55.787724 18070 leader_election.cc:336] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.800479 18144 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.818363 18838 raft_consensus.cc:2804] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.818771 18838 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.819123 18838 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.807724 17923 catalog_manager.cc:5697] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.787849 18831 tablet_bootstrap.cc:492] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
W20260709 13:19:55.801741 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 76115.8us
I20260709 13:19:55.811867 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802d97ba13fe467c87385eae6fe54a02" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
W20260709 13:19:55.827625 18218 leader_election.cc:336] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.827773 18831 ts_tablet_manager.cc:1403] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.188s	user 0.019s	sys 0.037s
I20260709 13:19:55.827888 18103 raft_consensus.cc:3060] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:55.828460 18218 leader_election.cc:336] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.830526 18831 raft_consensus.cc:359] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.831219 18831 raft_consensus.cc:740] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.832114 18831 consensus_queue.cc:260] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.834299 18831 ts_tablet_manager.cc:1434] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:55.826670 18736 leader_election.cc:290] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:55.835187 18831 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:55.838115 18103 raft_consensus.cc:2468] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:19:55.844080 18143 leader_election.cc:304] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.845415 18847 raft_consensus.cc:2804] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.845986 18847 raft_consensus.cc:697] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 2 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:55.846890 18847 consensus_queue.cc:237] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:55.842053 18838 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.848948 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:55.849660 18101 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.857059 18101 raft_consensus.cc:2468] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:19:55.868346 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:55.869144 18174 raft_consensus.cc:2468] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 1.
I20260709 13:19:55.871704 18172 raft_consensus.cc:2468] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
W20260709 13:19:55.875278 18144 leader_election.cc:336] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.878222 18838 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.889022 18067 leader_election.cc:304] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.890017 18797 raft_consensus.cc:2804] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:55.890496 18797 raft_consensus.cc:493] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:19:55.890892 18797 raft_consensus.cc:3060] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.904657 18797 raft_consensus.cc:515] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:55.907089 18144 leader_election.cc:336] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.907953 18144 leader_election.cc:336] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.913843 18217 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:19:55.917968 18215 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:55.908512 18719 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:55.922022 18814 raft_consensus.cc:2804] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.922487 18719 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:55.922729 18814 raft_consensus.cc:697] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:55.929945 18814 consensus_queue.cc:237] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:55.928180 18218 leader_election.cc:336] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.923172 18793 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.937410 18793 leader_election.cc:290] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:19:55.931954 18218 leader_election.cc:336] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.927623 18797 leader_election.cc:290] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:19:55.941920 18218 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:55.927829 18844 raft_consensus.cc:2804] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.945173 18793 raft_consensus.cc:2749] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:55.945993 18070 leader_election.cc:336] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.949273 18172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879a0395b8c47ee82b8d483717aacd7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:55.950500 18172 raft_consensus.cc:3060] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.949373 18844 raft_consensus.cc:697] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:55.960686 18844 consensus_queue.cc:237] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.981171 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:19:55.982076 18176 raft_consensus.cc:2393] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 23853b156a904ba6a31afa79977f3adc in current term 2: Already voted for candidate e6e16b9214a1403293e3eeb06be25a91 in this term.
I20260709 13:19:55.979537 17924 catalog_manager.cc:5697] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:55.984193 18218 leader_election.cc:336] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.985214 18218 leader_election.cc:336] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.986363 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 71385.1us
I20260709 13:19:55.988049 18831 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:55.989110 18831 tablet_bootstrap.cc:492] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:55.989792 18831 ts_tablet_manager.cc:1403] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.155s	user 0.034s	sys 0.035s
I20260709 13:19:55.992499 18831 raft_consensus.cc:359] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:55.993158 18831 raft_consensus.cc:740] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.993836 18831 consensus_queue.cc:260] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:55.994210 18218 leader_election.cc:336] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:19:55.994915 18218 leader_election.cc:336] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:19:55.996804 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:19:55.997473 18101 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.998741 18172 raft_consensus.cc:2468] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 2.
I20260709 13:19:56.005913 18831 ts_tablet_manager.cc:1434] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:56.005905 18067 leader_election.cc:304] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:56.025913 18797 raft_consensus.cc:2804] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:56.026582 18797 raft_consensus.cc:697] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:56.010176 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:56.027390 18797 consensus_queue.cc:237] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:56.028509 18248 raft_consensus.cc:2393] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e6e16b9214a1403293e3eeb06be25a91 in current term 2: Already voted for candidate 23853b156a904ba6a31afa79977f3adc in this term.
I20260709 13:19:56.007449 18101 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:19:56.031915 18217 leader_election.cc:304] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:56.034035 18844 raft_consensus.cc:2804] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:56.035038 18844 raft_consensus.cc:697] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:19:56.025924 18831 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:56.043159 18844 consensus_queue.cc:237] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.045408 18144 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:56.046712 18838 raft_consensus.cc:2749] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.065986 17923 catalog_manager.cc:5697] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.068410 17923 catalog_manager.cc:5697] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.066891 18215 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:56.074267 18814 raft_consensus.cc:2749] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.078711 18831 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.079773 18831 tablet_bootstrap.cc:492] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.080514 18831 ts_tablet_manager.cc:1403] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.003s
I20260709 13:19:56.111374 17924 catalog_manager.cc:5697] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.109205 18831 raft_consensus.cc:359] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.114620 18831 raft_consensus.cc:740] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.115475 18831 consensus_queue.cc:260] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.119911 18831 ts_tablet_manager.cc:1434] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:19:56.120930 18831 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:56.126466 18176 raft_consensus.cc:1275] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.131781 18852 consensus_queue.cc:1048] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:56.126359 17924 catalog_manager.cc:5697] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.144490 17924 catalog_manager.cc:5697] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.158407 18101 raft_consensus.cc:1275] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.157552 17924 catalog_manager.cc:5697] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.159148 18831 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.161065 18831 tablet_bootstrap.cc:492] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.161763 18831 ts_tablet_manager.cc:1403] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.005s
I20260709 13:19:56.167112 18814 consensus_queue.cc:1048] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:56.168861 18831 raft_consensus.cc:359] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.169641 18831 raft_consensus.cc:740] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.170352 18831 consensus_queue.cc:260] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.177197 18831 ts_tablet_manager.cc:1434] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:19:56.178104 18831 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:56.216488 18831 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.217516 18831 tablet_bootstrap.cc:492] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.218254 18831 ts_tablet_manager.cc:1403] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 13:19:56.226984 18831 raft_consensus.cc:359] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.227720 18831 raft_consensus.cc:740] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.230244 18831 consensus_queue.cc:260] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:56.231986 18070 consensus_peers.cc:597] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:56.233709 18831 ts_tablet_manager.cc:1434] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:19:56.237437 18831 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:56.275799 18218 consensus_peers.cc:597] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:56.286339 18172 raft_consensus.cc:1275] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.288337 18846 consensus_queue.cc:1048] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:56.290738 18831 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.304230 18831 tablet_bootstrap.cc:492] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.305106 18831 ts_tablet_manager.cc:1403] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.005s
W20260709 13:19:56.319510 18218 consensus_peers.cc:597] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.327665 18831 raft_consensus.cc:359] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.328876 18831 raft_consensus.cc:740] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.329782 18831 consensus_queue.cc:260] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.332096 18831 ts_tablet_manager.cc:1434] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:19:56.333060 18831 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:56.345472 18218 consensus_peers.cc:597] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:56.352195 18172 raft_consensus.cc:1275] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.358944 18853 consensus_queue.cc:1048] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:56.393800 18176 raft_consensus.cc:1275] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.395604 18846 consensus_queue.cc:1048] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:56.396662 18144 consensus_peers.cc:597] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:56.413096 18070 consensus_peers.cc:597] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:56.427798 18831 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.428828 18831 tablet_bootstrap.cc:492] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.498205 18840 raft_consensus.cc:493] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.499257 18101 raft_consensus.cc:1275] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e6e16b9214a1403293e3eeb06be25a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.504698 18840 raft_consensus.cc:515] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:56.505791 18070 consensus_peers.cc:597] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.429504 18831 ts_tablet_manager.cc:1403] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.001s
W20260709 13:19:56.540637 18070 consensus_peers.cc:597] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.543686 18840 leader_election.cc:290] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:56.549953 18847 consensus_queue.cc:1048] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:56.528569 18218 consensus_peers.cc:597] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.560182 18101 raft_consensus.cc:1275] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:56.570313 18144 consensus_peers.cc:597] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.573269 18070 consensus_peers.cc:597] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.574841 18831 raft_consensus.cc:359] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:19:56.592025 18070 consensus_peers.cc:597] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.598641 18218 consensus_peers.cc:597] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:56.597157 18831 raft_consensus.cc:740] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
W20260709 13:19:56.598508 18070 consensus_peers.cc:597] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.600708 18831 consensus_queue.cc:260] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.611910 18846 consensus_queue.cc:1048] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:19:56.613621 18840 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.614426 18840 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.617012 18840 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
W20260709 13:19:56.619652 18070 consensus_peers.cc:597] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.621147 18831 ts_tablet_manager.cc:1434] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.097s	user 0.011s	sys 0.001s
I20260709 13:19:56.622895 18831 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:56.624718 18101 raft_consensus.cc:1275] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:56.634131 18846 consensus_queue.cc:1048] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:56.651963 18840 raft_consensus.cc:493] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.652832 18840 raft_consensus.cc:515] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.659466 18840 leader_election.cc:290] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:56.709442 18172 raft_consensus.cc:1275] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:56.729506 18144 consensus_peers.cc:597] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.751575 18840 raft_consensus.cc:493] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.752547 18840 raft_consensus.cc:515] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.758504 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:56.760334 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:56.762486 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:56.764308 18252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
W20260709 13:19:56.765380 18218 consensus_peers.cc:597] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:56.765883 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 166527us
I20260709 13:19:56.774513 18840 leader_election.cc:290] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
W20260709 13:19:56.782902 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 53448.6us
W20260709 13:19:56.805706 18070 consensus_peers.cc:597] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.839030 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:56.837888 18853 consensus_queue.cc:1048] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:19:56.841416 18827 leader_election.cc:304] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:56.842850 18840 raft_consensus.cc:2749] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:56.844846 18070 consensus_peers.cc:597] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.848474 18070 consensus_peers.cc:597] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.848870 18218 consensus_peers.cc:597] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:56.848942 18070 consensus_peers.cc:597] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.849773 18218 consensus_peers.cc:597] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.850113 18070 consensus_peers.cc:597] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.851392 18070 consensus_peers.cc:597] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:56.851301 18218 consensus_peers.cc:597] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.861487 18831 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.864933 18831 tablet_bootstrap.cc:492] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.865703 18831 ts_tablet_manager.cc:1403] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.012s
W20260709 13:19:56.871451 18218 consensus_peers.cc:597] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.871188 18831 raft_consensus.cc:359] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.872078 18831 raft_consensus.cc:740] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.872918 18831 consensus_queue.cc:260] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:19:56.874281 18144 consensus_peers.cc:597] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.876185 18831 ts_tablet_manager.cc:1434] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:19:56.877290 18831 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:56.886488 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1412fa1b14f40fea87fb6a4cf76931d" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:56.896006 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:56.901589 18176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38e95faa660491da0ac409cbe606465" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:56.903455 18825 leader_election.cc:304] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:56.904448 18840 raft_consensus.cc:2749] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.905900 18825 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:56.907936 18840 raft_consensus.cc:2749] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.909777 18825 leader_election.cc:304] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:56.910794 18840 raft_consensus.cc:2749] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.918876 18840 raft_consensus.cc:493] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.919525 18840 raft_consensus.cc:515] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.922583 18840 leader_election.cc:290] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:56.923997 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
W20260709 13:19:56.925567 18218 consensus_peers.cc:597] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.927450 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675aa5689d904979a3aaa90534d93385" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:19:56.931989 18831 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:56.933014 18831 tablet_bootstrap.cc:492] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:56.933727 18831 ts_tablet_manager.cc:1403] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 13:19:56.937422 18825 leader_election.cc:304] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91
I20260709 13:19:56.938557 18840 raft_consensus.cc:2749] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:56.944839 18070 consensus_peers.cc:597] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.945472 18218 consensus_peers.cc:597] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.946110 18218 consensus_peers.cc:597] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.957612 18218 consensus_peers.cc:597] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:56.958601 18840 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.959280 18840 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:56.944864 18831 raft_consensus.cc:359] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.960691 18831 raft_consensus.cc:740] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.962507 18831 consensus_queue.cc:260] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:56.962707 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:19:56.963573 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:56.966114 18828 leader_election.cc:304] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8fdca3eaa0547d08fd840005216e2da; no voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425
I20260709 13:19:56.967664 18840 leader_election.cc:290] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:19:56.968449 18840 raft_consensus.cc:2749] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:56.971513 18144 consensus_peers.cc:597] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.972170 18144 consensus_peers.cc:597] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.974457 18144 consensus_peers.cc:597] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.991128 18144 consensus_peers.cc:597] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.008912 18831 ts_tablet_manager.cc:1434] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.023s
I20260709 13:19:57.011322 18831 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:57.011765 18144 consensus_peers.cc:597] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.042346 18831 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.043511 18831 tablet_bootstrap.cc:492] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.044394 18831 ts_tablet_manager.cc:1403] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.000s
I20260709 13:19:57.047304 18831 raft_consensus.cc:359] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.048008 18831 raft_consensus.cc:740] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.048861 18831 consensus_queue.cc:260] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.051102 18831 ts_tablet_manager.cc:1434] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:57.052096 18831 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.075556 18831 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.076571 18831 tablet_bootstrap.cc:492] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.080081 18831 ts_tablet_manager.cc:1403] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 13:19:57.083052 18831 raft_consensus.cc:359] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.083807 18831 raft_consensus.cc:740] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.084751 18831 consensus_queue.cc:260] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.087431 18831 ts_tablet_manager.cc:1434] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:57.088435  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:41391
I20260709 13:19:57.088582 18831 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.088626 18963 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:41391 every 8 connection(s)
I20260709 13:19:57.152421 18831 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.154299 18831 tablet_bootstrap.cc:492] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.156284 18831 ts_tablet_manager.cc:1403] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.008s
I20260709 13:19:57.159040 18831 raft_consensus.cc:359] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.161870 18831 raft_consensus.cc:740] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.160269 18965 heartbeater.cc:344] Connected to a master server at 127.8.186.254:34083
I20260709 13:19:57.162575 18965 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:57.162854 18831 consensus_queue.cc:260] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:19:57.164577 18218 consensus_peers.cc:597] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.163637 18965 heartbeater.cc:507] Master 127.8.186.254:34083 requested a full tablet report, sending...
I20260709 13:19:57.164788 18831 ts_tablet_manager.cc:1434] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:19:57.202255 18831 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:57.204685 18144 consensus_peers.cc:597] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.208038 18912 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.214088 18925 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.214761 18925 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.216979 18925 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:57.219578 18909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
W20260709 13:19:57.222470 18070 leader_election.cc:343] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.234284 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:57.235397 18251 raft_consensus.cc:2468] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 2.
I20260709 13:19:57.240443 18070 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:57.248725 18834 raft_consensus.cc:2804] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:57.249353 18834 raft_consensus.cc:493] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.249801 18834 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:57.251547 18218 consensus_peers.cc:597] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.266325 18831 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.267379 18831 tablet_bootstrap.cc:492] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.268100 18831 ts_tablet_manager.cc:1403] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.018s
I20260709 13:19:57.279004 18831 raft_consensus.cc:359] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.286896 18831 raft_consensus.cc:740] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.288000 18831 consensus_queue.cc:260] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.286131 18834 raft_consensus.cc:515] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.293133 18906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
I20260709 13:19:57.294482 18834 leader_election.cc:290] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 3 election: Requested vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:19:57.294718 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6d9f19cd54ca29ff8bb17b2f7abb7" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
W20260709 13:19:57.295053 18070 leader_election.cc:343] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.295349 18246 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:57.293146 18831 ts_tablet_manager.cc:1434] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:19:57.299242 18831 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.304373 18246 raft_consensus.cc:2468] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 3.
I20260709 13:19:57.305665 18070 leader_election.cc:304] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:57.306883 18834 raft_consensus.cc:2804] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:57.307401 18834 raft_consensus.cc:697] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 3 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:19:57.308743 18834 consensus_queue.cc:237] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.335887 17923 catalog_manager.cc:5697] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 1 to 3, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.377476 17924 ts_manager.cc:194] Re-registered known tserver with Master: e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:57.396085 18831 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.397133 18831 tablet_bootstrap.cc:492] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.397791 18831 ts_tablet_manager.cc:1403] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.015s
I20260709 13:19:57.400484 18831 raft_consensus.cc:359] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.401185 18831 raft_consensus.cc:740] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.401979 18831 consensus_queue.cc:260] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.406705 18906 raft_consensus.cc:3060] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.413067 18831 ts_tablet_manager.cc:1434] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:57.414058 18831 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.417121 18913 raft_consensus.cc:3060] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.460404 18831 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.461547 18831 tablet_bootstrap.cc:492] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.462255 18831 ts_tablet_manager.cc:1403] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.000s
I20260709 13:19:57.466310 18831 raft_consensus.cc:359] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.467128 18831 raft_consensus.cc:740] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.468007 17924 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57976
I20260709 13:19:57.468057 18831 consensus_queue.cc:260] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.473905 18912 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.474828 18965 heartbeater.cc:499] Master 127.8.186.254:34083 was elected leader, sending a full tablet report...
I20260709 13:19:57.478565 18831 ts_tablet_manager.cc:1434] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:19:57.482215 18831 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.531863 18831 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.532843 18831 tablet_bootstrap.cc:492] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.533509 18831 ts_tablet_manager.cc:1403] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.020s
I20260709 13:19:57.536377 18831 raft_consensus.cc:359] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.537072 18831 raft_consensus.cc:740] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.537961 18831 consensus_queue.cc:260] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.540853 18831 ts_tablet_manager.cc:1434] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:57.549647 18831 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.569664 18912 raft_consensus.cc:3060] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.572067 18831 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.573130 18831 tablet_bootstrap.cc:492] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.573863 18831 ts_tablet_manager.cc:1403] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 13:19:57.576877 18831 raft_consensus.cc:359] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.577584 18831 raft_consensus.cc:740] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.578292 18831 consensus_queue.cc:260] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.581077 18831 ts_tablet_manager.cc:1434] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:19:57.581981 18831 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.622957 18838 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.623633 18838 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.625852 18838 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:57.629303 18906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:19:57.630240 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:19:57.630975 18251 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:19:57.632400 18144 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:19:57.634256 18838 raft_consensus.cc:2804] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:57.634676 18838 raft_consensus.cc:493] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.635061 18838 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:57.636837 18144 leader_election.cc:343] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.634886 18831 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.640116 18831 tablet_bootstrap.cc:492] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.640784 18831 ts_tablet_manager.cc:1403] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.008s
I20260709 13:19:57.643510 18831 raft_consensus.cc:359] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.644215 18831 raft_consensus.cc:740] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.645052 18831 consensus_queue.cc:260] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:57.647420 18831 ts_tablet_manager.cc:1434] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:57.648303 18831 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.661227 18912 raft_consensus.cc:3060] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.670555 18838 raft_consensus.cc:515] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.675112 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:19:57.677429 18251 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:57.675458 18913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a20b2a9b6fc418eaebac50b17ddee1b" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
W20260709 13:19:57.681507 18144 leader_election.cc:343] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.689270 18251 raft_consensus.cc:2468] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 3.
I20260709 13:19:57.674371 18838 leader_election.cc:290] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:19:57.690699 18144 leader_election.cc:304] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:19:57.691524 18838 raft_consensus.cc:2804] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:57.694557 18838 raft_consensus.cc:697] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:19:57.695647 18838 consensus_queue.cc:237] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.696503 18831 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.697549 18831 tablet_bootstrap.cc:492] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.698125 18831 ts_tablet_manager.cc:1403] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.005s
I20260709 13:19:57.702541 18831 raft_consensus.cc:359] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.703831 18831 raft_consensus.cc:740] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.704614 18831 consensus_queue.cc:260] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.714735 18831 ts_tablet_manager.cc:1434] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 13:19:57.716048 18831 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.755921 18913 raft_consensus.cc:3060] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.762054 18912 raft_consensus.cc:3060] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:57.769727 17924 catalog_manager.cc:5697] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 1 to 3, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.776521 18912 raft_consensus.cc:1275] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:57.781149 18831 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.782327 18831 tablet_bootstrap.cc:492] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.783164 18831 ts_tablet_manager.cc:1403] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.012s
I20260709 13:19:57.786120 18925 consensus_queue.cc:1048] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:57.786465 18831 raft_consensus.cc:359] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.787289 18831 raft_consensus.cc:740] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.788115 18831 consensus_queue.cc:260] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:57.790513 18831 ts_tablet_manager.cc:1434] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260709 13:19:57.791715 18831 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.805714 18251 raft_consensus.cc:1275] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:57.820462 18834 consensus_queue.cc:1048] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:19:57.903206 18913 raft_consensus.cc:3060] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.941169 18831 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.942245 18831 tablet_bootstrap.cc:492] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.942942 18831 ts_tablet_manager.cc:1403] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.030s
I20260709 13:19:57.952046 18831 raft_consensus.cc:359] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.952775 18831 raft_consensus.cc:740] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.953471 18831 consensus_queue.cc:260] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.957556 18831 ts_tablet_manager.cc:1434] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:19:57.959460 18831 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:57.975628 18831 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.976579 18831 tablet_bootstrap.cc:492] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:57.977269 18831 ts_tablet_manager.cc:1403] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:19:57.979858 18831 raft_consensus.cc:359] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.980579 18831 raft_consensus.cc:740] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.981263 18831 consensus_queue.cc:260] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:57.982786 18831 ts_tablet_manager.cc:1434] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:19:57.983595 18831 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.011197 18831 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.012348 18831 tablet_bootstrap.cc:492] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.013051 18831 ts_tablet_manager.cc:1403] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.000s
I20260709 13:19:58.015771 18831 raft_consensus.cc:359] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.016433 18831 raft_consensus.cc:740] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.017199 18831 consensus_queue.cc:260] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.019381 18831 ts_tablet_manager.cc:1434] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:58.020218 18831 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.056771 18831 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.057682 18831 tablet_bootstrap.cc:492] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.058338 18831 ts_tablet_manager.cc:1403] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.008s
I20260709 13:19:58.061399 18831 raft_consensus.cc:359] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.062047 18831 raft_consensus.cc:740] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.062831 18831 consensus_queue.cc:260] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.069459 18831 ts_tablet_manager.cc:1434] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:19:58.070312 18831 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.076503 18913 raft_consensus.cc:3060] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:58.123595 18144 consensus_peers.cc:597] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:58.128779 18831 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.129931 18831 tablet_bootstrap.cc:492] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.130674 18831 ts_tablet_manager.cc:1403] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.028s
I20260709 13:19:58.136371 18831 raft_consensus.cc:359] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.137079 18831 raft_consensus.cc:740] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.137792 18831 consensus_queue.cc:260] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.140201 18831 ts_tablet_manager.cc:1434] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:58.141161 18831 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.156018 18831 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.156782 18831 tablet_bootstrap.cc:492] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.157353 18831 ts_tablet_manager.cc:1403] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:19:58.159394 18831 raft_consensus.cc:359] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.159932 18831 raft_consensus.cc:740] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.160491 18831 consensus_queue.cc:260] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.162406 18831 ts_tablet_manager.cc:1434] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:58.163604 18831 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.186199 18831 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.187379 18831 tablet_bootstrap.cc:492] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.188370 18831 ts_tablet_manager.cc:1403] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:19:58.191242 18831 raft_consensus.cc:359] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.192042 18831 raft_consensus.cc:740] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.193010 18831 consensus_queue.cc:260] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.195295 18831 ts_tablet_manager.cc:1434] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:58.201917 18246 raft_consensus.cc:1275] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Refusing update from remote peer e6e16b9214a1403293e3eeb06be25a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:58.202497 18831 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.204026 18847 consensus_queue.cc:1048] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.224642 18831 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.225840 18831 tablet_bootstrap.cc:492] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.226634 18831 ts_tablet_manager.cc:1403] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.011s
I20260709 13:19:58.229745 18831 raft_consensus.cc:359] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.231760 18831 raft_consensus.cc:740] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.232673 18831 consensus_queue.cc:260] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.235040 18831 ts_tablet_manager.cc:1434] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:58.240249 18831 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.305284 18831 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.306382 18831 tablet_bootstrap.cc:492] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.307122 18831 ts_tablet_manager.cc:1403] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.013s
I20260709 13:19:58.309842 18831 raft_consensus.cc:359] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.310592 18831 raft_consensus.cc:740] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.311506 18831 consensus_queue.cc:260] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.313769 18831 ts_tablet_manager.cc:1434] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:19:58.314697 18831 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.353716 18831 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.354779 18831 tablet_bootstrap.cc:492] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.355506 18831 ts_tablet_manager.cc:1403] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.013s
I20260709 13:19:58.358222 18831 raft_consensus.cc:359] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.358902 18831 raft_consensus.cc:740] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.359623 18831 consensus_queue.cc:260] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.364925 18831 ts_tablet_manager.cc:1434] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:58.366425 18831 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.409559 18831 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.410588 18831 tablet_bootstrap.cc:492] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.411355 18831 ts_tablet_manager.cc:1403] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.015s
I20260709 13:19:58.417899 18831 raft_consensus.cc:359] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.418479 18831 raft_consensus.cc:740] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.419268 18831 consensus_queue.cc:260] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:19:58.421659 18831 ts_tablet_manager.cc:1434] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:58.424155 18831 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.476768 18831 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.477828 18831 tablet_bootstrap.cc:492] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.478586 18831 ts_tablet_manager.cc:1403] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.006s
I20260709 13:19:58.499960 18831 raft_consensus.cc:359] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.500806 18831 raft_consensus.cc:740] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.501600 18831 consensus_queue.cc:260] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.503952 18831 ts_tablet_manager.cc:1434] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:19:58.504877 18831 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.544673 18831 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.545706 18831 tablet_bootstrap.cc:492] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.547083 18831 ts_tablet_manager.cc:1403] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.006s
I20260709 13:19:58.550463 18831 raft_consensus.cc:359] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.551200 18831 raft_consensus.cc:740] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.551972 18831 consensus_queue.cc:260] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:19:58.557677 18831 ts_tablet_manager.cc:1434] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:58.558578 18831 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.580216 18831 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.581080 18831 tablet_bootstrap.cc:492] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.581673 18831 ts_tablet_manager.cc:1403] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:19:58.583595 18831 raft_consensus.cc:359] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.584133 18831 raft_consensus.cc:740] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.584700 18831 consensus_queue.cc:260] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.586848 18831 ts_tablet_manager.cc:1434] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:58.588224 18831 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.623632 18831 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.624452 18831 tablet_bootstrap.cc:492] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.625077 18831 ts_tablet_manager.cc:1403] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.009s
I20260709 13:19:58.628011 18831 raft_consensus.cc:359] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.628721 18831 raft_consensus.cc:740] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.629417 18831 consensus_queue.cc:260] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.632673 18831 ts_tablet_manager.cc:1434] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:58.633745 18831 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.660060 18831 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.661055 18831 tablet_bootstrap.cc:492] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.661846 18831 ts_tablet_manager.cc:1403] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:19:58.664557 18831 raft_consensus.cc:359] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.665275 18831 raft_consensus.cc:740] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.665989 18831 consensus_queue.cc:260] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.668138 18831 ts_tablet_manager.cc:1434] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:58.669183 18831 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.687222 18906 raft_consensus.cc:3060] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:58.708148 18831 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.709120 18831 tablet_bootstrap.cc:492] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.709702 18831 ts_tablet_manager.cc:1403] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.009s
I20260709 13:19:58.711819 18831 raft_consensus.cc:359] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.712448 18831 raft_consensus.cc:740] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.713191 18831 consensus_queue.cc:260] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.715220 18831 ts_tablet_manager.cc:1434] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:19:58.716051 18831 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
W20260709 13:19:58.818439 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 48233.9us
I20260709 13:19:58.844934 18831 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.846041 18831 tablet_bootstrap.cc:492] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.846752 18831 ts_tablet_manager.cc:1403] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.131s	user 0.035s	sys 0.071s
I20260709 13:19:58.851265 18831 raft_consensus.cc:359] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.852088 18831 raft_consensus.cc:740] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.854274 18831 consensus_queue.cc:260] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.856781 18831 ts_tablet_manager.cc:1434] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:19:58.857684 18831 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap starting.
I20260709 13:19:58.873623 18831 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.874663 18831 tablet_bootstrap.cc:492] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Bootstrap complete.
I20260709 13:19:58.875383 18831 ts_tablet_manager.cc:1403] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:19:58.878381 18831 raft_consensus.cc:359] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.879125 18831 raft_consensus.cc:740] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.879834 18831 consensus_queue.cc:260] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:19:58.881970 18831 ts_tablet_manager.cc:1434] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 13:20:04.658143 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 64625.2us
W20260709 13:20:04.807058 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 109326us
W20260709 13:20:05.095091 18070 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 50063.2us
W20260709 13:20:05.096045 18217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38977, user_credentials={real_user=slave}} blocked reactor thread for 84100.4us
I20260709 13:20:05.378073 19037 raft_consensus.cc:493] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 830a192d6137410e8bd043588f0ed425)
I20260709 13:20:05.378638 19037 raft_consensus.cc:515] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:05.399219 19037 leader_election.cc:290] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:05.432512 18103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "830a192d6137410e8bd043588f0ed425" is_pre_election: true
I20260709 13:20:05.459851 18909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0088d5969b0d4183886e26ed2654e034" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8fdca3eaa0547d08fd840005216e2da" is_pre_election: true
I20260709 13:20:05.475435 18144 leader_election.cc:304] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:05.476323 19050 raft_consensus.cc:2749] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:06.030351 18125 debug-util.cc:398] Leaking SignalData structure 0x7b0800167b00 after lost signal to thread 8942
W20260709 13:20:06.031603 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3700 after lost signal to thread 17961
W20260709 13:20:06.032950 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08002b09a0 after lost signal to thread 18128
W20260709 13:20:06.034114 18125 debug-util.cc:398] Leaking SignalData structure 0x7b0800237700 after lost signal to thread 18202
W20260709 13:20:06.035132 18125 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6dc0 after lost signal to thread 18276
W20260709 13:20:06.036329 18125 debug-util.cc:398] Leaking SignalData structure 0x7b0800143b00 after lost signal to thread 18963
I20260709 13:20:07.910113  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:08.296720 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:08.297441 18246 raft_consensus.cc:606] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:08.299922 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "830a192d6137410e8bd043588f0ed425"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:08.300341 18246 raft_consensus.cc:606] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS 830a192d6137410e8bd043588f0ed425
I20260709 13:20:08.311020 18178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5"
dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
mode: GRACEFUL
new_leader_uuid: "23853b156a904ba6a31afa79977f3adc"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:20:08.311556 18178 raft_consensus.cc:606] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Received request to transfer leadership to TS 23853b156a904ba6a31afa79977f3adc
I20260709 13:20:08.314100 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e6e16b9214a1403293e3eeb06be25a91"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:08.314581 18246 raft_consensus.cc:606] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS e6e16b9214a1403293e3eeb06be25a91
I20260709 13:20:08.316710 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a659b113eca540428fc23a797373191e"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:08.317129 18246 raft_consensus.cc:606] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:08.319182 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:08.319599 18246 raft_consensus.cc:606] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:08.330519 18101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b"
dest_uuid: "830a192d6137410e8bd043588f0ed425"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:49130
I20260709 13:20:08.330973 18101 raft_consensus.cc:606] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:08.332147  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:20:08.333468  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:08.455154 19076 raft_consensus.cc:993] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.455689 19076 raft_consensus.cc:1081] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.457204 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37658
I20260709 13:20:08.457690 18904 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.457973 18904 raft_consensus.cc:3060] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.464496 18904 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.466400 18904 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:08.467556 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:08.467736 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c712025f0c334b2ea7f26a97e97c347b" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:08.468366 18246 raft_consensus.cc:3060] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.468407 18101 raft_consensus.cc:3055] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.468892 18101 raft_consensus.cc:740] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:20:08.469899 18101 consensus_queue.cc:260] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.471334 18101 raft_consensus.cc:3060] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.477277 18246 raft_consensus.cc:2468] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:08.479347 18828 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:08.480160 18101 raft_consensus.cc:2468] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:08.484618 19101 raft_consensus.cc:2804] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.485944 19101 raft_consensus.cc:697] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:08.487103 19101 consensus_queue.cc:237] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.501111 17927 catalog_manager.cc:5697] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 830a192d6137410e8bd043588f0ed425 (127.8.186.194) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.601293 19098 raft_consensus.cc:993] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: : Instructing follower 23853b156a904ba6a31afa79977f3adc to start an election
I20260709 13:20:08.601938 19078 raft_consensus.cc:1081] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Signalling peer 23853b156a904ba6a31afa79977f3adc to start an election
I20260709 13:20:08.603360 18246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
 from {username='slave'} at 127.0.0.1:45630
I20260709 13:20:08.603837 18246 raft_consensus.cc:493] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.604159 18246 raft_consensus.cc:3060] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.610353 18246 raft_consensus.cc:515] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.613013 18246 leader_election.cc:290] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:20:08.614917 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:08.615638 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481e9aa796fa47f5b94531ca8587c3c5" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:08.616068 18178 raft_consensus.cc:3055] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.616454 18178 raft_consensus.cc:740] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:08.621418 19095 raft_consensus.cc:993] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.622040 19095 raft_consensus.cc:1081] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.625168 18908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a659b113eca540428fc23a797373191e"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:08.629345 18908 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.629786 18908 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:08.624148 18101 raft_consensus.cc:3060] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.630692 19092 raft_consensus.cc:993] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e6e16b9214a1403293e3eeb06be25a91 to start an election
I20260709 13:20:08.631415 19092 raft_consensus.cc:1081] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer e6e16b9214a1403293e3eeb06be25a91 to start an election
I20260709 13:20:08.628552 19094 raft_consensus.cc:993] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: : Instructing follower 830a192d6137410e8bd043588f0ed425 to start an election
I20260709 13:20:08.623854 18178 consensus_queue.cc:260] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.640269 18176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7"
dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
 from {username='slave'} at 127.0.0.1:32914
I20260709 13:20:08.640913 18176 raft_consensus.cc:493] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.641304 18176 raft_consensus.cc:3060] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.643863 18101 raft_consensus.cc:2468] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:20:08.645941 18908 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.648270 18217 leader_election.cc:304] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:20:08.649845 19095 raft_consensus.cc:2804] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.650331 19095 raft_consensus.cc:697] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:08.650983 18176 raft_consensus.cc:515] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.651212 19095 consensus_queue.cc:237] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.653092 18176 leader_election.cc:290] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:20:08.653980 18178 raft_consensus.cc:3060] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.654040 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:08.654075 18101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:08.654893 18246 raft_consensus.cc:3055] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:08.654984 18101 raft_consensus.cc:3060] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.655258 18246 raft_consensus.cc:740] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:08.657451 18246 consensus_queue.cc:260] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.660411 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a659b113eca540428fc23a797373191e" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:08.638339 19082 raft_consensus.cc:1081] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer 830a192d6137410e8bd043588f0ed425 to start an election
I20260709 13:20:08.661222 18104 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:08.660892 18246 raft_consensus.cc:3060] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:08.657899 18908 leader_election.cc:290] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 3 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:08.674005 18246 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 3.
I20260709 13:20:08.685437 18251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b19233b689b4661a029f09f617dd4b7" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:08.686199 18251 raft_consensus.cc:3055] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.686606 18251 raft_consensus.cc:740] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:08.689719 18828 leader_election.cc:304] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:08.690887 19101 raft_consensus.cc:2804] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:08.691438 19101 raft_consensus.cc:697] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 3 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:08.692476 19101 consensus_queue.cc:237] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.710222 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b"
dest_uuid: "830a192d6137410e8bd043588f0ed425"
 from {username='slave'} at 127.0.0.1:47860
I20260709 13:20:08.711081 18099 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.711467 18099 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.735246 19083 raft_consensus.cc:993] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.735791 19083 raft_consensus.cc:1081] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.738489 18101 raft_consensus.cc:2468] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:20:08.734541 18104 raft_consensus.cc:2468] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 3.
I20260709 13:20:08.741216 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:08.742014 18904 raft_consensus.cc:493] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.742424 18904 raft_consensus.cc:3060] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.742564 18143 leader_election.cc:304] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:20:08.743417 19078 raft_consensus.cc:2804] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.743911 19078 raft_consensus.cc:697] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:08.744800 19078 consensus_queue.cc:237] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.735394 18251 consensus_queue.cc:260] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.767483 17927 catalog_manager.cc:5697] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.779119 17923 catalog_manager.cc:5697] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 2 to 3, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 3 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.806659 18904 raft_consensus.cc:515] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.808964 19092 raft_consensus.cc:993] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.810220 19092 raft_consensus.cc:1081] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:08.813414 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:08.814231 18248 raft_consensus.cc:3055] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.814644 18248 raft_consensus.cc:740] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:08.815626 18913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:08.815611 18248 consensus_queue.cc:260] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.816439 18913 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.816859 18248 raft_consensus.cc:3060] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.817118 18913 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.820312 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b44da0a6da3147d694f8909e41b70aa8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:08.821048 18097 raft_consensus.cc:3060] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.825129 18251 raft_consensus.cc:3060] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:08.833503 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 64357.3us
I20260709 13:20:08.834391 18248 raft_consensus.cc:2468] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:08.838578 18828 leader_election.cc:304] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:08.839576 19101 raft_consensus.cc:2804] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.840193 19101 raft_consensus.cc:697] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:08.841153 19101 consensus_queue.cc:237] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:08.839733 18251 raft_consensus.cc:2468] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:20:08.814225 18904 leader_election.cc:290] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:08.835629 18913 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:08.862396 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:08.863067 18173 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.868271 18913 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:20:08.869927 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:08.870869 18248 raft_consensus.cc:3055] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.871176 18248 raft_consensus.cc:740] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:08.872012 18248 consensus_queue.cc:260] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:08.873023 18248 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.872778 18099 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.873255 17927 catalog_manager.cc:5697] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.879015 18248 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:08.880118 18178 raft_consensus.cc:2468] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:20:08.880398 18828 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:08.883713 19101 raft_consensus.cc:2804] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.884251 19101 raft_consensus.cc:697] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:08.884584 17923 catalog_manager.cc:5697] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.886813 18097 raft_consensus.cc:2468] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:08.892117 18104 raft_consensus.cc:1240] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Rejecting Update request from peer 23853b156a904ba6a31afa79977f3adc for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:08.882651 18173 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:08.885203 19101 consensus_queue.cc:237] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:08.884589 18099 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:20:08.898831 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:08.911772 18248 raft_consensus.cc:3055] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.912192 18248 raft_consensus.cc:740] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:08.913228 18248 consensus_queue.cc:260] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.913551 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "830a192d6137410e8bd043588f0ed425" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:08.914258 18178 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.914692 18248 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.917228 17923 catalog_manager.cc:5697] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.922237 18248 raft_consensus.cc:2468] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 2.
I20260709 13:20:08.922963 18178 raft_consensus.cc:2468] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 830a192d6137410e8bd043588f0ed425 in term 2.
I20260709 13:20:08.923579 18070 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:20:08.924494 19077 raft_consensus.cc:2804] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:08.924939 19077 raft_consensus.cc:697] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Becoming Leader. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:20:08.925853 19077 consensus_queue.cc:237] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:08.935530 17923 catalog_manager.cc:5697] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to 830a192d6137410e8bd043588f0ed425 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "830a192d6137410e8bd043588f0ed425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.966171 18248 raft_consensus.cc:1275] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:08.967528 19101 consensus_queue.cc:1048] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:08.983193 18099 raft_consensus.cc:1275] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:08.985461 19101 consensus_queue.cc:1048] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.073282 18248 raft_consensus.cc:1275] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:09.074779 19101 consensus_queue.cc:1048] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:09.085171 18097 raft_consensus.cc:1275] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:09.088124 19119 consensus_queue.cc:1048] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:09.140345 18099 raft_consensus.cc:1275] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.142159 19092 consensus_queue.cc:1048] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:09.157310 18958 debug-util.cc:398] Leaking SignalData structure 0x7b0800237b60 after lost signal to thread 8942
W20260709 13:20:09.158776 18958 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2920 after lost signal to thread 17961
W20260709 13:20:09.160449 18958 debug-util.cc:398] Leaking SignalData structure 0x7b0800392ae0 after lost signal to thread 18128
W20260709 13:20:09.161844 18958 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8bc0 after lost signal to thread 18202
W20260709 13:20:09.163408 18958 debug-util.cc:398] Leaking SignalData structure 0x7b080026e440 after lost signal to thread 18276
W20260709 13:20:09.172617 18958 debug-util.cc:398] Leaking SignalData structure 0x7b0800379020 after lost signal to thread 18963
I20260709 13:20:09.192246 18178 raft_consensus.cc:1275] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.195756 19082 consensus_queue.cc:1048] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.284700 18248 raft_consensus.cc:1275] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e6e16b9214a1403293e3eeb06be25a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.286091 19078 consensus_queue.cc:1048] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.297253 18099 raft_consensus.cc:1275] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e6e16b9214a1403293e3eeb06be25a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.300864 19112 consensus_queue.cc:1048] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:09.312417 18249 raft_consensus.cc:1275] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.313814 19077 consensus_queue.cc:1048] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.334435  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:09.356184 18173 raft_consensus.cc:1275] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 830a192d6137410e8bd043588f0ed425: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.359853 19087 consensus_queue.cc:1048] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.361392 18173 raft_consensus.cc:1275] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.362928 19119 consensus_queue.cc:1048] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.369167 18246 raft_consensus.cc:1275] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.372445 18099 raft_consensus.cc:1275] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.374877 19102 consensus_queue.cc:1048] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.395510 19101 consensus_queue.cc:1048] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:09.488227 18218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 58475.6us
I20260709 13:20:09.510876 18249 raft_consensus.cc:1275] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.532282 19101 consensus_queue.cc:1048] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.542037  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:09.604879 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:09.605500 18246 raft_consensus.cc:606] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:09.611532 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb"
dest_uuid: "830a192d6137410e8bd043588f0ed425"
mode: GRACEFUL
new_leader_uuid: "23853b156a904ba6a31afa79977f3adc"
 from {username='slave'} at 127.0.0.1:49130
I20260709 13:20:09.612322 18097 raft_consensus.cc:606] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Received request to transfer leadership to TS 23853b156a904ba6a31afa79977f3adc
I20260709 13:20:09.618800 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5"
dest_uuid: "830a192d6137410e8bd043588f0ed425"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:49130
I20260709 13:20:09.619527 18097 raft_consensus.cc:606] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:09.639473 18176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479841006f754b57b85acab5b257c912"
dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:20:09.640128 18176 raft_consensus.cc:606] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:09.655629 19087 raft_consensus.cc:993] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:09.656210 19087 raft_consensus.cc:1081] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:09.660615 18906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37658
I20260709 13:20:09.661394 18906 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.661830 18906 raft_consensus.cc:3060] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.671090 18906 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:09.673310 18906 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:09.673979 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:09.675467 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c7cf1efa6d4c26b013079c0cfeb2c5" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:09.678891 18097 raft_consensus.cc:3055] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.679211 18097 raft_consensus.cc:740] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:20:09.680245 18097 consensus_queue.cc:260] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:09.683616 18097 raft_consensus.cc:3060] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.678427 18246 raft_consensus.cc:3060] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.686287 18249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:09.686993 18249 raft_consensus.cc:606] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:09.699119 18249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:09.699788 18249 raft_consensus.cc:606] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:09.702483 19087 raft_consensus.cc:993] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: : Instructing follower 23853b156a904ba6a31afa79977f3adc to start an election
I20260709 13:20:09.703034 19087 raft_consensus.cc:1081] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Signalling peer 23853b156a904ba6a31afa79977f3adc to start an election
I20260709 13:20:09.703979  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:09.705185 18249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:20:09.705839 18249 raft_consensus.cc:493] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.705969  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:09.710857 18097 raft_consensus.cc:2468] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:09.713673 18246 raft_consensus.cc:2468] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:09.716238 18827 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:09.717669 19101 raft_consensus.cc:2804] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.718170 19101 raft_consensus.cc:697] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:09.719053 19101 consensus_queue.cc:237] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:09.706209 18249 raft_consensus.cc:3060] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.759960 18249 raft_consensus.cc:515] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:09.763108 17924 catalog_manager.cc:5697] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 830a192d6137410e8bd043588f0ed425 (127.8.186.194) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.765779 18249 leader_election.cc:290] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:20:09.767428 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:09.768291 18099 raft_consensus.cc:3055] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.768640 18099 raft_consensus.cc:740] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:20:09.769726 18099 consensus_queue.cc:260] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:09.771358 18099 raft_consensus.cc:3060] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.772188 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db0037842d34ab783fcba2d367d98eb" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:09.772915 18178 raft_consensus.cc:3060] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.801343 18099 raft_consensus.cc:2468] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
I20260709 13:20:09.803030 18217 leader_election.cc:304] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:20:09.803953 19136 raft_consensus.cc:2804] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.804438 19136 raft_consensus.cc:697] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:09.805207 19136 consensus_queue.cc:237] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:09.807569 18178 raft_consensus.cc:2468] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 2.
W20260709 13:20:09.811467 18144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:41391, user_credentials={real_user=slave}} blocked reactor thread for 62394.2us
I20260709 13:20:09.838006 19082 raft_consensus.cc:993] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:09.838557 19082 raft_consensus.cc:1081] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:09.840622 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:09.841243 18904 raft_consensus.cc:493] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.841619 18904 raft_consensus.cc:3060] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.850111 18904 raft_consensus.cc:515] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:09.853363 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:09.854041 18249 raft_consensus.cc:3055] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.854362 18249 raft_consensus.cc:740] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:09.855245 18249 consensus_queue.cc:260] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:09.856514 18249 raft_consensus.cc:3060] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.858398 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15af0e21890f4f18b1e124ce6ffdb689" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:09.859035 18099 raft_consensus.cc:3060] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.866750 18249 raft_consensus.cc:2468] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:09.856426 17923 catalog_manager.cc:5697] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 1 to 2, leader changed from 830a192d6137410e8bd043588f0ed425 (127.8.186.194) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 2 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.873319 18099 raft_consensus.cc:2468] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:09.874652 18827 leader_election.cc:304] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:09.875492 18904 leader_election.cc:290] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:09.875501 19101 raft_consensus.cc:2804] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.876348 19101 raft_consensus.cc:697] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:09.877385 19101 consensus_queue.cc:237] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:09.891872 17923 catalog_manager.cc:5697] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.979149 19095 raft_consensus.cc:993] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:09.979772 19136 raft_consensus.cc:1081] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:09.981319 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:09.981937 18904 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.982314 18904 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:09.992183 18904 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:09.995431 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:09.995513 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:09.996760 18178 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:09.996922 18249 raft_consensus.cc:3055] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:09.997377 18249 raft_consensus.cc:740] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:09.998205 18249 consensus_queue.cc:260] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:09.999370 18249 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.002630 18178 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 3.
I20260709 13:20:10.003978 18825 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:10.004720 19101 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:10.005163 19101 raft_consensus.cc:697] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 3 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:09.996201 18904 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 3 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:20:10.005899 19101 consensus_queue.cc:237] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:10.010473 18249 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 3.
I20260709 13:20:10.019435 17923 catalog_manager.cc:5697] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 2 to 3, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 3 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.036485 19140 raft_consensus.cc:993] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:10.037242 19096 raft_consensus.cc:1081] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:10.038837 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "479841006f754b57b85acab5b257c912"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:20:10.039359 18904 raft_consensus.cc:493] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.039647 18904 raft_consensus.cc:3060] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:10.045730 18904 raft_consensus.cc:515] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:10.047442 18904 leader_election.cc:290] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:20:10.048478 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:10.048537 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:10.049337 18173 raft_consensus.cc:3055] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:10.049403 18249 raft_consensus.cc:3060] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:10.049832 18173 raft_consensus.cc:740] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:10.050712 18173 consensus_queue.cc:260] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:10.052497 18173 raft_consensus.cc:3060] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:10.057638 18249 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:10.059005 18828 leader_election.cc:304] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:10.059947 19101 raft_consensus.cc:2804] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:10.060416 19101 raft_consensus.cc:697] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:10.061344 18173 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:10.061291 19101 consensus_queue.cc:237] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:10.084648 17923 catalog_manager.cc:5697] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.183645 19092 raft_consensus.cc:993] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:10.184249 19092 raft_consensus.cc:1081] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:10.185848 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:10.186399 18904 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.186766 18904 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.194133 18904 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:10.196035 18904 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 3 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:10.197014 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:10.197765 18249 raft_consensus.cc:3055] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:10.197892 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a5a37e724480ebc62f12966c08386" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:10.199193 18099 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.198190 18249 raft_consensus.cc:740] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:10.201040 18249 consensus_queue.cc:260] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:10.202347 18249 raft_consensus.cc:3060] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.212203 18249 raft_consensus.cc:2468] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 3.
I20260709 13:20:10.213409 18828 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:10.214946 18099 raft_consensus.cc:2468] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 3.
I20260709 13:20:10.216765 19101 raft_consensus.cc:2804] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:10.217406 19101 raft_consensus.cc:697] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 3 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:10.218333 19101 consensus_queue.cc:237] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:10.241367 17923 catalog_manager.cc:5697] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 2 to 3, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 3 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.245396 18249 raft_consensus.cc:1275] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.248718 19101 consensus_queue.cc:1048] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.288004 18099 raft_consensus.cc:1275] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.296819 19092 consensus_queue.cc:1048] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.299017 18099 raft_consensus.cc:1275] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.302459 19119 consensus_queue.cc:1048] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.324455 18100 raft_consensus.cc:1275] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.326467 19119 consensus_queue.cc:1048] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:20:10.408329 18173 raft_consensus.cc:1275] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.410151 18249 raft_consensus.cc:1275] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.413932 19102 consensus_queue.cc:1048] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.428838 18246 raft_consensus.cc:1275] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:10.430828 19102 consensus_queue.cc:1048] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:10.444769 19095 consensus_queue.cc:1048] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.450831 18173 raft_consensus.cc:1275] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:10.452764 19101 consensus_queue.cc:1048] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:10.599460 18248 raft_consensus.cc:1275] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.601254 19119 consensus_queue.cc:1048] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.647869 18178 raft_consensus.cc:1275] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.649768 19101 consensus_queue.cc:1048] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.707299  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:10.712073 18248 raft_consensus.cc:1275] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:10.713711 19101 consensus_queue.cc:1048] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:10.726225 18097 raft_consensus.cc:1275] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:10.739446 19102 consensus_queue.cc:1048] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:10.777737  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:10.833012 18099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036"
dest_uuid: "830a192d6137410e8bd043588f0ed425"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:49130
I20260709 13:20:10.833575 18099 raft_consensus.cc:606] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:10.836925 18099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b"
dest_uuid: "830a192d6137410e8bd043588f0ed425"
mode: GRACEFUL
new_leader_uuid: "23853b156a904ba6a31afa79977f3adc"
 from {username='slave'} at 127.0.0.1:49130
I20260709 13:20:10.837522 18099 raft_consensus.cc:606] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Received request to transfer leadership to TS 23853b156a904ba6a31afa79977f3adc
I20260709 13:20:10.841852 18173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167"
dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:20:10.842465 18173 raft_consensus.cc:606] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:10.844843 18173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8"
dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:20:10.845257 18173 raft_consensus.cc:606] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:10.847448 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:10.847903 18246 raft_consensus.cc:606] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:10.849061  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:10.850493  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:10.933051 19077 raft_consensus.cc:993] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: : Instructing follower 23853b156a904ba6a31afa79977f3adc to start an election
I20260709 13:20:10.934073 19139 raft_consensus.cc:1081] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Signalling peer 23853b156a904ba6a31afa79977f3adc to start an election
I20260709 13:20:10.939296 18246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
 from {username='slave'} at 127.0.0.1:51714
I20260709 13:20:10.940243 18246 raft_consensus.cc:493] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.940662 18246 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.954432 18246 raft_consensus.cc:515] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:10.956416 18246 leader_election.cc:290] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:20:10.956957 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:10.957635 18099 raft_consensus.cc:3055] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:10.957571 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45716870c722497db3b6cad734aa0a5b" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:10.958099 18099 raft_consensus.cc:740] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:20:10.958338 18173 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.958879 18099 consensus_queue.cc:260] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:10.960108 18099 raft_consensus.cc:3060] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:10.965462 18173 raft_consensus.cc:2468] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 3.
I20260709 13:20:10.967684 18099 raft_consensus.cc:2468] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23853b156a904ba6a31afa79977f3adc in term 3.
I20260709 13:20:10.969146 18217 leader_election.cc:304] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, 830a192d6137410e8bd043588f0ed425; no voters: 
I20260709 13:20:10.969973 19136 raft_consensus.cc:2804] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:10.970435 19136 raft_consensus.cc:697] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 3 LEADER]: Becoming Leader. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:10.971225 19136 consensus_queue.cc:237] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } }
I20260709 13:20:10.989643 17923 catalog_manager.cc:5697] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc reported cstate change: term changed from 2 to 3, leader changed from 830a192d6137410e8bd043588f0ed425 (127.8.186.194) to 23853b156a904ba6a31afa79977f3adc (127.8.186.196). New cstate: current_term: 3 leader_uuid: "23853b156a904ba6a31afa79977f3adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.012619 19140 raft_consensus.cc:993] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.013343 19140 raft_consensus.cc:1081] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.015431 18908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:20:11.016085 18908 raft_consensus.cc:493] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.016463 18908 raft_consensus.cc:3060] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.023788 18908 raft_consensus.cc:515] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:11.025497 18908 leader_election.cc:290] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:20:11.026173 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:11.026836 18099 raft_consensus.cc:3060] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.026538 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597550505a4d4924b3edf943e2dd4167" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:11.028230 18173 raft_consensus.cc:3055] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.028488 18173 raft_consensus.cc:740] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:11.029235 18173 consensus_queue.cc:260] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:11.030412 18173 raft_consensus.cc:3060] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.034359 18099 raft_consensus.cc:2468] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.036080 18827 leader_election.cc:304] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:11.037002 19102 raft_consensus.cc:2804] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.163671 19102 raft_consensus.cc:697] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:11.164813 19102 consensus_queue.cc:237] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:11.165503 18173 raft_consensus.cc:2468] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.193337 17923 catalog_manager.cc:5697] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.218283 19159 raft_consensus.cc:993] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.219731 19175 raft_consensus.cc:1081] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.221618 18908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:20:11.222302 18908 raft_consensus.cc:493] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.222658 18908 raft_consensus.cc:3060] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.230425 18908 raft_consensus.cc:515] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:11.232417 18908 leader_election.cc:290] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977), e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697)
I20260709 13:20:11.237053 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:11.237615 18097 raft_consensus.cc:3060] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.244753 18097 raft_consensus.cc:2468] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.247203 18827 leader_election.cc:304] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:11.248075 19177 raft_consensus.cc:2804] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.249060 19177 raft_consensus.cc:697] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:11.265412 19177 consensus_queue.cc:237] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:11.281625 19136 raft_consensus.cc:993] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.283690 19136 raft_consensus.cc:1081] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.285526 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:11.286113 18904 raft_consensus.cc:493] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.286441 18904 raft_consensus.cc:3060] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.293110 18178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72264469fd94db8b68aa30adcacd8c8" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:11.293766 18178 raft_consensus.cc:3055] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.294054 18178 raft_consensus.cc:740] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:11.294843 18178 consensus_queue.cc:260] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:11.296093 18178 raft_consensus.cc:3060] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.301982 18904 raft_consensus.cc:515] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:11.309281 18178 raft_consensus.cc:2468] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
W20260709 13:20:11.315488 18215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 49685us
I20260709 13:20:11.316893 19168 raft_consensus.cc:993] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.317497 19168 raft_consensus.cc:1081] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:11.320596 18913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37658
I20260709 13:20:11.321156 18913 raft_consensus.cc:493] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.321492 18913 raft_consensus.cc:3060] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.325191 18904 leader_election.cc:290] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:11.323640 17923 catalog_manager.cc:5697] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.328419 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:11.329051 18248 raft_consensus.cc:3055] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.329380 18248 raft_consensus.cc:740] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:11.329485 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f969e2d5e7334a5d9e4d21fe84cd0efb" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:11.330084 18097 raft_consensus.cc:3060] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.330174 18248 consensus_queue.cc:260] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:11.331472 18248 raft_consensus.cc:3060] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.328631 18913 raft_consensus.cc:515] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:11.338788 18097 raft_consensus.cc:2468] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.340068 18827 leader_election.cc:304] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:11.341212 19177 raft_consensus.cc:2804] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.341617 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:11.342233 18246 raft_consensus.cc:3060] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.342123 19177 raft_consensus.cc:697] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:11.343237 18913 leader_election.cc:290] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:11.344327 18104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408437b0be3b484dae4ecaed1badf036" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "830a192d6137410e8bd043588f0ed425"
I20260709 13:20:11.344298 19177 consensus_queue.cc:237] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:11.345134 18104 raft_consensus.cc:3055] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.348960 18104 raft_consensus.cc:740] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 830a192d6137410e8bd043588f0ed425, State: Running, Role: LEADER
I20260709 13:20:11.352371 18104 consensus_queue.cc:260] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:11.353559 18104 raft_consensus.cc:3060] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:11.357489 18067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 90597.3us
I20260709 13:20:11.362875 18104 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.363339 18248 raft_consensus.cc:2468] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.364122 18827 leader_election.cc:304] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:11.365113 19176 raft_consensus.cc:2804] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.365695 19176 raft_consensus.cc:697] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:11.366649 19176 consensus_queue.cc:237] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:11.367111 18246 raft_consensus.cc:2468] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:11.378124 17923 catalog_manager.cc:5697] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.405279 17923 catalog_manager.cc:5697] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 830a192d6137410e8bd043588f0ed425 (127.8.186.194) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.417536 18099 raft_consensus.cc:1275] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:11.419275 19187 consensus_queue.cc:1048] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:11.421818 18173 raft_consensus.cc:1275] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Refusing update from remote peer 23853b156a904ba6a31afa79977f3adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:11.423530 19187 consensus_queue.cc:1048] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:11.641377 18177 raft_consensus.cc:1275] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.643105 19177 consensus_queue.cc:1048] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.673924 18104 raft_consensus.cc:1275] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.675204 19177 consensus_queue.cc:1048] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.762740 18177 raft_consensus.cc:1275] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.763964 19177 consensus_queue.cc:1048] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.843465 18246 raft_consensus.cc:1275] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.847884 19176 consensus_queue.cc:1048] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.851447  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:11.899667 18099 raft_consensus.cc:1275] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.901295 19177 consensus_queue.cc:1048] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.902299 18104 raft_consensus.cc:1275] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.939076 18104 raft_consensus.cc:1275] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.947927 19199 consensus_queue.cc:1048] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:20:11.934296 18828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 88354.8us
I20260709 13:20:11.948060 19102 consensus_queue.cc:1048] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:20:11.998719 18828 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.196:35299, user_credentials={real_user=slave}} blocked reactor thread for 44995.8us
I20260709 13:20:12.003018 18246 raft_consensus.cc:1275] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:12.005223 18825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:37697, user_credentials={real_user=slave}} blocked reactor thread for 56947.7us
I20260709 13:20:12.007104 19102 consensus_queue.cc:1048] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:20:12.041831  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.112203 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0"
dest_uuid: "23853b156a904ba6a31afa79977f3adc"
mode: GRACEFUL
new_leader_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:32830
I20260709 13:20:12.112846 18246 raft_consensus.cc:606] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Received request to transfer leadership to TS e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:12.114387  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:12.115703  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:12.175197 19156 raft_consensus.cc:993] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: : Instructing follower e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:12.175838 19156 raft_consensus.cc:1081] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Signalling peer e8fdca3eaa0547d08fd840005216e2da to start an election
I20260709 13:20:12.177917 18904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0"
dest_uuid: "e8fdca3eaa0547d08fd840005216e2da"
 from {username='slave'} at 127.0.0.1:37670
I20260709 13:20:12.178483 18904 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.178795 18904 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.186107 18904 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:12.189064 18904 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Requested vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299)
I20260709 13:20:12.189580 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:12.189328 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e8fdca3eaa0547d08fd840005216e2da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6e16b9214a1403293e3eeb06be25a91"
I20260709 13:20:12.190169 18248 raft_consensus.cc:3055] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.190395 18177 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.190538 18248 raft_consensus.cc:740] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23853b156a904ba6a31afa79977f3adc, State: Running, Role: LEADER
I20260709 13:20:12.191473 18248 consensus_queue.cc:260] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:12.192659 18248 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.199282 18248 raft_consensus.cc:2468] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:12.200287 18828 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e8fdca3eaa0547d08fd840005216e2da; no voters: 
I20260709 13:20:12.201256 19199 raft_consensus.cc:2804] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:12.201759 19199 raft_consensus.cc:697] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Becoming Leader. State: Replica: e8fdca3eaa0547d08fd840005216e2da, State: Running, Role: LEADER
I20260709 13:20:12.202659 19199 consensus_queue.cc:237] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:12.204941 18177 raft_consensus.cc:2468] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8fdca3eaa0547d08fd840005216e2da in term 2.
I20260709 13:20:12.219009 17925 catalog_manager.cc:5697] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da reported cstate change: term changed from 1 to 2, leader changed from 23853b156a904ba6a31afa79977f3adc (127.8.186.196) to e8fdca3eaa0547d08fd840005216e2da (127.8.186.193). New cstate: current_term: 2 leader_uuid: "e8fdca3eaa0547d08fd840005216e2da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.742282 18246 raft_consensus.cc:1275] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.743453 19199 consensus_queue.cc:1048] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:12.802091 18177 raft_consensus.cc:1275] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Refusing update from remote peer e8fdca3eaa0547d08fd840005216e2da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.806454 19176 consensus_queue.cc:1048] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.116716  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.158413  8939 tablet_server.cc:179] TabletServer@127.8.186.193:41391 shutting down...
W20260709 13:20:13.179128 18218 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 257 similar messages]
W20260709 13:20:13.201900 18070 consensus_peers.cc:597] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.202669 18218 consensus_peers.cc:597] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.205336 18218 consensus_peers.cc:597] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.206033 18144 consensus_peers.cc:597] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.208621 18144 consensus_peers.cc:597] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.208894 18070 consensus_peers.cc:597] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.215891  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:20:13.218164 18070 consensus_peers.cc:597] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.218918  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.219983  8939 raft_consensus.cc:2243] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.220587  8939 raft_consensus.cc:2272] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.223424  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.224462  8939 raft_consensus.cc:2243] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.225039  8939 raft_consensus.cc:2272] T 2891e8255e0b4398a034d1bc7f353332 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.229012  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.229969  8939 raft_consensus.cc:2243] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.230525  8939 raft_consensus.cc:2272] T 0918ff57517a4193add2df7b454631f8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.232666 18144 consensus_peers.cc:597] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.233654  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.234695  8939 raft_consensus.cc:2243] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.235227  8939 raft_consensus.cc:2272] T 98540bdb13d84727be4be8cd6b851140 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.236682 18070 consensus_peers.cc:597] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.238219  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.239394  8939 raft_consensus.cc:2243] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.240454  8939 raft_consensus.cc:2272] T 597550505a4d4924b3edf943e2dd4167 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.244554  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.245265  8939 raft_consensus.cc:2243] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.246284  8939 raft_consensus.cc:2272] T a010bb50f906431fa93244db273529cb P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.249717  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.250669  8939 raft_consensus.cc:2243] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.251731  8939 raft_consensus.cc:2272] T 15af0e21890f4f18b1e124ce6ffdb689 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.254374  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.255236  8939 raft_consensus.cc:2243] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.255851  8939 raft_consensus.cc:2272] T 8a20b2a9b6fc418eaebac50b17ddee1b P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.259188  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.260093  8939 raft_consensus.cc:2243] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.261061  8939 raft_consensus.cc:2272] T b44da0a6da3147d694f8909e41b70aa8 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.263770  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.264531  8939 raft_consensus.cc:2243] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.265034  8939 raft_consensus.cc:2272] T 227d050c5ac14865954c8c8dce1cfe86 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.268076  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.269054  8939 raft_consensus.cc:2243] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.269621  8939 raft_consensus.cc:2272] T 47fc415ccc6740a7ab53f700cb2a82c8 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.272480  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.273278  8939 raft_consensus.cc:2243] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.273795  8939 raft_consensus.cc:2272] T 802d97ba13fe467c87385eae6fe54a02 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.276227  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.276928  8939 raft_consensus.cc:2243] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.277747  8939 raft_consensus.cc:2272] T c712025f0c334b2ea7f26a97e97c347b P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.280239  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.280891  8939 raft_consensus.cc:2243] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.281334  8939 raft_consensus.cc:2272] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.283982  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.284636  8939 raft_consensus.cc:2243] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.285051  8939 raft_consensus.cc:2272] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.288172  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.288944  8939 raft_consensus.cc:2243] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.289500  8939 raft_consensus.cc:2272] T 4511aae3d2a140fc8941166745d82fe3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.292333  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.293046  8939 raft_consensus.cc:2243] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:13.293186 18070 consensus_peers.cc:597] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.293674  8939 raft_consensus.cc:2272] T 0088d5969b0d4183886e26ed2654e034 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.296311  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.296954  8939 raft_consensus.cc:2243] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.298141  8939 raft_consensus.cc:2272] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.301281  8939 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:13.301985 18070 consensus_peers.cc:597] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.302099  8939 raft_consensus.cc:2243] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.302897  8939 raft_consensus.cc:2272] T 549b6d4d69b644b7a7c5ec7b137eef7f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.306336  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.307188  8939 raft_consensus.cc:2243] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.307719  8939 raft_consensus.cc:2272] T 26ca0113f4654093a3524c8198661196 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.311064  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.311977  8939 raft_consensus.cc:2243] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.312512  8939 raft_consensus.cc:2272] T 9163e7694071456bb2b68a6858e44443 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.315836  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.316665  8939 raft_consensus.cc:2243] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.317243  8939 raft_consensus.cc:2272] T 1ae0e2b2834f4fc0bd95acb2401862ed P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.319396 18070 consensus_peers.cc:597] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.320194  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.321566  8939 raft_consensus.cc:2243] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.322196  8939 raft_consensus.cc:2272] T 70fc24e67dd34b168bc7110e7b8bdfa3 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.323452 18070 consensus_peers.cc:597] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.325434  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.326380  8939 raft_consensus.cc:2243] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.326932  8939 raft_consensus.cc:2272] T 698a6a9993674b4eae04bad2efa5485f P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.329977  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.331027  8939 raft_consensus.cc:2243] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:20:13.331717 18218 consensus_peers.cc:597] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.332116  8939 raft_consensus.cc:2272] T 479841006f754b57b85acab5b257c912 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.335173  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.336076  8939 raft_consensus.cc:2243] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.336591  8939 raft_consensus.cc:2272] T f3de96e0eff148aa92357ccf945a3a9d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.339629  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.340550  8939 raft_consensus.cc:2243] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.341650  8939 raft_consensus.cc:2272] T 168fed5754ae48c19312ea4a2fa2c5ed P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.344739  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.345592  8939 raft_consensus.cc:2243] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.346100  8939 raft_consensus.cc:2272] T 926766f358784880a482cc7ea6052052 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.349104 18218 consensus_peers.cc:597] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.349098  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.350164  8939 raft_consensus.cc:2243] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.350782  8939 raft_consensus.cc:2272] T 675aa5689d904979a3aaa90534d93385 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.354023  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.354864  8939 raft_consensus.cc:2243] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.355345  8939 raft_consensus.cc:2272] T 27094133c5bd4d54ae86e99d83396dec P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.358230  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.358940  8939 raft_consensus.cc:2243] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.359477  8939 raft_consensus.cc:2272] T 35f2c770ec624cb48eb6dc2e7007437d P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.362294  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.363313  8939 raft_consensus.cc:2243] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.363904  8939 raft_consensus.cc:2272] T c38e95faa660491da0ac409cbe606465 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.367048  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.367925  8939 raft_consensus.cc:2243] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.368547  8939 raft_consensus.cc:2272] T 3879a0395b8c47ee82b8d483717aacd7 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.371256  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.372015  8939 raft_consensus.cc:2243] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.372501  8939 raft_consensus.cc:2272] T 55a427d8aa884b3f98202c983c1292ab P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.374899 18144 consensus_peers.cc:597] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.375370  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.376286  8939 raft_consensus.cc:2243] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.377328  8939 raft_consensus.cc:2272] T f969e2d5e7334a5d9e4d21fe84cd0efb P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.380473  8939 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:13.381011 18144 consensus_peers.cc:597] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.381248  8939 raft_consensus.cc:2243] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.381901  8939 raft_consensus.cc:2272] T a1412fa1b14f40fea87fb6a4cf76931d P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.384810  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.385536  8939 raft_consensus.cc:2243] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.386089  8939 raft_consensus.cc:2272] T 5ec6c104c96c43e5848ec45b8cf9c36d P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.388803  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.389493  8939 raft_consensus.cc:2243] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.390512  8939 raft_consensus.cc:2272] T f13a5a37e724480ebc62f12966c08386 P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.393481  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.394234  8939 raft_consensus.cc:2243] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.394761  8939 raft_consensus.cc:2272] T 2f57aae4fb06403aaac8a835763ff266 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.397716  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.398428  8939 raft_consensus.cc:2243] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.399421  8939 raft_consensus.cc:2272] T a659b113eca540428fc23a797373191e P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.402305  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.402984  8939 raft_consensus.cc:2243] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.403975  8939 raft_consensus.cc:2272] T f72264469fd94db8b68aa30adcacd8c8 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.406631  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.407310  8939 raft_consensus.cc:2243] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.408298  8939 raft_consensus.cc:2272] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.411051  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.411778  8939 raft_consensus.cc:2243] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.412801  8939 raft_consensus.cc:2272] T 951bc38e637242429f4d8415582fa5dc P e8fdca3eaa0547d08fd840005216e2da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:13.415711  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.416409  8939 raft_consensus.cc:2243] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:13.417393  8939 raft_consensus.cc:2272] T 408437b0be3b484dae4ecaed1badf036 P e8fdca3eaa0547d08fd840005216e2da [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.418133 18070 consensus_peers.cc:597] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:13.420324  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:13.421066  8939 raft_consensus.cc:2243] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:13.421540  8939 raft_consensus.cc:2272] T 0e90ea9c973f4fcdbbd047a3346e4639 P e8fdca3eaa0547d08fd840005216e2da [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:13.456210 18218 consensus_peers.cc:597] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.466771 18144 consensus_peers.cc:597] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.492972 18070 consensus_peers.cc:597] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.501134 18070 consensus_peers.cc:597] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.530068 18070 consensus_peers.cc:597] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.557935 18218 consensus_peers.cc:597] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.561512 18144 consensus_peers.cc:597] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.577942 18218 consensus_peers.cc:597] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.579879 18144 consensus_peers.cc:597] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.617014 18070 consensus_peers.cc:597] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.654975 18218 consensus_peers.cc:597] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.711154 18144 consensus_peers.cc:597] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:13.716104 18218 consensus_peers.cc:597] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc -> Peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Couldn't send request to peer e8fdca3eaa0547d08fd840005216e2da. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.096750  8939 tablet_server.cc:196] TabletServer@127.8.186.193:41391 shutdown complete.
I20260709 13:20:14.199913  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
W20260709 13:20:14.205031 18143 consensus_peers.cc:597] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.223229 18143 consensus_peers.cc:597] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.238144  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:14.239022  8939 tablet_replica.cc:333] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.239938  8939 raft_consensus.cc:2243] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.240418  8939 raft_consensus.cc:2272] T 408437b0be3b484dae4ecaed1badf036 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.242944  8939 tablet_replica.cc:333] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.243796  8939 raft_consensus.cc:2243] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.244284  8939 raft_consensus.cc:2272] T 39309f26ab25439e8503252118d584d0 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.246943  8939 tablet_replica.cc:333] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.247570  8939 raft_consensus.cc:2243] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.248458  8939 raft_consensus.cc:2272] T 348515f468ae48c3a679e082be5ba35d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.250557  8939 tablet_replica.cc:333] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.251255  8939 raft_consensus.cc:2243] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.251830  8939 raft_consensus.cc:2272] T f3de96e0eff148aa92357ccf945a3a9d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.254709  8939 tablet_replica.cc:333] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.255561  8939 raft_consensus.cc:2243] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.256171  8939 raft_consensus.cc:2272] T 45716870c722497db3b6cad734aa0a5b P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.256748 19230 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.257273 19230 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.258569  8939 tablet_replica.cc:333] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.259008 19230 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.259485  8939 raft_consensus.cc:2243] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.260124  8939 raft_consensus.cc:2272] T 597550505a4d4924b3edf943e2dd4167 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.260813 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:20:14.262977 18218 leader_election.cc:336] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.263442 18218 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.263443 19230 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.264427 19136 raft_consensus.cc:2749] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.264810  8939 tablet_replica.cc:333] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.265712  8939 raft_consensus.cc:2243] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.264295 19230 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.267410  8939 raft_consensus.cc:2272] T 98540bdb13d84727be4be8cd6b851140 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.268422 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:20:14.271591  8939 tablet_replica.cc:333] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.272473  8939 raft_consensus.cc:2243] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.272981  8939 raft_consensus.cc:2272] T b44da0a6da3147d694f8909e41b70aa8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.276013  8939 tablet_replica.cc:333] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.276868  8939 raft_consensus.cc:2243] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.277220 19230 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.277529  8939 raft_consensus.cc:2272] T f13a5a37e724480ebc62f12966c08386 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.280939  8939 tablet_replica.cc:333] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.281845  8939 raft_consensus.cc:2243] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.282400  8939 raft_consensus.cc:2272] T f0c73929e277490a8d8e29869c87f676 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.285260 18218 leader_election.cc:336] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.285643  8939 tablet_replica.cc:333] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.286574  8939 raft_consensus.cc:2243] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.286851 18218 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.287616 19136 raft_consensus.cc:2749] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.287698  8939 raft_consensus.cc:2272] T 0088d5969b0d4183886e26ed2654e034 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.292874  8939 tablet_replica.cc:333] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.293787  8939 raft_consensus.cc:2243] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.294450  8939 raft_consensus.cc:2272] T a659b113eca540428fc23a797373191e P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.297400  8939 tablet_replica.cc:333] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.298229  8939 raft_consensus.cc:2243] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:14.298501 18217 consensus_peers.cc:597] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.298823  8939 raft_consensus.cc:2272] T f969e2d5e7334a5d9e4d21fe84cd0efb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.301539  8939 tablet_replica.cc:333] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.302274  8939 raft_consensus.cc:2243] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.302742  8939 raft_consensus.cc:2272] T 2ab14946ec96453d983b98de84b5a104 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.305128  8939 tablet_replica.cc:333] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.305714  8939 raft_consensus.cc:2243] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.306492  8939 raft_consensus.cc:2272] T e5e40c116d0e4d4a9c87a0a4c8daf709 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.308936  8939 tablet_replica.cc:333] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.309806  8939 raft_consensus.cc:2243] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.310678  8939 raft_consensus.cc:2272] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 830a192d6137410e8bd043588f0ed425 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.312742  8939 tablet_replica.cc:333] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.313282  8939 raft_consensus.cc:2243] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.313865  8939 raft_consensus.cc:2272] T c712025f0c334b2ea7f26a97e97c347b P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.316154  8939 tablet_replica.cc:333] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.316727  8939 raft_consensus.cc:2243] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.317543  8939 raft_consensus.cc:2272] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.319734  8939 tablet_replica.cc:333] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.320399  8939 raft_consensus.cc:2243] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.320849  8939 raft_consensus.cc:2272] T b8918d3a188f4572af4b584b200ba410 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.322757  8939 tablet_replica.cc:333] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.323377  8939 raft_consensus.cc:2243] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.323947  8939 raft_consensus.cc:2272] T 5ec6c104c96c43e5848ec45b8cf9c36d P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.326653  8939 tablet_replica.cc:333] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.327499  8939 raft_consensus.cc:2243] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.327986  8939 raft_consensus.cc:2272] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.330091  8939 tablet_replica.cc:333] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.330662  8939 raft_consensus.cc:2243] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.331676  8939 raft_consensus.cc:2272] T 0e90ea9c973f4fcdbbd047a3346e4639 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.333818  8939 tablet_replica.cc:333] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.334345  8939 raft_consensus.cc:2243] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.335127  8939 raft_consensus.cc:2272] T 13c71a8d73a841e5840ba9d18aba7b58 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.337478  8939 tablet_replica.cc:333] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.338233  8939 raft_consensus.cc:2243] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.339187  8939 raft_consensus.cc:2272] T 47fc415ccc6740a7ab53f700cb2a82c8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.341786  8939 tablet_replica.cc:333] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.342392  8939 raft_consensus.cc:2243] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.342984  8939 raft_consensus.cc:2272] T a88eab1bc51e48fc9f75286f06f31b2d P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.345307  8939 tablet_replica.cc:333] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.345836  8939 raft_consensus.cc:2243] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.346251  8939 raft_consensus.cc:2272] T 926766f358784880a482cc7ea6052052 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.348222  8939 tablet_replica.cc:333] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.348690  8939 raft_consensus.cc:2243] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.349653  8939 raft_consensus.cc:2272] T 675aa5689d904979a3aaa90534d93385 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.351974  8939 tablet_replica.cc:333] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
W20260709 13:20:14.352653 18217 consensus_peers.cc:597] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.352697  8939 raft_consensus.cc:2243] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.353361  8939 raft_consensus.cc:2272] T 1db0037842d34ab783fcba2d367d98eb P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.355408  8939 tablet_replica.cc:333] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.356029  8939 raft_consensus.cc:2243] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.356483  8939 raft_consensus.cc:2272] T 802d97ba13fe467c87385eae6fe54a02 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.358660  8939 tablet_replica.cc:333] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.359217  8939 raft_consensus.cc:2243] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.360082  8939 raft_consensus.cc:2272] T 2891e8255e0b4398a034d1bc7f353332 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.361953 18143 consensus_peers.cc:597] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.362115  8939 tablet_replica.cc:333] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.362784  8939 raft_consensus.cc:2243] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.363196  8939 raft_consensus.cc:2272] T 481e9aa796fa47f5b94531ca8587c3c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.365746  8939 tablet_replica.cc:333] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.366505  8939 raft_consensus.cc:2243] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.366994  8939 raft_consensus.cc:2272] T 15af0e21890f4f18b1e124ce6ffdb689 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.369714  8939 tablet_replica.cc:333] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.370236  8939 raft_consensus.cc:2243] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.370618  8939 raft_consensus.cc:2272] T c950171fa2384c128706fe4e1cc5c562 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.373145  8939 tablet_replica.cc:333] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.373697  8939 raft_consensus.cc:2243] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.374123  8939 raft_consensus.cc:2272] T f72264469fd94db8b68aa30adcacd8c8 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.376578  8939 tablet_replica.cc:333] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.377333  8939 raft_consensus.cc:2243] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.377801  8939 raft_consensus.cc:2272] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.379907  8939 tablet_replica.cc:333] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.380519  8939 raft_consensus.cc:2243] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.381348  8939 raft_consensus.cc:2272] T 27094133c5bd4d54ae86e99d83396dec P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.383674 19201 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.384052  8939 tablet_replica.cc:333] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.384330 19201 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.384881  8939 raft_consensus.cc:2243] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.385805 19230 raft_consensus.cc:493] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.386026  8939 raft_consensus.cc:2272] T 3879a0395b8c47ee82b8d483717aacd7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.386286 19201 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.386371 19230 raft_consensus.cc:515] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.387456 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:20:14.388104 18248 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:20:14.388916 19230 leader_election.cc:290] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:14.389262  8939 tablet_replica.cc:333] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.390064  8939 raft_consensus.cc:2243] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.390058 18144 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:20:14.390900  8939 raft_consensus.cc:2272] T 26ca0113f4654093a3524c8198661196 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.391105 19201 raft_consensus.cc:2804] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:14.391590 19201 raft_consensus.cc:493] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.392006 19201 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.393457  8939 tablet_replica.cc:333] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.394246  8939 raft_consensus.cc:2243] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.394762  8939 raft_consensus.cc:2272] T c7e89b6eefa04beea2f707a0208c3268 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.395968 18218 leader_election.cc:336] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.397441  8939 tablet_replica.cc:333] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.398037  8939 raft_consensus.cc:2243] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.398981  8939 raft_consensus.cc:2272] T 1ae0e2b2834f4fc0bd95acb2401862ed P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.400597 19201 raft_consensus.cc:515] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.401511  8939 tablet_replica.cc:333] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.402305  8939 raft_consensus.cc:2243] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.402962 19201 leader_election.cc:290] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.403400  8939 raft_consensus.cc:2272] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.403975 19230 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.404563 19230 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:20:14.405599 18217 leader_election.cc:336] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:14.406358 18217 leader_election.cc:304] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.406555  8939 tablet_replica.cc:333] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
I20260709 13:20:14.407337  8939 raft_consensus.cc:2243] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.407493 18175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
I20260709 13:20:14.408110  8939 raft_consensus.cc:2272] T 9163e7694071456bb2b68a6858e44443 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.407337 19136 raft_consensus.cc:2749] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:14.409431 19230 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.410501 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168fed5754ae48c19312ea4a2fa2c5ed" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:14.411067  8939 tablet_replica.cc:333] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
W20260709 13:20:14.411767 18144 leader_election.cc:336] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.411835  8939 raft_consensus.cc:2243] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.411116 18248 raft_consensus.cc:3060] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.413094  8939 raft_consensus.cc:2272] T 0918ff57517a4193add2df7b454631f8 P 830a192d6137410e8bd043588f0ed425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.416046  8939 tablet_replica.cc:333] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425: stopping tablet replica
W20260709 13:20:14.416076 18144 leader_election.cc:336] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.416776  8939 raft_consensus.cc:2243] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.417317  8939 raft_consensus.cc:2272] T 4b19233b689b4661a029f09f617dd4b7 P 830a192d6137410e8bd043588f0ed425 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.417387 18218 leader_election.cc:336] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.417948 18218 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
W20260709 13:20:14.420243 18143 consensus_peers.cc:597] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.420933 19230 raft_consensus.cc:2749] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:14.421794 18248 raft_consensus.cc:2468] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 3.
W20260709 13:20:14.422509 18143 consensus_peers.cc:597] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.423458 18144 leader_election.cc:304] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.424217 19201 raft_consensus.cc:2804] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:14.424677 19201 raft_consensus.cc:697] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:14.425483 19201 consensus_queue.cc:237] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
W20260709 13:20:14.429950 18217 consensus_peers.cc:597] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.436371 17925 catalog_manager.cc:5697] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 reported cstate change: term changed from 2 to 3, leader changed from e8fdca3eaa0547d08fd840005216e2da (127.8.186.193) to e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "e6e16b9214a1403293e3eeb06be25a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:14.440080 18143 consensus_peers.cc:597] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.498874 19230 raft_consensus.cc:493] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.499501 19230 raft_consensus.cc:515] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.501736 19230 leader_election.cc:290] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:20:14.506704 18218 leader_election.cc:336] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:20:14.508064 18217 leader_election.cc:336] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.508520 18217 leader_election.cc:304] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.509215 19230 raft_consensus.cc:2749] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:14.539448 18143 consensus_peers.cc:597] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.541158 18217 consensus_peers.cc:597] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.541721 19230 raft_consensus.cc:493] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.542675  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
I20260709 13:20:14.542302 19230 raft_consensus.cc:515] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.544379 19230 leader_election.cc:290] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:20:14.548997 18218 leader_election.cc:336] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:20:14.549672 18217 leader_election.cc:336] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.550055 18217 leader_election.cc:304] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.550678 19230 raft_consensus.cc:2749] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:14.569676 18217 consensus_peers.cc:597] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.579141 19201 raft_consensus.cc:493] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
W20260709 13:20:14.579581 18143 consensus_peers.cc:597] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.579885 19201 raft_consensus.cc:515] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
I20260709 13:20:14.581863 19136 raft_consensus.cc:493] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.582456 19136 raft_consensus.cc:515] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.584587 19136 leader_election.cc:290] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:14.581898 19201 leader_election.cc:290] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:20:14.587486 18144 leader_election.cc:336] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:20:14.589527 18143 leader_election.cc:336] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.589967 18143 leader_election.cc:304] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.591181 19201 raft_consensus.cc:2749] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:14.592439 18217 leader_election.cc:336] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
W20260709 13:20:14.592969 18217 consensus_peers.cc:597] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.595651 18218 leader_election.cc:336] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.596120 18218 leader_election.cc:304] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
W20260709 13:20:14.596505 18217 consensus_peers.cc:597] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.596839 19230 raft_consensus.cc:2749] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.597380 19136 raft_consensus.cc:493] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.597852 19136 raft_consensus.cc:515] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.599591 19136 leader_election.cc:290] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:20:14.604264 18218 leader_election.cc:336] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:20:14.604770 18217 leader_election.cc:336] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.605190 18217 leader_election.cc:304] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.605803 19136 raft_consensus.cc:2749] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.613097 19230 raft_consensus.cc:493] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.613746 19230 raft_consensus.cc:515] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.616223 19230 leader_election.cc:290] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.617673 18177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "23853b156a904ba6a31afa79977f3adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6e16b9214a1403293e3eeb06be25a91" is_pre_election: true
W20260709 13:20:14.620050 18217 consensus_peers.cc:597] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.621826 18218 leader_election.cc:336] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.622278 18218 leader_election.cc:304] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: e6e16b9214a1403293e3eeb06be25a91, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.622982 19230 raft_consensus.cc:2749] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.639108  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
W20260709 13:20:14.660293 18143 consensus_peers.cc:597] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.662377 18217 consensus_peers.cc:597] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.664722 18217 consensus_peers.cc:597] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc -> Peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Couldn't send request to peer 830a192d6137410e8bd043588f0ed425. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.673565 18215 consensus_peers.cc:597] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.692448 19230 raft_consensus.cc:493] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.692984 19230 raft_consensus.cc:515] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.697577 19230 leader_election.cc:290] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
W20260709 13:20:14.700122 18218 leader_election.cc:336] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.707245 19180 raft_consensus.cc:493] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.707914 19180 raft_consensus.cc:515] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } } peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } }
W20260709 13:20:14.711403 18215 consensus_peers.cc:597] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.703629 18217 leader_election.cc:336] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.712345  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:14.712527 18217 leader_election.cc:304] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.713270 19180 leader_election.cc:290] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:14.713928 19230 raft_consensus.cc:2749] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:20:14.716586 18144 leader_election.cc:336] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
W20260709 13:20:14.719517 18143 leader_election.cc:336] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.719986 18143 leader_election.cc:304] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6e16b9214a1403293e3eeb06be25a91; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.720571  8939 tablet_replica.cc:333] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.721626  8939 raft_consensus.cc:2243] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.722259  8939 raft_consensus.cc:2272] T 35f2c770ec624cb48eb6dc2e7007437d P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.722625 19180 raft_consensus.cc:2749] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.725700  8939 tablet_replica.cc:333] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.726675  8939 raft_consensus.cc:2243] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.727272  8939 raft_consensus.cc:2272] T c38e95faa660491da0ac409cbe606465 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.730262  8939 tablet_replica.cc:333] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.731037  8939 raft_consensus.cc:2243] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.731597  8939 raft_consensus.cc:2272] T c7e89b6eefa04beea2f707a0208c3268 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.735646  8939 tablet_replica.cc:333] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.736500  8939 raft_consensus.cc:2243] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.737013  8939 raft_consensus.cc:2272] T 1ae0e2b2834f4fc0bd95acb2401862ed P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.739687  8939 tablet_replica.cc:333] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.740475  8939 raft_consensus.cc:2243] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.740959  8939 raft_consensus.cc:2272] T 348515f468ae48c3a679e082be5ba35d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.743775  8939 tablet_replica.cc:333] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.744616  8939 raft_consensus.cc:2243] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.744704 19230 raft_consensus.cc:493] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.745275 19230 raft_consensus.cc:515] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
W20260709 13:20:14.746805 18215 consensus_peers.cc:597] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.747460 19230 leader_election.cc:290] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:14.745285  8939 raft_consensus.cc:2272] T f0c73929e277490a8d8e29869c87f676 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.752286 18218 leader_election.cc:336] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.753440  8939 tablet_replica.cc:333] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.753280 19232 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.753932 19232 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.754393  8939 raft_consensus.cc:2243] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.756161 19232 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
W20260709 13:20:14.757876 18217 leader_election.cc:336] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.758364 18217 leader_election.cc:304] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.759310 19230 raft_consensus.cc:2749] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.759651  8939 raft_consensus.cc:2272] T 597550505a4d4924b3edf943e2dd4167 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.760843 18144 leader_election.cc:336] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.762646  8939 tablet_replica.cc:333] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.763182 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:20:14.763528  8939 raft_consensus.cc:2243] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.763851 18248 raft_consensus.cc:2468] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:20:14.764672  8939 raft_consensus.cc:2272] T 98540bdb13d84727be4be8cd6b851140 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.764834 18144 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.765718 19232 raft_consensus.cc:2804] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:14.767771  8939 tablet_replica.cc:333] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.767992 19232 raft_consensus.cc:493] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.768567 19232 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.768728  8939 raft_consensus.cc:2243] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.769889  8939 raft_consensus.cc:2272] T 4511aae3d2a140fc8941166745d82fe3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.767637 19201 raft_consensus.cc:493] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.770609 19201 raft_consensus.cc:515] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.772806  8939 tablet_replica.cc:333] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.772826 19201 leader_election.cc:290] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.773772  8939 raft_consensus.cc:2243] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:14.774168 18215 consensus_peers.cc:597] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.774430  8939 raft_consensus.cc:2272] T 0088d5969b0d4183886e26ed2654e034 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.775270 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479841006f754b57b85acab5b257c912" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:20:14.775884 18248 raft_consensus.cc:2468] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 2.
I20260709 13:20:14.777560  8939 tablet_replica.cc:333] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.778448  8939 raft_consensus.cc:2243] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.779542  8939 raft_consensus.cc:2272] T 39309f26ab25439e8503252118d584d0 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.782012 18144 leader_election.cc:336] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.782373  8939 tablet_replica.cc:333] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.782900 18144 leader_election.cc:304] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.783315  8939 raft_consensus.cc:2243] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.783730 19180 raft_consensus.cc:2706] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Received pre-election callback for term 3 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:20:14.784301  8939 raft_consensus.cc:2272] T 479841006f754b57b85acab5b257c912 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.784763 19232 raft_consensus.cc:515] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.786991 19232 leader_election.cc:290] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.787392  8939 tablet_replica.cc:333] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.789122 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2bb64614fc44ec9c9f2a6691cdd1e0" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:14.789600  8939 raft_consensus.cc:2243] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.789749 18246 raft_consensus.cc:3060] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.790812  8939 raft_consensus.cc:2272] T f3de96e0eff148aa92357ccf945a3a9d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:14.793555 18144 leader_election.cc:336] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.793999  8939 tablet_replica.cc:333] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.795186  8939 raft_consensus.cc:2243] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.796036  8939 pending_rounds.cc:70] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: Trying to abort 1 pending ops.
I20260709 13:20:14.796240  8939 pending_rounds.cc:77] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638766296178688 op_type: NO_OP noop_request { }
I20260709 13:20:14.796576  8939 raft_consensus.cc:2889] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:14.796862  8939 raft_consensus.cc:2272] T 168fed5754ae48c19312ea4a2fa2c5ed P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.799417  8939 tablet_replica.cc:333] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.799727 18246 raft_consensus.cc:2468] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 3.
I20260709 13:20:14.800092  8939 raft_consensus.cc:2243] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.801303  8939 raft_consensus.cc:2272] T c950171fa2384c128706fe4e1cc5c562 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.801047 18144 leader_election.cc:304] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.802218 19232 raft_consensus.cc:2804] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:14.802711 19232 raft_consensus.cc:697] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: Becoming Leader. State: Replica: e6e16b9214a1403293e3eeb06be25a91, State: Running, Role: LEADER
I20260709 13:20:14.803609 19232 consensus_queue.cc:237] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.804710  8939 tablet_replica.cc:333] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.805801  8939 raft_consensus.cc:2243] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.806845  8939 raft_consensus.cc:2272] T a1412fa1b14f40fea87fb6a4cf76931d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.809674  8939 tablet_replica.cc:333] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.810503  8939 raft_consensus.cc:2243] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.811344  8939 raft_consensus.cc:2272] T 2ab14946ec96453d983b98de84b5a104 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.814451  8939 tablet_replica.cc:333] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.815265  8939 raft_consensus.cc:2243] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.815862  8939 raft_consensus.cc:2272] T 1380a01d5ea6449a8d7cf0fef7a4bf60 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.818084  8939 tablet_replica.cc:333] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.818693  8939 raft_consensus.cc:2243] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.819145  8939 raft_consensus.cc:2272] T e5e40c116d0e4d4a9c87a0a4c8daf709 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.821251  8939 tablet_replica.cc:333] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.821822  8939 raft_consensus.cc:2243] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.822314  8939 raft_consensus.cc:2272] T 13c71a8d73a841e5840ba9d18aba7b58 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.824988  8939 tablet_replica.cc:333] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.825692  8939 raft_consensus.cc:2243] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.826277  8939 raft_consensus.cc:2272] T 47fc415ccc6740a7ab53f700cb2a82c8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.829171  8939 tablet_replica.cc:333] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.829764  8939 raft_consensus.cc:2243] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.830164  8939 raft_consensus.cc:2272] T 45716870c722497db3b6cad734aa0a5b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.832194  8939 tablet_replica.cc:333] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.832739  8939 raft_consensus.cc:2243] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.833523  8939 raft_consensus.cc:2272] T 2f57aae4fb06403aaac8a835763ff266 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.835973  8939 tablet_replica.cc:333] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.836642  8939 raft_consensus.cc:2243] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.837098  8939 raft_consensus.cc:2272] T 0e90ea9c973f4fcdbbd047a3346e4639 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.839411  8939 tablet_replica.cc:333] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.839964  8939 raft_consensus.cc:2243] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.840756  8939 raft_consensus.cc:2272] T 4ab3b20d1eec4e5c93ec3223184a53d3 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.843129  8939 tablet_replica.cc:333] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.843715  8939 raft_consensus.cc:2243] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.844139  8939 raft_consensus.cc:2272] T a010bb50f906431fa93244db273529cb P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.846153  8939 tablet_replica.cc:333] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.846674  8939 raft_consensus.cc:2243] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.847438  8939 raft_consensus.cc:2272] T 8a20b2a9b6fc418eaebac50b17ddee1b P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.849491  8939 tablet_replica.cc:333] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.849993  8939 raft_consensus.cc:2243] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.850749  8939 raft_consensus.cc:2272] T 698a6a9993674b4eae04bad2efa5485f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.852705  8939 tablet_replica.cc:333] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.853199  8939 raft_consensus.cc:2243] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.853577  8939 raft_consensus.cc:2272] T a88eab1bc51e48fc9f75286f06f31b2d P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.855508  8939 tablet_replica.cc:333] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.856035  8939 raft_consensus.cc:2243] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.856441  8939 raft_consensus.cc:2272] T 675aa5689d904979a3aaa90534d93385 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.858407  8939 tablet_replica.cc:333] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.858886  8939 raft_consensus.cc:2243] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.859228  8939 raft_consensus.cc:2272] T 1db0037842d34ab783fcba2d367d98eb P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.861054  8939 tablet_replica.cc:333] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.861544  8939 raft_consensus.cc:2243] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.861908  8939 raft_consensus.cc:2272] T 227d050c5ac14865954c8c8dce1cfe86 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.863794  8939 tablet_replica.cc:333] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.864286  8939 raft_consensus.cc:2243] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.865028  8939 raft_consensus.cc:2272] T 4b19233b689b4661a029f09f617dd4b7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.866876  8939 tablet_replica.cc:333] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.867425  8939 raft_consensus.cc:2243] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.867842  8939 raft_consensus.cc:2272] T 2891e8255e0b4398a034d1bc7f353332 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.869642  8939 tablet_replica.cc:333] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.870102  8939 raft_consensus.cc:2243] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.870458  8939 raft_consensus.cc:2272] T 481e9aa796fa47f5b94531ca8587c3c5 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.872360  8939 tablet_replica.cc:333] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.872824  8939 raft_consensus.cc:2243] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.873556  8939 raft_consensus.cc:2272] T 802d97ba13fe467c87385eae6fe54a02 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.875559  8939 tablet_replica.cc:333] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.876060  8939 raft_consensus.cc:2243] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.876427  8939 raft_consensus.cc:2272] T 0918ff57517a4193add2df7b454631f8 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.878381  8939 tablet_replica.cc:333] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.878826  8939 raft_consensus.cc:2243] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.879194  8939 raft_consensus.cc:2272] T 549b6d4d69b644b7a7c5ec7b137eef7f P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.880985 19230 raft_consensus.cc:493] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.881156  8939 tablet_replica.cc:333] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.881500 19230 raft_consensus.cc:515] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } } peers { permanent_uuid: "830a192d6137410e8bd043588f0ed425" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38977 } }
I20260709 13:20:14.881810  8939 raft_consensus.cc:2243] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.882536  8939 pending_rounds.cc:70] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: Trying to abort 1 pending ops.
I20260709 13:20:14.882702  8939 pending_rounds.cc:77] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638767846404096 op_type: NO_OP noop_request { }
I20260709 13:20:14.882964  8939 raft_consensus.cc:2889] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:14.883242  8939 raft_consensus.cc:2272] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.883335 19230 leader_election.cc:290] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391), 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977)
I20260709 13:20:14.886966  8939 tablet_replica.cc:333] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
W20260709 13:20:14.887637 18218 leader_election.cc:336] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.887883  8939 raft_consensus.cc:2243] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:14.888382 18217 leader_election.cc:336] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 830a192d6137410e8bd043588f0ed425 (127.8.186.194:38977): Network error: Client connection negotiation failed: client connection to 127.8.186.194:38977: connect: Connection refused (error 111)
I20260709 13:20:14.888765 18217 leader_election.cc:304] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc; no voters: 830a192d6137410e8bd043588f0ed425, e8fdca3eaa0547d08fd840005216e2da
I20260709 13:20:14.889096  8939 raft_consensus.cc:2272] T 55a427d8aa884b3f98202c983c1292ab P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.889338 19230 raft_consensus.cc:2749] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:14.891142 19232 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.891606  8939 tablet_replica.cc:333] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.891599 19232 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.892328  8939 raft_consensus.cc:2243] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.892782  8939 raft_consensus.cc:2272] T 3879a0395b8c47ee82b8d483717aacd7 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.894160 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc" is_pre_election: true
I20260709 13:20:14.894784 18246 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 3.
I20260709 13:20:14.893553 19232 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.895315  8939 tablet_replica.cc:333] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.896138  8939 raft_consensus.cc:2243] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:14.896180 18144 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: 
I20260709 13:20:14.896932 19232 raft_consensus.cc:2804] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:14.897226 19232 raft_consensus.cc:493] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8fdca3eaa0547d08fd840005216e2da)
I20260709 13:20:14.897317  8939 raft_consensus.cc:2272] T b8918d3a188f4572af4b584b200ba410 P e6e16b9214a1403293e3eeb06be25a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.897555 19232 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:14.898559 18144 leader_election.cc:336] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.899951  8939 tablet_replica.cc:333] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.900542  8939 raft_consensus.cc:2243] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.900959  8939 raft_consensus.cc:2272] T f72264469fd94db8b68aa30adcacd8c8 P e6e16b9214a1403293e3eeb06be25a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.903077  8939 tablet_replica.cc:333] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: stopping tablet replica
I20260709 13:20:14.903550 19232 raft_consensus.cc:515] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6e16b9214a1403293e3eeb06be25a91" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 37697 } } peers { permanent_uuid: "23853b156a904ba6a31afa79977f3adc" member_type: VOTER last_known_addr { host: "127.8.186.196" port: 35299 } } peers { permanent_uuid: "e8fdca3eaa0547d08fd840005216e2da" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 41391 } }
I20260709 13:20:14.904502  8939 raft_consensus.cc:2243] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:14.905434 19232 leader_election.cc:290] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 4 election: Requested vote from peers 23853b156a904ba6a31afa79977f3adc (127.8.186.196:35299), e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391)
I20260709 13:20:14.906242 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951bc38e637242429f4d8415582fa5dc" candidate_uuid: "e6e16b9214a1403293e3eeb06be25a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23853b156a904ba6a31afa79977f3adc"
I20260709 13:20:14.906831  8939 raft_consensus.cc:2272] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:14.906854 18246 raft_consensus.cc:3060] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:14.909454 18144 leader_election.cc:336] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e8fdca3eaa0547d08fd840005216e2da (127.8.186.193:41391): Network error: Client connection negotiation failed: client connection to 127.8.186.193:41391: connect: Connection refused (error 111)
I20260709 13:20:14.914275 18246 raft_consensus.cc:2468] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6e16b9214a1403293e3eeb06be25a91 in term 4.
I20260709 13:20:14.915498 18144 leader_election.cc:304] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23853b156a904ba6a31afa79977f3adc, e6e16b9214a1403293e3eeb06be25a91; no voters: e8fdca3eaa0547d08fd840005216e2da
W20260709 13:20:14.916051 18144 raft_consensus.cc:2686] T 951bc38e637242429f4d8415582fa5dc P e6e16b9214a1403293e3eeb06be25a91: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:20:14.925681 18215 consensus_peers.cc:597] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:14.950750 18215 consensus_peers.cc:597] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:14.987622  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
W20260709 13:20:15.004244 18215 consensus_peers.cc:597] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:37697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:15.004788 18215 consensus_peers.cc:597] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:37697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:15.023512 18215 consensus_peers.cc:597] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:37697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:15.061775  8939 tablet_server.cc:179] TabletServer@127.8.186.196:0 shutting down...
I20260709 13:20:15.097061  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:15.098027  8939 tablet_replica.cc:333] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.098790  8939 raft_consensus.cc:2243] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.100061  8939 raft_consensus.cc:2272] T c38e95faa660491da0ac409cbe606465 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.102438  8939 tablet_replica.cc:333] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.103113  8939 raft_consensus.cc:2243] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.103587  8939 raft_consensus.cc:2272] T 408437b0be3b484dae4ecaed1badf036 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.105562  8939 tablet_replica.cc:333] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.106094  8939 raft_consensus.cc:2243] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.106472  8939 raft_consensus.cc:2272] T 4511aae3d2a140fc8941166745d82fe3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.108438  8939 tablet_replica.cc:333] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.108996  8939 raft_consensus.cc:2243] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.109395  8939 raft_consensus.cc:2272] T 348515f468ae48c3a679e082be5ba35d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.111357  8939 tablet_replica.cc:333] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.112106  8939 raft_consensus.cc:2243] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.112524  8939 raft_consensus.cc:2272] T b44da0a6da3147d694f8909e41b70aa8 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.114441  8939 tablet_replica.cc:333] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.114979  8939 raft_consensus.cc:2243] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.115345  8939 raft_consensus.cc:2272] T f13a5a37e724480ebc62f12966c08386 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.117333  8939 tablet_replica.cc:333] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.117875  8939 raft_consensus.cc:2243] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.118746  8939 raft_consensus.cc:2272] T f0c73929e277490a8d8e29869c87f676 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.120993  8939 tablet_replica.cc:333] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.121565  8939 raft_consensus.cc:2243] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.122090  8939 raft_consensus.cc:2272] T 168fed5754ae48c19312ea4a2fa2c5ed P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.124462  8939 tablet_replica.cc:333] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.125067  8939 raft_consensus.cc:2243] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.125976  8939 raft_consensus.cc:2272] T 926766f358784880a482cc7ea6052052 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.128193  8939 tablet_replica.cc:333] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.128777  8939 raft_consensus.cc:2243] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.129678  8939 raft_consensus.cc:2272] T a88eab1bc51e48fc9f75286f06f31b2d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.131974  8939 tablet_replica.cc:333] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.132589  8939 raft_consensus.cc:2243] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.133037  8939 raft_consensus.cc:2272] T 39309f26ab25439e8503252118d584d0 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.135164  8939 tablet_replica.cc:333] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.135813  8939 raft_consensus.cc:2243] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.136234  8939 raft_consensus.cc:2272] T 479841006f754b57b85acab5b257c912 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.138345  8939 tablet_replica.cc:333] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.138939  8939 raft_consensus.cc:2243] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.139364  8939 raft_consensus.cc:2272] T 15af0e21890f4f18b1e124ce6ffdb689 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.141346  8939 tablet_replica.cc:333] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.141954  8939 raft_consensus.cc:2243] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.142372  8939 raft_consensus.cc:2272] T c950171fa2384c128706fe4e1cc5c562 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.144557  8939 tablet_replica.cc:333] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.145279  8939 raft_consensus.cc:2243] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.145838  8939 raft_consensus.cc:2272] T f969e2d5e7334a5d9e4d21fe84cd0efb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.148597  8939 tablet_replica.cc:333] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.149257  8939 raft_consensus.cc:2243] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.149775  8939 raft_consensus.cc:2272] T a1412fa1b14f40fea87fb6a4cf76931d P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.152467  8939 tablet_replica.cc:333] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.153178  8939 raft_consensus.cc:2243] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.153681  8939 raft_consensus.cc:2272] T 2ab14946ec96453d983b98de84b5a104 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.156195  8939 tablet_replica.cc:333] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.156739  8939 raft_consensus.cc:2243] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.157503  8939 raft_consensus.cc:2272] T a010bb50f906431fa93244db273529cb P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.159606  8939 tablet_replica.cc:333] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.160193  8939 raft_consensus.cc:2243] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.160624  8939 raft_consensus.cc:2272] T 4ab3b20d1eec4e5c93ec3223184a53d3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.162667  8939 tablet_replica.cc:333] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.163223  8939 raft_consensus.cc:2243] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.163616  8939 raft_consensus.cc:2272] T a659b113eca540428fc23a797373191e P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.165813  8939 tablet_replica.cc:333] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.166402  8939 raft_consensus.cc:2243] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.167173  8939 raft_consensus.cc:2272] T 45716870c722497db3b6cad734aa0a5b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.169188  8939 tablet_replica.cc:333] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.169723  8939 raft_consensus.cc:2243] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.170110  8939 raft_consensus.cc:2272] T 2f57aae4fb06403aaac8a835763ff266 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.172384  8939 tablet_replica.cc:333] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.172905  8939 raft_consensus.cc:2243] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.173301  8939 raft_consensus.cc:2272] T b8918d3a188f4572af4b584b200ba410 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.175227  8939 tablet_replica.cc:333] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.175767  8939 raft_consensus.cc:2243] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.176517  8939 raft_consensus.cc:2272] T 5ec6c104c96c43e5848ec45b8cf9c36d P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.178448  8939 tablet_replica.cc:333] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.178928  8939 raft_consensus.cc:2243] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.179695  8939 raft_consensus.cc:2272] T 1db0037842d34ab783fcba2d367d98eb P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.181921  8939 tablet_replica.cc:333] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.182734  8939 raft_consensus.cc:2243] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.183247  8939 raft_consensus.cc:2272] T 8a20b2a9b6fc418eaebac50b17ddee1b P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.185663  8939 tablet_replica.cc:333] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.186308  8939 raft_consensus.cc:2243] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.186736  8939 raft_consensus.cc:2272] T 698a6a9993674b4eae04bad2efa5485f P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.189237  8939 tablet_replica.cc:333] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.189836  8939 raft_consensus.cc:2243] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.190237  8939 raft_consensus.cc:2272] T 13c71a8d73a841e5840ba9d18aba7b58 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.192397  8939 tablet_replica.cc:333] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.192967  8939 raft_consensus.cc:2243] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.193423  8939 raft_consensus.cc:2272] T 41c7cf1efa6d4c26b013079c0cfeb2c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.195504  8939 tablet_replica.cc:333] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.196110  8939 raft_consensus.cc:2243] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.196525  8939 raft_consensus.cc:2272] T 951bc38e637242429f4d8415582fa5dc P 23853b156a904ba6a31afa79977f3adc [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:15.196446 18215 consensus_peers.cc:597] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc -> Peer e6e16b9214a1403293e3eeb06be25a91 (127.8.186.195:37697): Couldn't send request to peer e6e16b9214a1403293e3eeb06be25a91. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.195:37697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:15.198740  8939 tablet_replica.cc:333] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.199366  8939 raft_consensus.cc:2243] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.199844  8939 raft_consensus.cc:2272] T 77a6d9f19cd54ca29ff8bb17b2f7abb7 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.201921  8939 tablet_replica.cc:333] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.202441  8939 raft_consensus.cc:2243] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.202849  8939 raft_consensus.cc:2272] T c712025f0c334b2ea7f26a97e97c347b P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.204828  8939 tablet_replica.cc:333] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.205344  8939 raft_consensus.cc:2243] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.206149  8939 raft_consensus.cc:2272] T 227d050c5ac14865954c8c8dce1cfe86 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.208297  8939 tablet_replica.cc:333] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.208827  8939 raft_consensus.cc:2243] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.209245  8939 raft_consensus.cc:2272] T 4b19233b689b4661a029f09f617dd4b7 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.211390  8939 tablet_replica.cc:333] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.211992  8939 raft_consensus.cc:2243] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.212800  8939 raft_consensus.cc:2272] T 549b6d4d69b644b7a7c5ec7b137eef7f P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.214766  8939 tablet_replica.cc:333] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.215456  8939 raft_consensus.cc:2243] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.216296  8939 raft_consensus.cc:2272] T 26ca0113f4654093a3524c8198661196 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.218813  8939 tablet_replica.cc:333] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.219456  8939 raft_consensus.cc:2243] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.219940  8939 raft_consensus.cc:2272] T 3e2bb64614fc44ec9c9f2a6691cdd1e0 P 23853b156a904ba6a31afa79977f3adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.221843  8939 tablet_replica.cc:333] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.222306  8939 raft_consensus.cc:2243] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.223052  8939 raft_consensus.cc:2272] T 35f2c770ec624cb48eb6dc2e7007437d P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.225097  8939 tablet_replica.cc:333] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.225611  8939 raft_consensus.cc:2243] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.225986  8939 raft_consensus.cc:2272] T 27094133c5bd4d54ae86e99d83396dec P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.227875  8939 tablet_replica.cc:333] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.228358  8939 raft_consensus.cc:2243] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.228739  8939 raft_consensus.cc:2272] T 55a427d8aa884b3f98202c983c1292ab P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.230693  8939 tablet_replica.cc:333] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.231177  8939 raft_consensus.cc:2243] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.231971  8939 raft_consensus.cc:2272] T c7e89b6eefa04beea2f707a0208c3268 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.233781  8939 tablet_replica.cc:333] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.234253  8939 raft_consensus.cc:2243] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.234609  8939 raft_consensus.cc:2272] T 70fc24e67dd34b168bc7110e7b8bdfa3 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.236577  8939 tablet_replica.cc:333] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.237035  8939 raft_consensus.cc:2243] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.237813  8939 raft_consensus.cc:2272] T 9163e7694071456bb2b68a6858e44443 P 23853b156a904ba6a31afa79977f3adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.239952  8939 tablet_replica.cc:333] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc: stopping tablet replica
I20260709 13:20:15.240443  8939 raft_consensus.cc:2243] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.241221  8939 raft_consensus.cc:2272] T 481e9aa796fa47f5b94531ca8587c3c5 P 23853b156a904ba6a31afa79977f3adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.312785  8939 tablet_server.cc:196] TabletServer@127.8.186.196:0 shutdown complete.
I20260709 13:20:15.379284  8939 master.cc:562] Master@127.8.186.254:34083 shutting down...
I20260709 13:20:15.404286  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.404884  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.405207  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P 974c2aa131d140b29fb3577a49e5258e: stopping tablet replica
I20260709 13:20:15.427920  8939 master.cc:584] Master@127.8.186.254:34083 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34604 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:20:15.511876  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:35411
I20260709 13:20:15.513026  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:15.518501 19244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:15.519088 19245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:15.521557 19247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.522306  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:15.523391  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:15.523571  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:15.523708  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603215523695 us; error 0 us; skew 500 ppm
I20260709 13:20:15.524260  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:15.526635  8939 webserver.cc:533] Webserver started at http://127.8.186.254:34623/ using document root <none> and password file <none>
I20260709 13:20:15.527122  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:15.527303  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:15.527566  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:15.528780  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.533658  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:15.537142 19252 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.537931  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:15.538316  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.538625  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:15.560492  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:15.561704  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:15.600116  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:35411
I20260709 13:20:15.600217 19303 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:35411 every 8 connection(s)
I20260709 13:20:15.603964 19304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:15.615083 19304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d: Bootstrap starting.
I20260709 13:20:15.619930 19304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:15.624344 19304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d: No bootstrap required, opened a new log
I20260709 13:20:15.626616 19304 raft_consensus.cc:359] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" member_type: VOTER }
I20260709 13:20:15.627002 19304 raft_consensus.cc:385] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:15.627179 19304 raft_consensus.cc:740] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd6ecd022f2445fcbe5a424c21a6bd1d, State: Initialized, Role: FOLLOWER
I20260709 13:20:15.627767 19304 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" member_type: VOTER }
I20260709 13:20:15.628194 19304 raft_consensus.cc:399] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:15.628396 19304 raft_consensus.cc:493] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:15.628603 19304 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:15.633525 19304 raft_consensus.cc:515] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" member_type: VOTER }
I20260709 13:20:15.634043 19304 leader_election.cc:304] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd6ecd022f2445fcbe5a424c21a6bd1d; no voters: 
I20260709 13:20:15.635140 19304 leader_election.cc:290] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:15.635560 19307 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:15.636904 19307 raft_consensus.cc:697] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 1 LEADER]: Becoming Leader. State: Replica: dd6ecd022f2445fcbe5a424c21a6bd1d, State: Running, Role: LEADER
I20260709 13:20:15.637584 19307 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" member_type: VOTER }
I20260709 13:20:15.638077 19304 sys_catalog.cc:565] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:15.642187 19309 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd6ecd022f2445fcbe5a424c21a6bd1d. Latest consensus state: current_term: 1 leader_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" member_type: VOTER } }
I20260709 13:20:15.642254 19308 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6ecd022f2445fcbe5a424c21a6bd1d" member_type: VOTER } }
I20260709 13:20:15.643108 19309 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:15.643167 19308 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:15.648036 19314 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:15.653486 19314 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:15.654534  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:15.662652 19314 catalog_manager.cc:1383] Generated new cluster ID: b7de7f1e86a140dbad384bb9d5ca72c9
I20260709 13:20:15.662978 19314 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:15.687729 19314 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:15.689137 19314 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:15.700470 19314 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d: Generated new TSK 0
I20260709 13:20:15.701125 19314 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:15.721930  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:15.727902 19325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:15.728925 19326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.732189  8939 server_base.cc:1061] running on GCE node
W20260709 13:20:15.732822 19328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.733757  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:15.733983  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:15.734145  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603215734129 us; error 0 us; skew 500 ppm
I20260709 13:20:15.734680  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:15.736971  8939 webserver.cc:533] Webserver started at http://127.8.186.193:36573/ using document root <none> and password file <none>
I20260709 13:20:15.737418  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:15.737586  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:15.737833  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:15.738879  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.743431  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:15.746759 19333 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.747450  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:15.747781  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.748080  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:15.767421  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:15.768920  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:15.770431  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:15.772780  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:15.772966  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.773197  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:15.773350  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.813097  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:39219
I20260709 13:20:15.813202 19395 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:39219 every 8 connection(s)
I20260709 13:20:15.817884  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:15.825659 19400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:15.826653 19401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.829216  8939 server_base.cc:1061] running on GCE node
W20260709 13:20:15.829270 19403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.830618  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:15.830893  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:15.831099  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603215831077 us; error 0 us; skew 500 ppm
I20260709 13:20:15.831773  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:15.833328 19396 heartbeater.cc:344] Connected to a master server at 127.8.186.254:35411
I20260709 13:20:15.833704 19396 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:15.834291  8939 webserver.cc:533] Webserver started at http://127.8.186.194:35271/ using document root <none> and password file <none>
I20260709 13:20:15.834604 19396 heartbeater.cc:507] Master 127.8.186.254:35411 requested a full tablet report, sending...
I20260709 13:20:15.834975  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:15.835264  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:15.835569  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:15.836908  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "57695c4e300e40e2a33e5db1ae797439"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.836938 19269 ts_manager.cc:194] Registered new tserver with Master: b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219)
I20260709 13:20:15.839427 19269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48196
I20260709 13:20:15.842550  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:15.845955 19408 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.846832  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:15.847105  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "57695c4e300e40e2a33e5db1ae797439"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.847339  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:15.868059  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:15.869234  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:15.870633  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:15.872839  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:15.873027  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.873251  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:15.873386  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.911526  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:33453
I20260709 13:20:15.911630 19470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:33453 every 8 connection(s)
I20260709 13:20:15.916152  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:15.923096 19474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:15.924598 19475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.930418 19471 heartbeater.cc:344] Connected to a master server at 127.8.186.254:35411
I20260709 13:20:15.931104 19471 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:15.932312 19471 heartbeater.cc:507] Master 127.8.186.254:35411 requested a full tablet report, sending...
W20260709 13:20:15.933620 19477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:15.933651  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:15.934392 19269 ts_manager.cc:194] Registered new tserver with Master: 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:15.934996  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:15.935288  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:15.935487  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603215935468 us; error 0 us; skew 500 ppm
I20260709 13:20:15.936262  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:15.936262 19269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48204
I20260709 13:20:15.939050  8939 webserver.cc:533] Webserver started at http://127.8.186.195:35521/ using document root <none> and password file <none>
I20260709 13:20:15.939500  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:15.939677  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:15.940001  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:15.941148  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "ad07500f78b44548bedd957abeb97fee"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.945426  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:20:15.948606 19482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.949407  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:15.949676  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "ad07500f78b44548bedd957abeb97fee"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:15.949941  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:15.961294  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:15.962455  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:15.963882  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:15.965988  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:15.966172  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:15.966382  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:15.966524  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:16.004774  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:40149
I20260709 13:20:16.004896 19544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:40149 every 8 connection(s)
I20260709 13:20:16.017398 19545 heartbeater.cc:344] Connected to a master server at 127.8.186.254:35411
I20260709 13:20:16.017841 19545 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:16.018527 19545 heartbeater.cc:507] Master 127.8.186.254:35411 requested a full tablet report, sending...
I20260709 13:20:16.020462 19269 ts_manager.cc:194] Registered new tserver with Master: ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.021238  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013358249s
I20260709 13:20:16.021780 19269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48208
I20260709 13:20:16.044756 19269 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48218:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:16.047501 19269 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:16.115320 19436 tablet_service.cc:1511] Processing CreateTablet for tablet 760b76838bc745b78197c565c851b817 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:16.116403 19510 tablet_service.cc:1511] Processing CreateTablet for tablet 760b76838bc745b78197c565c851b817 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:16.117786 19510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760b76838bc745b78197c565c851b817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.118145 19435 tablet_service.cc:1511] Processing CreateTablet for tablet c4e48ec95c684c2394436df2e199c413 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:16.116804 19436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760b76838bc745b78197c565c851b817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.120836 19509 tablet_service.cc:1511] Processing CreateTablet for tablet c4e48ec95c684c2394436df2e199c413 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:16.121783 19360 tablet_service.cc:1511] Processing CreateTablet for tablet c4e48ec95c684c2394436df2e199c413 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:16.123150 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e48ec95c684c2394436df2e199c413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.123430 19358 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff73d14242f4e7688ff86e8299602d9 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:16.124728 19358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff73d14242f4e7688ff86e8299602d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.125962 19433 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff73d14242f4e7688ff86e8299602d9 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:16.127374 19433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff73d14242f4e7688ff86e8299602d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.122184 19509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e48ec95c684c2394436df2e199c413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.128127 19432 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbe992d3d7c4c4db03e643990d99939 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:16.129055 19508 tablet_service.cc:1511] Processing CreateTablet for tablet d6a450e1da164221b76494bca73d5ab0 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:16.130463 19508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a450e1da164221b76494bca73d5ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.128196 19357 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbe992d3d7c4c4db03e643990d99939 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:16.131073 19359 tablet_service.cc:1511] Processing CreateTablet for tablet d6a450e1da164221b76494bca73d5ab0 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:16.132071 19357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe992d3d7c4c4db03e643990d99939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.133698 19356 tablet_service.cc:1511] Processing CreateTablet for tablet e1231680e561412fbea1243b9729f527 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:16.135017 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1231680e561412fbea1243b9729f527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.136054 19431 tablet_service.cc:1511] Processing CreateTablet for tablet e1231680e561412fbea1243b9729f527 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:16.136463 19434 tablet_service.cc:1511] Processing CreateTablet for tablet d6a450e1da164221b76494bca73d5ab0 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:16.124635 19361 tablet_service.cc:1511] Processing CreateTablet for tablet 760b76838bc745b78197c565c851b817 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:16.138928 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760b76838bc745b78197c565c851b817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.140827 19505 tablet_service.cc:1511] Processing CreateTablet for tablet e1231680e561412fbea1243b9729f527 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:16.142256 19505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1231680e561412fbea1243b9729f527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.130774 19506 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbe992d3d7c4c4db03e643990d99939 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:16.144863 19506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe992d3d7c4c4db03e643990d99939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.129509 19432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe992d3d7c4c4db03e643990d99939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.123334 19507 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff73d14242f4e7688ff86e8299602d9 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:16.148308 19507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff73d14242f4e7688ff86e8299602d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.149482 19355 tablet_service.cc:1511] Processing CreateTablet for tablet 7b493ff1c3a34ae8b08fc04bdc4b0e24 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:16.150475 19435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4e48ec95c684c2394436df2e199c413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.151873 19354 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9cf8cbeaa44332a57a5e5339586a1c (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:16.152902 19503 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9cf8cbeaa44332a57a5e5339586a1c (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:16.154206 19503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9cf8cbeaa44332a57a5e5339586a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.154081 19353 tablet_service.cc:1511] Processing CreateTablet for tablet 40424916b95848bd97d2e30a1def1fd7 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:16.156242 19429 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9cf8cbeaa44332a57a5e5339586a1c (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:16.157552 19429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9cf8cbeaa44332a57a5e5339586a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.160949 19428 tablet_service.cc:1511] Processing CreateTablet for tablet 40424916b95848bd97d2e30a1def1fd7 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:16.162292 19428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40424916b95848bd97d2e30a1def1fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.163410 19502 tablet_service.cc:1511] Processing CreateTablet for tablet 40424916b95848bd97d2e30a1def1fd7 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:16.150142 19430 tablet_service.cc:1511] Processing CreateTablet for tablet 7b493ff1c3a34ae8b08fc04bdc4b0e24 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:16.166520 19504 tablet_service.cc:1511] Processing CreateTablet for tablet 7b493ff1c3a34ae8b08fc04bdc4b0e24 (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:16.167872 19504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b493ff1c3a34ae8b08fc04bdc4b0e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.172290 19502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40424916b95848bd97d2e30a1def1fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.176715 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a450e1da164221b76494bca73d5ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.177868 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b493ff1c3a34ae8b08fc04bdc4b0e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.180092 19431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1231680e561412fbea1243b9729f527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.180681 19353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40424916b95848bd97d2e30a1def1fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.183534 19430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b493ff1c3a34ae8b08fc04bdc4b0e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.184158 19354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9cf8cbeaa44332a57a5e5339586a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.188149 19434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a450e1da164221b76494bca73d5ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.280645 19560 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.283378 19353 tablet_service.cc:1511] Processing CreateTablet for tablet 1b999ccda0e34f48bc4b3306902160eb (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:16.286242 19353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b999ccda0e34f48bc4b3306902160eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.286178 19428 tablet_service.cc:1511] Processing CreateTablet for tablet 1b999ccda0e34f48bc4b3306902160eb (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:16.310910 19428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b999ccda0e34f48bc4b3306902160eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.310395 19505 tablet_service.cc:1511] Processing CreateTablet for tablet 1b999ccda0e34f48bc4b3306902160eb (DEFAULT_TABLE table=test-workload [id=5150c6e6254d4e2eb258142defae2f6c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:16.321405 19562 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.321486 19561 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.322118 19505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b999ccda0e34f48bc4b3306902160eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:16.339362 19562 tablet_bootstrap.cc:654] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.345574 19561 tablet_bootstrap.cc:654] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.351454 19560 tablet_bootstrap.cc:654] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.374601 19562 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.375145 19562 ts_tablet_manager.cc:1403] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.006s
I20260709 13:20:16.378130 19562 raft_consensus.cc:359] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.385838 19562 raft_consensus.cc:385] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.383860 19560 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.386219 19562 raft_consensus.cc:740] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.386832 19560 ts_tablet_manager.cc:1403] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.004s
I20260709 13:20:16.387121 19562 consensus_queue.cc:260] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.390552 19560 raft_consensus.cc:359] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.391520 19560 raft_consensus.cc:385] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.391884 19560 raft_consensus.cc:740] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.392709 19560 consensus_queue.cc:260] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.393574 19561 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.394068 19561 ts_tablet_manager.cc:1403] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.000s
I20260709 13:20:16.395157 19471 heartbeater.cc:499] Master 127.8.186.254:35411 was elected leader, sending a full tablet report...
I20260709 13:20:16.397002 19561 raft_consensus.cc:359] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.397799 19561 raft_consensus.cc:385] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.398029 19561 raft_consensus.cc:740] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.398666 19561 consensus_queue.cc:260] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.400542 19560 ts_tablet_manager.cc:1434] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:20:16.401194 19562 ts_tablet_manager.cc:1434] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.012s
I20260709 13:20:16.402055 19560 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.402115 19545 heartbeater.cc:499] Master 127.8.186.254:35411 was elected leader, sending a full tablet report...
I20260709 13:20:16.405202 19567 raft_consensus.cc:493] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.405831 19567 raft_consensus.cc:515] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.408303 19562 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
W20260709 13:20:16.415928 19472 tablet.cc:2406] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:16.415917 19562 tablet_bootstrap.cc:654] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.417614 19567 leader_election.cc:290] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.418435 19560 tablet_bootstrap.cc:654] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.421779 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe992d3d7c4c4db03e643990d99939" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
W20260709 13:20:16.423990 19411 leader_election.cc:343] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.439281 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe992d3d7c4c4db03e643990d99939" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
W20260709 13:20:16.441802 19410 leader_election.cc:343] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.442484 19410 leader_election.cc:304] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439; no voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.443483 19567 raft_consensus.cc:2749] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:16.446185 19560 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.446897 19560 ts_tablet_manager.cc:1403] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.013s
I20260709 13:20:16.450748 19560 raft_consensus.cc:359] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.451658 19560 raft_consensus.cc:385] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.452064 19560 raft_consensus.cc:740] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.453130 19560 consensus_queue.cc:260] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.455662 19560 ts_tablet_manager.cc:1434] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:16.456983 19560 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.464198 19560 tablet_bootstrap.cc:654] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.468775 19396 heartbeater.cc:499] Master 127.8.186.254:35411 was elected leader, sending a full tablet report...
I20260709 13:20:16.470842 19562 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.471329 19562 ts_tablet_manager.cc:1403] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.063s	user 0.027s	sys 0.026s
I20260709 13:20:16.473874 19561 ts_tablet_manager.cc:1434] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.079s	user 0.012s	sys 0.034s
I20260709 13:20:16.474474 19560 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.474224 19562 raft_consensus.cc:359] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.475111 19560 ts_tablet_manager.cc:1403] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 13:20:16.475250 19561 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.475162 19562 raft_consensus.cc:385] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.475950 19562 raft_consensus.cc:740] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.476820 19562 consensus_queue.cc:260] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.478381 19560 raft_consensus.cc:359] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.479060 19562 ts_tablet_manager.cc:1434] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:20:16.479236 19560 raft_consensus.cc:385] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.479696 19560 raft_consensus.cc:740] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.480245 19562 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.480660 19560 consensus_queue.cc:260] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.482973 19561 tablet_bootstrap.cc:654] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.483009 19560 ts_tablet_manager.cc:1434] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:16.484452 19560 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.487394 19562 tablet_bootstrap.cc:654] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.491173 19560 tablet_bootstrap.cc:654] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.495302 19561 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.496115 19561 ts_tablet_manager.cc:1403] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:20:16.499369 19562 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.500092 19562 ts_tablet_manager.cc:1403] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:20:16.499791 19561 raft_consensus.cc:359] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.500924 19561 raft_consensus.cc:385] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.501325 19561 raft_consensus.cc:740] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.502395 19561 consensus_queue.cc:260] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.503263 19562 raft_consensus.cc:359] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.504228 19562 raft_consensus.cc:385] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.504580 19562 raft_consensus.cc:740] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.505187 19561 ts_tablet_manager.cc:1434] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:16.505628 19562 consensus_queue.cc:260] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.506567 19561 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.508335 19562 ts_tablet_manager.cc:1434] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:20:16.509560 19562 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.514196 19568 raft_consensus.cc:493] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.514871 19568 raft_consensus.cc:515] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.515764 19562 tablet_bootstrap.cc:654] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.544214 19568 leader_election.cc:290] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.552270 19560 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.553035 19560 ts_tablet_manager.cc:1403] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.069s	user 0.028s	sys 0.026s
I20260709 13:20:16.554334 19562 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.554394 19561 tablet_bootstrap.cc:654] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.555132 19562 ts_tablet_manager.cc:1403] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.014s
I20260709 13:20:16.556270 19560 raft_consensus.cc:359] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.557096 19560 raft_consensus.cc:385] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.557439 19560 raft_consensus.cc:740] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.558238 19562 raft_consensus.cc:359] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.558378 19560 consensus_queue.cc:260] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.559120 19562 raft_consensus.cc:385] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.559545 19562 raft_consensus.cc:740] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.563026 19560 ts_tablet_manager.cc:1434] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:20:16.564204 19560 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.560495 19562 consensus_queue.cc:260] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.568691 19446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.568987 19562 ts_tablet_manager.cc:1434] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:20:16.570892 19560 tablet_bootstrap.cc:654] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.574646 19562 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
W20260709 13:20:16.577275 19337 leader_election.cc:343] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.579346 19561 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.580199 19561 ts_tablet_manager.cc:1403] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.005s
I20260709 13:20:16.581950 19562 tablet_bootstrap.cc:654] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.584177 19561 raft_consensus.cc:359] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.587829 19560 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.587909 19561 raft_consensus.cc:385] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.588428 19561 raft_consensus.cc:740] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.588630 19560 ts_tablet_manager.cc:1403] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:20:16.589219 19561 consensus_queue.cc:260] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.591912 19561 ts_tablet_manager.cc:1434] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:20:16.592114 19560 raft_consensus.cc:359] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.592988 19560 raft_consensus.cc:385] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.593037 19561 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.593416 19560 raft_consensus.cc:740] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.594341 19560 consensus_queue.cc:260] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.632179 19567 raft_consensus.cc:493] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.634291 19567 raft_consensus.cc:515] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.640810 19566 raft_consensus.cc:493] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.642052 19566 raft_consensus.cc:515] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.644483 19562 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.645141 19561 tablet_bootstrap.cc:654] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.648237 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:16.645684 19562 ts_tablet_manager.cc:1403] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.017s
I20260709 13:20:16.646862 19560 ts_tablet_manager.cc:1434] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
W20260709 13:20:16.653100 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:16.654424 19560 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
W20260709 13:20:16.656080 19335 leader_election.cc:343] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.657984 19335 leader_election.cc:304] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5c5c5bd5d0043b1a81647121e3622dc; no voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee
I20260709 13:20:16.657184 19568 raft_consensus.cc:493] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.664433 19568 raft_consensus.cc:515] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.668731 19568 leader_election.cc:290] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.669665 19562 raft_consensus.cc:359] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.670956 19562 raft_consensus.cc:385] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.671458 19562 raft_consensus.cc:740] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.672518 19562 consensus_queue.cc:260] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.663885 19560 tablet_bootstrap.cc:654] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.674161 19446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.678450 19566 leader_election.cc:290] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:16.675724 19568 raft_consensus.cc:2749] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:16.680379 19337 leader_election.cc:343] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.682271 19567 leader_election.cc:290] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.683670 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
W20260709 13:20:16.685851 19411 leader_election.cc:343] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.687489 19567 raft_consensus.cc:493] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.690104 19567 raft_consensus.cc:515] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.693445 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:16.693686 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.694624 19520 raft_consensus.cc:2468] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5c5c5bd5d0043b1a81647121e3622dc in term 0.
I20260709 13:20:16.694717 19371 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 0.
I20260709 13:20:16.695580 19561 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.695991 19519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:16.696429 19561 ts_tablet_manager.cc:1403] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.104s	user 0.034s	sys 0.013s
I20260709 13:20:16.696604 19411 leader_election.cc:304] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:16.696838 19519 raft_consensus.cc:2468] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 0.
I20260709 13:20:16.697707 19560 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.698333 19560 ts_tablet_manager.cc:1403] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.007s
I20260709 13:20:16.698665 19410 leader_election.cc:304] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.700332 19561 raft_consensus.cc:359] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.701300 19561 raft_consensus.cc:385] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.701611 19561 raft_consensus.cc:740] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.702206 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:16.703156 19561 consensus_queue.cc:260] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.703431 19335 leader_election.cc:304] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:16.707775 19568 raft_consensus.cc:2804] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:16.702445 19567 leader_election.cc:290] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.708163 19568 raft_consensus.cc:493] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.708586 19568 raft_consensus.cc:3060] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.708640 19567 raft_consensus.cc:2804] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:16.706630 19562 ts_tablet_manager.cc:1434] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:20:16.709350 19567 raft_consensus.cc:493] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.702260 19560 raft_consensus.cc:359] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.710403 19560 raft_consensus.cc:385] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.710705 19560 raft_consensus.cc:740] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.713699 19590 raft_consensus.cc:2804] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:16.714217 19590 raft_consensus.cc:493] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.714586 19590 raft_consensus.cc:3060] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:16.716614 19410 leader_election.cc:343] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.711529 19560 consensus_queue.cc:260] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.720448 19560 ts_tablet_manager.cc:1434] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:20:16.721894 19561 ts_tablet_manager.cc:1434] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:20:16.726617 19561 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.728708 19560 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.722879 19568 raft_consensus.cc:515] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.723850 19562 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.733623 19568 leader_election.cc:290] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 election: Requested vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.710397 19567 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.734300 19568 raft_consensus.cc:493] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.734802 19568 raft_consensus.cc:515] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.736606 19446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:16.736580 19588 raft_consensus.cc:493] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.738626 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.738997 19588 raft_consensus.cc:515] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.740296 19568 leader_election.cc:290] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.741074 19446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.741767 19561 tablet_bootstrap.cc:654] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.742676 19560 tablet_bootstrap.cc:654] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:16.739831 19337 leader_election.cc:343] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.739226 19590 raft_consensus.cc:515] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.747638 19445 raft_consensus.cc:2393] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5c5c5bd5d0043b1a81647121e3622dc in current term 1: Already voted for candidate 57695c4e300e40e2a33e5db1ae797439 in this term.
I20260709 13:20:16.748682 19561 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.749795 19561 ts_tablet_manager.cc:1403] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 13:20:16.751616 19588 leader_election.cc:290] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:16.751222 19446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
W20260709 13:20:16.757452 19486 leader_election.cc:343] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.757273 19561 raft_consensus.cc:359] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.758152 19561 raft_consensus.cc:385] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.758520 19561 raft_consensus.cc:740] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.759516 19561 consensus_queue.cc:260] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
W20260709 13:20:16.759995 19335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:40149, user_credentials={real_user=slave}} blocked reactor thread for 56689.4us
I20260709 13:20:16.760326 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:16.766525 19562 tablet_bootstrap.cc:654] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.766932 19371 raft_consensus.cc:3060] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.767994 19519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:16.768626 19519 raft_consensus.cc:3060] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.773077 19588 raft_consensus.cc:493] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.774072 19588 raft_consensus.cc:515] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.774991 19562 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.775583 19562 ts_tablet_manager.cc:1403] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.001s
I20260709 13:20:16.760552 19590 leader_election.cc:290] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.763479 19560 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.776830 19560 ts_tablet_manager.cc:1403] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.015s
I20260709 13:20:16.777402 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760b76838bc745b78197c565c851b817" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.777937 19371 raft_consensus.cc:2468] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:16.778282 19445 raft_consensus.cc:2468] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:16.778982 19562 raft_consensus.cc:359] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.779444 19411 leader_election.cc:304] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:16.779757 19486 leader_election.cc:304] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: 
I20260709 13:20:16.762257 19561 ts_tablet_manager.cc:1434] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:20:16.780140 19560 raft_consensus.cc:359] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.761765 19520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:16.780882 19566 raft_consensus.cc:2804] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:16.781096 19520 raft_consensus.cc:3060] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.781571 19566 raft_consensus.cc:493] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.780431 19590 raft_consensus.cc:2804] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:16.779819 19562 raft_consensus.cc:385] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.782837 19562 raft_consensus.cc:740] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.782927 19590 raft_consensus.cc:697] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:16.783792 19562 consensus_queue.cc:260] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.784119 19590 consensus_queue.cc:237] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.781983 19561 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.781984 19566 raft_consensus.cc:3060] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.765609 19567 raft_consensus.cc:515] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.780920 19560 raft_consensus.cc:385] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.792317 19561 tablet_bootstrap.cc:654] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.792235 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:16.792371 19560 raft_consensus.cc:740] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.793092 19518 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.793409 19588 leader_election.cc:290] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219)
I20260709 13:20:16.794247 19567 leader_election.cc:290] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.796169 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:16.796923 19371 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.797293 19560 consensus_queue.cc:260] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.800612 19560 ts_tablet_manager.cc:1434] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:20:16.806808 19519 raft_consensus.cc:2468] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c5c5bd5d0043b1a81647121e3622dc in term 1.
I20260709 13:20:16.805400 19566 raft_consensus.cc:515] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.815603 19335 leader_election.cc:304] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:16.807498 19560 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.808672 19562 ts_tablet_manager.cc:1434] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 13:20:16.809321 19517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:16.818470 19562 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.809640 19371 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:16.811576 19520 raft_consensus.cc:2468] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:16.812638 19561 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.821372 19561 ts_tablet_manager.cc:1403] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.005s
I20260709 13:20:16.821744 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760b76838bc745b78197c565c851b817" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:16.822556 19445 raft_consensus.cc:3060] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.824301 19411 leader_election.cc:304] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:16.813333 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4e48ec95c684c2394436df2e199c413" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.813706 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.826242 19370 raft_consensus.cc:2393] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad07500f78b44548bedd957abeb97fee in current term 1: Already voted for candidate 57695c4e300e40e2a33e5db1ae797439 in this term.
I20260709 13:20:16.814013 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760b76838bc745b78197c565c851b817" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.826881 19368 raft_consensus.cc:2468] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:16.803133 19518 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:16.825587 19567 raft_consensus.cc:2804] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:16.828234 19567 raft_consensus.cc:697] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:16.827540 19269 catalog_manager.cc:5697] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.829445 19567 consensus_queue.cc:237] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.830227 19560 tablet_bootstrap.cc:654] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.833236 19566 leader_election.cc:290] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Requested vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219)
I20260709 13:20:16.833858 19591 raft_consensus.cc:2804] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:16.835557 19591 raft_consensus.cc:697] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 LEADER]: Becoming Leader. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Running, Role: LEADER
I20260709 13:20:16.836839 19591 consensus_queue.cc:237] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.838264 19562 tablet_bootstrap.cc:654] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.836994 19561 raft_consensus.cc:359] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
W20260709 13:20:16.842583 19485 leader_election.cc:343] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.843171 19485 leader_election.cc:304] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad07500f78b44548bedd957abeb97fee; no voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.841738 19561 raft_consensus.cc:385] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.845957 19561 raft_consensus.cc:740] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.845230 19566 raft_consensus.cc:2749] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:16.848371 19561 consensus_queue.cc:260] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.853024 19561 ts_tablet_manager.cc:1434] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:20:16.854074 19485 leader_election.cc:304] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad07500f78b44548bedd957abeb97fee; no voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.853338 19268 catalog_manager.cc:5697] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc reported cstate change: term changed from 0 to 1, leader changed from <none> to b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193). New cstate: current_term: 1 leader_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.861053 19562 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.861594 19562 ts_tablet_manager.cc:1403] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.012s
I20260709 13:20:16.861888 19560 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.862423 19560 ts_tablet_manager.cc:1403] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.007s
I20260709 13:20:16.858328 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760b76838bc745b78197c565c851b817" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:16.862866 19561 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.863045 19368 raft_consensus.cc:3060] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.861629 19566 raft_consensus.cc:2749] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:16.859261 19335 leader_election.cc:304] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5c5c5bd5d0043b1a81647121e3622dc; no voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee
I20260709 13:20:16.867493 19591 raft_consensus.cc:2749] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:16.865572 19445 raft_consensus.cc:2468] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:16.866267 19560 raft_consensus.cc:359] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.869871 19486 leader_election.cc:304] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: 
I20260709 13:20:16.870039 19560 raft_consensus.cc:385] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.870756 19566 raft_consensus.cc:2804] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:16.872352 19566 raft_consensus.cc:697] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:16.873564 19566 consensus_queue.cc:237] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:16.874542 19560 raft_consensus.cc:740] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.876088 19560 consensus_queue.cc:260] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.878878 19560 ts_tablet_manager.cc:1434] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.002s
I20260709 13:20:16.879329 19368 raft_consensus.cc:2468] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:16.874542 19562 raft_consensus.cc:359] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.881526 19562 raft_consensus.cc:385] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.882112 19562 raft_consensus.cc:740] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.883073 19562 consensus_queue.cc:260] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.886498 19266 catalog_manager.cc:5697] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 1 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.888576 19562 ts_tablet_manager.cc:1434] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:20:16.889943 19562 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.884270 19561 tablet_bootstrap.cc:654] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.885169 19560 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.894273 19566 raft_consensus.cc:493] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.894891 19566 raft_consensus.cc:515] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.898005 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.898350 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.899202 19445 raft_consensus.cc:2468] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
W20260709 13:20:16.899633 19485 leader_election.cc:343] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.899860 19562 tablet_bootstrap.cc:654] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.900594 19486 leader_election.cc:304] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.901705 19595 raft_consensus.cc:2804] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:16.902087 19595 raft_consensus.cc:493] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.902416 19595 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.903466 19560 tablet_bootstrap.cc:654] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.917491 19269 catalog_manager.cc:5697] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.909565 19566 leader_election.cc:290] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:16.921906 19562 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.922528 19562 ts_tablet_manager.cc:1403] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.002s
I20260709 13:20:16.922758 19560 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.923300 19560 ts_tablet_manager.cc:1403] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.001s
I20260709 13:20:16.925545 19562 raft_consensus.cc:359] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.926524 19562 raft_consensus.cc:385] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.926163 19560 raft_consensus.cc:359] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.926956 19560 raft_consensus.cc:385] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.918532 19595 raft_consensus.cc:515] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.927249 19560 raft_consensus.cc:740] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.928068 19560 consensus_queue.cc:260] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.930248 19560 ts_tablet_manager.cc:1434] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:20:16.930157 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:16.931676 19560 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439: Bootstrap starting.
I20260709 13:20:16.926822 19562 raft_consensus.cc:740] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
W20260709 13:20:16.932255 19485 leader_election.cc:343] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.932232 19567 raft_consensus.cc:493] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.933231 19562 consensus_queue.cc:260] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.933493 19567 raft_consensus.cc:515] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.935976 19562 ts_tablet_manager.cc:1434] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:20:16.937562 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.937803 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
W20260709 13:20:16.939869 19411 leader_election.cc:343] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.935936 19567 leader_election.cc:290] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:16.940001 19562 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
W20260709 13:20:16.941123 19410 leader_election.cc:343] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:16.941646 19410 leader_election.cc:304] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439; no voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.942871 19567 raft_consensus.cc:2749] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:16.945463 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:16.946234 19445 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.949116 19562 tablet_bootstrap.cc:654] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.949966 19560 tablet_bootstrap.cc:654] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.954655 19562 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.954767 19445 raft_consensus.cc:2468] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:16.955180 19562 ts_tablet_manager.cc:1403] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:20:16.956372 19486 leader_election.cc:304] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:16.957268 19561 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:16.957428 19566 raft_consensus.cc:2804] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:16.957880 19561 ts_tablet_manager.cc:1403] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.010s
I20260709 13:20:16.957966 19566 raft_consensus.cc:697] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:16.958889 19566 consensus_queue.cc:237] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.961184 19561 raft_consensus.cc:359] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.961968 19561 raft_consensus.cc:385] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.962275 19561 raft_consensus.cc:740] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.963853 19595 leader_election.cc:290] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:16.963187 19561 consensus_queue.cc:260] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.964277 19562 raft_consensus.cc:359] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.966682 19562 raft_consensus.cc:385] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.967088 19562 raft_consensus.cc:740] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.966779 19561 ts_tablet_manager.cc:1434] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:16.968019 19562 consensus_queue.cc:260] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.969575 19561 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:16.970173 19562 ts_tablet_manager.cc:1434] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:20:16.971349 19560 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439: No bootstrap required, opened a new log
I20260709 13:20:16.971850 19560 ts_tablet_manager.cc:1403] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.012s
I20260709 13:20:16.974643 19560 raft_consensus.cc:359] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.975335 19560 raft_consensus.cc:385] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.975617 19560 raft_consensus.cc:740] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.976362 19560 consensus_queue.cc:260] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.978796 19560 ts_tablet_manager.cc:1434] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:16.979897 19566 raft_consensus.cc:493] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.980446 19566 raft_consensus.cc:515] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.971422 19562 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: Bootstrap starting.
I20260709 13:20:16.983505 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:16.984282 19368 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:16.985447 19485 leader_election.cc:304] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:16.987191 19595 raft_consensus.cc:2804] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:16.986423 19268 catalog_manager.cc:5697] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 1 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.987643 19595 raft_consensus.cc:493] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.988065 19595 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:16.989769 19562 tablet_bootstrap.cc:654] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:16.983546 19566 leader_election.cc:290] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:16.983911 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:16.993903 19445 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:16.995266 19562 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: No bootstrap required, opened a new log
I20260709 13:20:16.995828 19562 ts_tablet_manager.cc:1403] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.005s
I20260709 13:20:16.996342 19595 raft_consensus.cc:515] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.998728 19562 raft_consensus.cc:359] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:16.999155 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:16.999527 19562 raft_consensus.cc:385] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:16.999162 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:16.999955 19562 raft_consensus.cc:740] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Initialized, Role: FOLLOWER
I20260709 13:20:16.999982 19368 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.000155 19445 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.001641 19562 consensus_queue.cc:260] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.004067 19562 ts_tablet_manager.cc:1434] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:17.004206 19567 raft_consensus.cc:493] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.004738 19567 raft_consensus.cc:515] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.006980 19567 leader_election.cc:290] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:17.007823 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:17.008669 19445 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:17.009033 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:17.009776 19518 raft_consensus.cc:2393] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57695c4e300e40e2a33e5db1ae797439 in current term 1: Already voted for candidate b5c5c5bd5d0043b1a81647121e3622dc in this term.
I20260709 13:20:17.010794 19486 leader_election.cc:304] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: 
I20260709 13:20:17.011662 19566 raft_consensus.cc:2804] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:17.012172 19566 raft_consensus.cc:697] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:17.012600 19561 tablet_bootstrap.cc:654] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:17.013134 19566 consensus_queue.cc:237] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.016160 19410 leader_election.cc:304] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439; no voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:17.016346 19595 leader_election.cc:290] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:17.017099 19561 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:17.017053 19567 raft_consensus.cc:3060] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.017740 19561 ts_tablet_manager.cc:1403] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.049s	user 0.004s	sys 0.009s
I20260709 13:20:17.016052 19368 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:17.019959 19561 raft_consensus.cc:359] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.020645 19561 raft_consensus.cc:385] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:17.020939 19561 raft_consensus.cc:740] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:17.021806 19561 consensus_queue.cc:260] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.023717 19561 ts_tablet_manager.cc:1434] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:17.025188 19561 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:17.028126 19567 raft_consensus.cc:2749] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:17.028455 19268 catalog_manager.cc:5697] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 1 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.030920 19561 tablet_bootstrap.cc:654] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:17.037110 19561 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:17.037621 19561 ts_tablet_manager.cc:1403] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:20:17.039786 19561 raft_consensus.cc:359] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.040290 19561 raft_consensus.cc:385] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:17.040459 19561 raft_consensus.cc:740] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:17.040948 19561 consensus_queue.cc:260] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.042367 19561 ts_tablet_manager.cc:1434] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:17.043530 19561 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:17.048220 19561 tablet_bootstrap.cc:654] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:17.053478 19561 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: No bootstrap required, opened a new log
I20260709 13:20:17.053857 19561 ts_tablet_manager.cc:1403] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:17.055878 19561 raft_consensus.cc:359] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.056347 19561 raft_consensus.cc:385] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:17.056514 19561 raft_consensus.cc:740] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:17.057076 19561 consensus_queue.cc:260] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.058511 19561 ts_tablet_manager.cc:1434] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:17.108434 19591 raft_consensus.cc:493] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.108922 19591 raft_consensus.cc:515] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.110625 19591 leader_election.cc:290] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:17.111377 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:17.111697 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:17.112277 19445 raft_consensus.cc:2393] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5c5c5bd5d0043b1a81647121e3622dc in current term 1: Already voted for candidate ad07500f78b44548bedd957abeb97fee in this term.
I20260709 13:20:17.113299 19337 leader_election.cc:304] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5c5c5bd5d0043b1a81647121e3622dc; no voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee
I20260709 13:20:17.113958 19591 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.120697 19591 raft_consensus.cc:2749] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:17.133359 19566 raft_consensus.cc:493] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.133944 19566 raft_consensus.cc:515] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.135731 19566 leader_election.cc:290] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:17.136605 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:17.136741 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:17.137209 19368 raft_consensus.cc:2468] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:17.137360 19445 raft_consensus.cc:2468] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:17.138164 19485 leader_election.cc:304] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:17.138890 19566 raft_consensus.cc:2804] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:17.139180 19566 raft_consensus.cc:493] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.139436 19566 raft_consensus.cc:3060] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.144984 19566 raft_consensus.cc:515] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.146571 19566 leader_election.cc:290] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:17.147543 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:17.147639 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:17.148219 19368 raft_consensus.cc:3060] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.148299 19445 raft_consensus.cc:3060] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.151896 19567 raft_consensus.cc:493] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.152483 19567 raft_consensus.cc:515] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.154192 19368 raft_consensus.cc:2468] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:17.154639 19567 leader_election.cc:290] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:17.155381 19485 leader_election.cc:304] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:17.155470 19445 raft_consensus.cc:2468] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:17.155472 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:17.156291 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:17.156364 19368 raft_consensus.cc:2468] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 0.
I20260709 13:20:17.156440 19566 raft_consensus.cc:2804] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:17.157104 19518 raft_consensus.cc:2468] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 0.
I20260709 13:20:17.157599 19566 raft_consensus.cc:697] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:17.158309 19410 leader_election.cc:304] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: 
I20260709 13:20:17.158453 19566 consensus_queue.cc:237] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.158980 19567 raft_consensus.cc:2804] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:17.159322 19567 raft_consensus.cc:493] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.159569 19567 raft_consensus.cc:3060] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.165784 19567 raft_consensus.cc:515] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.165962 19268 catalog_manager.cc:5697] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 1 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.167362 19567 leader_election.cc:290] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:17.168211 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:17.168434 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:17.168738 19368 raft_consensus.cc:3060] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.168998 19518 raft_consensus.cc:3060] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.175292 19368 raft_consensus.cc:2468] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:17.175344 19518 raft_consensus.cc:2468] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:17.176573 19411 leader_election.cc:304] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:17.177330 19567 raft_consensus.cc:2804] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:17.177785 19567 raft_consensus.cc:697] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:17.178573 19567 consensus_queue.cc:237] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.186517 19268 catalog_manager.cc:5697] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.206681 19567 raft_consensus.cc:493] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.207259 19567 raft_consensus.cc:515] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.209138 19567 leader_election.cc:290] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:17.209936 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:17.210103 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:17.210577 19368 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 0.
I20260709 13:20:17.210696 19518 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 0.
I20260709 13:20:17.211571 19411 leader_election.cc:304] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:17.212318 19567 raft_consensus.cc:2804] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:17.212611 19567 raft_consensus.cc:493] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.212884 19567 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.218506 19567 raft_consensus.cc:515] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.220229 19567 leader_election.cc:290] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:17.221122 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:17.221241 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:17.221678 19368 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.221824 19518 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.227391 19368 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:17.227388 19518 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:17.229143 19410 leader_election.cc:304] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: 
I20260709 13:20:17.230029 19567 raft_consensus.cc:2804] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:17.230499 19567 raft_consensus.cc:697] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:17.231119 19567 consensus_queue.cc:237] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.238734 19268 catalog_manager.cc:5697] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.242153 19591 consensus_queue.cc:1048] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.252548 19566 raft_consensus.cc:493] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.253087 19566 raft_consensus.cc:515] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.255329 19566 leader_election.cc:290] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:17.257277 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe992d3d7c4c4db03e643990d99939" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" is_pre_election: true
I20260709 13:20:17.258069 19368 raft_consensus.cc:2468] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:17.258678 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe992d3d7c4c4db03e643990d99939" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
I20260709 13:20:17.259286 19445 raft_consensus.cc:2468] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 0.
I20260709 13:20:17.259899 19485 leader_election.cc:304] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:17.260480 19591 consensus_queue.cc:1048] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.261055 19566 raft_consensus.cc:2804] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:17.261422 19566 raft_consensus.cc:493] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.261727 19566 raft_consensus.cc:3060] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.269963 19566 raft_consensus.cc:515] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.271844 19567 consensus_queue.cc:1048] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:17.273985 19566 leader_election.cc:290] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:17.274158 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe992d3d7c4c4db03e643990d99939" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:17.276491 19368 raft_consensus.cc:3060] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.275063 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe992d3d7c4c4db03e643990d99939" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:17.281790 19445 raft_consensus.cc:3060] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:17.283418 19368 raft_consensus.cc:2468] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:17.284559 19485 leader_election.cc:304] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:17.285248 19566 raft_consensus.cc:2804] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:17.285848 19566 raft_consensus.cc:697] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:17.286782 19566 consensus_queue.cc:237] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:17.290310 19445 raft_consensus.cc:2468] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 1.
I20260709 13:20:17.299659 19567 consensus_queue.cc:1048] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.301167 19590 consensus_queue.cc:1048] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.308712 19595 consensus_queue.cc:1048] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:17.314437 19269 catalog_manager.cc:5697] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 1 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.330019 19588 consensus_queue.cc:1048] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.334898 19567 consensus_queue.cc:1048] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.348078  8939 ts_manager.cc:295] Set tserver state for b5c5c5bd5d0043b1a81647121e3622dc to MAINTENANCE_MODE
I20260709 13:20:17.349287  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
I20260709 13:20:17.392397  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:17.393491  8939 tablet_replica.cc:333] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.394071  8939 raft_consensus.cc:2243] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.394562  8939 raft_consensus.cc:2272] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.396901  8939 tablet_replica.cc:333] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.397500  8939 raft_consensus.cc:2243] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.397969  8939 raft_consensus.cc:2272] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.400358  8939 tablet_replica.cc:333] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.400947  8939 raft_consensus.cc:2243] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.401324  8939 raft_consensus.cc:2272] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.403292  8939 tablet_replica.cc:333] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.403916  8939 raft_consensus.cc:2243] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.404294  8939 raft_consensus.cc:2272] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.406386  8939 tablet_replica.cc:333] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.406951  8939 raft_consensus.cc:2243] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.407379  8939 raft_consensus.cc:2272] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.409838  8939 tablet_replica.cc:333] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.410395  8939 raft_consensus.cc:2243] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:17.411233  8939 raft_consensus.cc:2272] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.414222  8939 tablet_replica.cc:333] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.414975  8939 raft_consensus.cc:2243] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.415454  8939 raft_consensus.cc:2272] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.415217 19588 consensus_queue.cc:1048] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.418476  8939 tablet_replica.cc:333] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.419129  8939 raft_consensus.cc:2243] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.419554  8939 raft_consensus.cc:2272] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.424412  8939 tablet_replica.cc:333] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.425259  8939 raft_consensus.cc:2243] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.425833  8939 raft_consensus.cc:2272] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:17.428367  8939 tablet_replica.cc:333] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: stopping tablet replica
I20260709 13:20:17.429028  8939 raft_consensus.cc:2243] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:17.429549  8939 raft_consensus.cc:2272] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:17.431403 19485 consensus_peers.cc:597] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.454898  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
W20260709 13:20:17.494916 19485 consensus_peers.cc:597] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.588285 19595 consensus_queue.cc:1048] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:17.613583 19485 consensus_peers.cc:597] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.629786 19588 consensus_queue.cc:1048] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:17.649202 19411 consensus_peers.cc:597] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:17.654485 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:17.674674 19411 consensus_peers.cc:597] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:17.722364 19411 consensus_peers.cc:597] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.737272 19567 consensus_queue.cc:1048] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:17.740927 19567 consensus_queue.cc:1048] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:17.778434 19485 consensus_peers.cc:597] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:17.845353 19485 consensus_peers.cc:597] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:17.858472 19411 consensus_peers.cc:597] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:17.888911 19566 consensus_queue.cc:1048] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:18.215193 19485 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111) [suppressed 186 similar messages]
W20260709 13:20:18.655553 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:18.754642 19595 raft_consensus.cc:493] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5c5c5bd5d0043b1a81647121e3622dc)
I20260709 13:20:18.755182 19595 raft_consensus.cc:515] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:18.757067 19595 leader_election.cc:290] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:18.758240 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57695c4e300e40e2a33e5db1ae797439" is_pre_election: true
W20260709 13:20:18.760897 19485 leader_election.cc:336] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111)
I20260709 13:20:18.761252 19485 leader_election.cc:304] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad07500f78b44548bedd957abeb97fee; no voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:18.761866 19595 raft_consensus.cc:2749] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:18.764148 19567 raft_consensus.cc:493] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5c5c5bd5d0043b1a81647121e3622dc)
I20260709 13:20:18.764650 19567 raft_consensus.cc:515] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:18.766860 19567 leader_election.cc:290] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:18.767884 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee" is_pre_election: true
I20260709 13:20:18.768594 19518 raft_consensus.cc:2468] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 1.
I20260709 13:20:18.769819 19410 leader_election.cc:304] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: 
I20260709 13:20:18.770499 19567 raft_consensus.cc:2804] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:18.770529 19411 leader_election.cc:336] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111)
I20260709 13:20:18.770895 19567 raft_consensus.cc:493] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5c5c5bd5d0043b1a81647121e3622dc)
I20260709 13:20:18.771229 19567 raft_consensus.cc:3060] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.778100 19567 raft_consensus.cc:515] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:18.780889 19567 leader_election.cc:290] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:18.782891 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1231680e561412fbea1243b9729f527" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:18.783492 19518 raft_consensus.cc:3060] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:18.784922 19411 leader_election.cc:336] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111)
I20260709 13:20:18.789537 19518 raft_consensus.cc:2468] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:18.791050 19410 leader_election.cc:304] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, ad07500f78b44548bedd957abeb97fee; no voters: b5c5c5bd5d0043b1a81647121e3622dc
I20260709 13:20:18.791946 19590 raft_consensus.cc:2804] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:18.792408 19590 raft_consensus.cc:697] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:18.793120 19590 consensus_queue.cc:237] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:18.800558 19265 catalog_manager.cc:5697] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 1 to 2, leader changed from b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193) to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:19.212781 19518 raft_consensus.cc:1275] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.214030 19590 consensus_queue.cc:1048] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:19.231225 19411 consensus_peers.cc:597] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.656466 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:19.840656 19485 consensus_peers.cc:597] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:19.962440 19411 consensus_peers.cc:597] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.155380 19485 consensus_peers.cc:597] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.195084 19411 consensus_peers.cc:597] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.195087 19485 consensus_peers.cc:597] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.200203 19485 consensus_peers.cc:597] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.225823 19485 consensus_peers.cc:597] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.402302 19411 consensus_peers.cc:597] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.535614 19411 consensus_peers.cc:597] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:20.657428 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:21.658715 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:21.905644 19411 consensus_peers.cc:597] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:22.478396  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:22.485280 19654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:22.486917 19655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:22.487087 19485 consensus_peers.cc:597] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:22.491971 19657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:22.492308  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:22.495021  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:22.495242  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:22.495441  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603222495424 us; error 0 us; skew 500 ppm
I20260709 13:20:22.496083  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:22.498755  8939 webserver.cc:533] Webserver started at http://127.8.186.193:36573/ using document root <none> and password file <none>
I20260709 13:20:22.499308  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:22.499495  8939 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:22.503166  8939 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:22.506882 19662 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:22.507603  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:22.507948  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
format_stamp: "Formatted at 2026-07-09 13:20:15 on dist-test-slave-mq27"
I20260709 13:20:22.508303  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:22.519084  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:22.520337  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:22.521808  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:22.525390 19669 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:20:22.569320 19411 consensus_peers.cc:597] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.579576  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:20:22.580005  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.001s	sys 0.001s
I20260709 13:20:22.580382  8939 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:20:22.585292 19669 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.599151 19669 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.600028 19669 tablet_bootstrap.cc:492] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.600679 19669 ts_tablet_manager.cc:1403] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.011s
I20260709 13:20:22.604588 19669 raft_consensus.cc:359] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.605340 19669 raft_consensus.cc:740] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.606148 19669 consensus_queue.cc:260] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.608992 19669 ts_tablet_manager.cc:1434] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:22.609860 19669 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.624112 19669 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.625008 19669 tablet_bootstrap.cc:492] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.625783 19669 ts_tablet_manager.cc:1403] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.009s
I20260709 13:20:22.628594 19669 raft_consensus.cc:359] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.629351 19669 raft_consensus.cc:740] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
W20260709 13:20:22.629503 19485 consensus_peers.cc:597] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.630133 19669 consensus_queue.cc:260] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.632265 19669 ts_tablet_manager.cc:1434] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:22.633070 19669 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.634747  8939 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:20:22.635129  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.055s	user 0.051s	sys 0.000s
I20260709 13:20:22.647801 19669 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.648873 19669 tablet_bootstrap.cc:492] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.649820 19669 ts_tablet_manager.cc:1403] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
W20260709 13:20:22.652665 19485 consensus_peers.cc:597] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.652943 19669 raft_consensus.cc:359] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.654093 19669 raft_consensus.cc:740] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
W20260709 13:20:22.655490 19485 consensus_peers.cc:597] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.655534 19669 consensus_queue.cc:260] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.658344 19669 ts_tablet_manager.cc:1434] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:22.659312 19669 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
W20260709 13:20:22.659646 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:22.672187 19485 consensus_peers.cc:597] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.677866 19669 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.679029 19669 tablet_bootstrap.cc:492] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.679827 19669 ts_tablet_manager.cc:1403] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
W20260709 13:20:22.680557 19411 consensus_peers.cc:597] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:22.682761 19669 raft_consensus.cc:359] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:22.683509 19669 raft_consensus.cc:740] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.684281 19669 consensus_queue.cc:260] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } } peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } }
I20260709 13:20:22.686261 19669 ts_tablet_manager.cc:1434] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:22.687152 19669 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.697181  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:39219
I20260709 13:20:22.697271 19730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:39219 every 8 connection(s)
I20260709 13:20:22.702358 19669 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.702524  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:22.703403 19669 tablet_bootstrap.cc:492] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.704165 19669 ts_tablet_manager.cc:1403] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:20:22.706646 19669 raft_consensus.cc:359] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.707333 19669 raft_consensus.cc:740] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.708176 19669 consensus_queue.cc:260] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.709904 19669 ts_tablet_manager.cc:1434] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:22.710829 19669 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.726812 19669 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.727787 19669 tablet_bootstrap.cc:492] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.728510 19669 ts_tablet_manager.cc:1403] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:20:22.731132 19669 raft_consensus.cc:359] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.731680 19669 raft_consensus.cc:740] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.732445 19669 consensus_queue.cc:260] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.734297 19669 ts_tablet_manager.cc:1434] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:22.734357 19732 heartbeater.cc:344] Connected to a master server at 127.8.186.254:35411
I20260709 13:20:22.734879 19732 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:22.735016 19669 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.735829 19732 heartbeater.cc:507] Master 127.8.186.254:35411 requested a full tablet report, sending...
I20260709 13:20:22.739845 19518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
mode: GRACEFUL
new_leader_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:51350
I20260709 13:20:22.740542 19518 raft_consensus.cc:606] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Received request to transfer leadership to TS 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:22.743462 19265 ts_manager.cc:194] Re-registered known tserver with Master: b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219)
I20260709 13:20:22.752550 19669 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.753288 19669 tablet_bootstrap.cc:492] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.753822 19669 ts_tablet_manager.cc:1403] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:20:22.755633 19669 raft_consensus.cc:359] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.756184 19669 raft_consensus.cc:740] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.756286 19265 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48224
I20260709 13:20:22.756805 19669 consensus_queue.cc:260] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.758728 19669 ts_tablet_manager.cc:1434] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:22.759349 19669 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.760059 19732 heartbeater.cc:499] Master 127.8.186.254:35411 was elected leader, sending a full tablet report...
I20260709 13:20:22.765372 19445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
mode: GRACEFUL
new_leader_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:43526
I20260709 13:20:22.766002 19445 raft_consensus.cc:606] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Received request to transfer leadership to TS ad07500f78b44548bedd957abeb97fee
I20260709 13:20:22.767935  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:22.768581  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:22.769398  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:22.776947 19669 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.777987 19669 tablet_bootstrap.cc:492] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.778713 19669 ts_tablet_manager.cc:1403] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:20:22.780941 19669 raft_consensus.cc:359] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.781440 19669 raft_consensus.cc:740] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.781991 19669 consensus_queue.cc:260] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.783891 19669 ts_tablet_manager.cc:1434] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:22.784934 19669 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.797966 19669 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.798629 19669 tablet_bootstrap.cc:492] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.799178 19669 ts_tablet_manager.cc:1403] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:20:22.801172 19669 raft_consensus.cc:359] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.801640 19669 raft_consensus.cc:740] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.802178 19669 consensus_queue.cc:260] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.803658 19669 ts_tablet_manager.cc:1434] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:22.804396 19669 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap starting.
I20260709 13:20:22.813954 19669 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:22.814512 19669 tablet_bootstrap.cc:492] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Bootstrap complete.
I20260709 13:20:22.815021 19669 ts_tablet_manager.cc:1403] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:20:22.816809 19669 raft_consensus.cc:359] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.817420 19669 raft_consensus.cc:740] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c5c5bd5d0043b1a81647121e3622dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.817925 19669 consensus_queue.cc:260] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:22.819212 19669 ts_tablet_manager.cc:1434] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:20:23.006438 19706 raft_consensus.cc:3060] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.155159 19595 raft_consensus.cc:993] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: : Instructing follower 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:23.155637 19751 raft_consensus.cc:1081] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Signalling peer 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:23.157308 19445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:43518
I20260709 13:20:23.157850 19445 raft_consensus.cc:493] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.158145 19445 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.163869 19445 raft_consensus.cc:515] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:23.165596 19445 leader_election.cc:290] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:23.166433 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:23.166616 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:23.167125 19706 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.167191 19518 raft_consensus.cc:3055] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.167572 19518 raft_consensus.cc:740] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:23.168314 19518 consensus_queue.cc:260] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:23.169317 19518 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.172560 19706 raft_consensus.cc:2468] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:23.173813 19411 leader_election.cc:304] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:23.174823 19650 raft_consensus.cc:2804] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.175566 19518 raft_consensus.cc:2468] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:23.175815 19650 raft_consensus.cc:697] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:23.176750 19650 consensus_queue.cc:237] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:23.184792 19265 catalog_manager.cc:5697] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 1 to 2, leader changed from ad07500f78b44548bedd957abeb97fee (127.8.186.195) to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.328485 19760 raft_consensus.cc:993] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: : Instructing follower ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:23.329015 19752 raft_consensus.cc:1081] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Signalling peer ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:23.330596 19518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:20:23.331081 19518 raft_consensus.cc:493] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.331370 19518 raft_consensus.cc:3060] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.336881 19518 raft_consensus.cc:515] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:23.338580 19518 leader_election.cc:290] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:23.339412 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:23.339638 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff73d14242f4e7688ff86e8299602d9" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:23.340193 19706 raft_consensus.cc:3060] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.340236 19445 raft_consensus.cc:3055] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.340677 19445 raft_consensus.cc:740] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:23.341522 19445 consensus_queue.cc:260] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:23.342839 19445 raft_consensus.cc:3060] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.348376 19706 raft_consensus.cc:2468] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 2.
I20260709 13:20:23.349746 19485 leader_election.cc:304] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:23.350339 19445 raft_consensus.cc:2468] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 2.
I20260709 13:20:23.350519 19751 raft_consensus.cc:2804] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.351050 19751 raft_consensus.cc:697] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:23.351950 19751 consensus_queue.cc:237] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:23.359128 19268 catalog_manager.cc:5697] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 1 to 2, leader changed from 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194) to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 2 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.634438 19518 raft_consensus.cc:1275] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.635761 19752 consensus_queue.cc:1048] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.646497 19706 raft_consensus.cc:1275] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.648687 19650 consensus_queue.cc:1048] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:23.661319 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:23.755338 19445 raft_consensus.cc:1275] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.756835 19762 consensus_queue.cc:1048] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.766809 19706 raft_consensus.cc:1275] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.768431 19751 consensus_queue.cc:1048] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.779721  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:23.789197 19518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
mode: GRACEFUL
new_leader_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:51350
I20260709 13:20:23.789745 19518 raft_consensus.cc:606] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Received request to transfer leadership to TS 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:23.792282 19445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
mode: GRACEFUL
new_leader_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:43526
I20260709 13:20:23.792761 19445 raft_consensus.cc:606] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Received request to transfer leadership to TS ad07500f78b44548bedd957abeb97fee
I20260709 13:20:23.793861  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:23.794457  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:23.795209  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:24.035087 19760 raft_consensus.cc:993] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: : Instructing follower ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:24.035558 19752 raft_consensus.cc:1081] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Signalling peer ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:24.037002 19518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:20:24.037418 19518 raft_consensus.cc:493] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:24.037643 19518 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.042632 19518 raft_consensus.cc:515] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:24.044154 19518 leader_election.cc:290] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:24.045042 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:24.045080 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:24.045771 19706 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.045838 19445 raft_consensus.cc:3055] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.046202 19445 raft_consensus.cc:740] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:24.046804 19445 consensus_queue.cc:260] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:24.047683 19445 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.051381 19706 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 2.
I20260709 13:20:24.052544 19445 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 2.
I20260709 13:20:24.052515 19485 leader_election.cc:304] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:24.053514 19762 raft_consensus.cc:2804] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:24.053970 19762 raft_consensus.cc:697] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:24.054666 19762 consensus_queue.cc:237] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:24.061810 19268 catalog_manager.cc:5697] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 1 to 2, leader changed from 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194) to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 2 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.250805 19595 raft_consensus.cc:993] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: : Instructing follower 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:24.251232 19762 raft_consensus.cc:1081] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Signalling peer 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:24.252777 19445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:43518
I20260709 13:20:24.253244 19445 raft_consensus.cc:493] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:24.253494 19445 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.258541 19445 raft_consensus.cc:515] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:24.260221 19445 leader_election.cc:290] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:24.261016 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:24.261255 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:24.261628 19706 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.261831 19518 raft_consensus.cc:3055] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.262159 19518 raft_consensus.cc:740] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:24.262884 19518 consensus_queue.cc:260] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:24.263849 19518 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.267166 19706 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:24.268389 19411 leader_election.cc:304] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:24.269044 19518 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:24.269198 19752 raft_consensus.cc:2804] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:24.269742 19752 raft_consensus.cc:697] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:24.270709 19752 consensus_queue.cc:237] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:24.283588 19268 catalog_manager.cc:5697] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 1 to 2, leader changed from ad07500f78b44548bedd957abeb97fee (127.8.186.195) to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:24.571977 19445 raft_consensus.cc:1275] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.573166 19595 consensus_queue.cc:1048] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:24.584527 19706 raft_consensus.cc:1275] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.585783 19762 consensus_queue.cc:1048] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:24.662276 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:24.688450 19706 raft_consensus.cc:1275] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.689625 19752 consensus_queue.cc:1048] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:24.698285 19518 raft_consensus.cc:1275] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.699949 19650 consensus_queue.cc:1048] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:24.802192  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:24.809937 19445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
mode: GRACEFUL
new_leader_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:43526
I20260709 13:20:24.810509 19445 raft_consensus.cc:606] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Received request to transfer leadership to TS ad07500f78b44548bedd957abeb97fee
I20260709 13:20:24.812888 19518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
mode: GRACEFUL
new_leader_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:51350
I20260709 13:20:24.813354 19518 raft_consensus.cc:606] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Received request to transfer leadership to TS 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:24.814505  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:24.814980  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:24.815531  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:25.074828 19595 raft_consensus.cc:993] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: : Instructing follower 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:25.075374 19762 raft_consensus.cc:1081] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Signalling peer 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:25.076977 19445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:43518
I20260709 13:20:25.077435 19445 raft_consensus.cc:493] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:25.077710 19445 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.083348 19445 raft_consensus.cc:515] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.084812 19445 leader_election.cc:290] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 3 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:25.085721 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:25.085918 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a450e1da164221b76494bca73d5ab0" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:25.086422 19706 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.086439 19518 raft_consensus.cc:3055] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:25.086983 19518 raft_consensus.cc:740] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:25.087828 19518 consensus_queue.cc:260] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.089092 19518 raft_consensus.cc:3060] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.094265 19706 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 3.
I20260709 13:20:25.095675 19411 leader_election.cc:304] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:25.095885 19518 raft_consensus.cc:2468] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 3.
I20260709 13:20:25.096431 19650 raft_consensus.cc:2804] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:25.096903 19650 raft_consensus.cc:697] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 3 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:25.097674 19650 consensus_queue.cc:237] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.104127 19266 catalog_manager.cc:5697] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 2 to 3, leader changed from ad07500f78b44548bedd957abeb97fee (127.8.186.195) to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:25.141875 19760 raft_consensus.cc:993] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: : Instructing follower ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:25.142370 19650 raft_consensus.cc:1081] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Signalling peer ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:25.143968 19518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:20:25.144537 19518 raft_consensus.cc:493] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:25.144882 19518 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.150095 19518 raft_consensus.cc:515] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.151576 19518 leader_election.cc:290] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 3 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:25.152498 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:25.152578 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b493ff1c3a34ae8b08fc04bdc4b0e24" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:25.153188 19706 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.153287 19445 raft_consensus.cc:3055] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:25.153645 19445 raft_consensus.cc:740] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:25.154249 19445 consensus_queue.cc:260] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.155156 19445 raft_consensus.cc:3060] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.159278 19706 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 3.
I20260709 13:20:25.159770 19445 raft_consensus.cc:2468] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 3.
I20260709 13:20:25.160576 19485 leader_election.cc:304] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:25.161420 19762 raft_consensus.cc:2804] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:25.161825 19762 raft_consensus.cc:697] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 3 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:25.162518 19762 consensus_queue.cc:237] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.168897 19266 catalog_manager.cc:5697] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 2 to 3, leader changed from 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194) to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 3 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.484198 19518 raft_consensus.cc:1275] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.485620 19650 consensus_queue.cc:1048] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:25.496749 19706 raft_consensus.cc:1275] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.500124 19760 consensus_queue.cc:1048] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:25.579676 19706 raft_consensus.cc:1275] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.581297 19595 consensus_queue.cc:1048] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:25.589587 19445 raft_consensus.cc:1275] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.591637 19595 consensus_queue.cc:1048] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:25.663264 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:25.822078  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:25.829427 19518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
mode: GRACEFUL
new_leader_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:51350
I20260709 13:20:25.829916 19518 raft_consensus.cc:606] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Received request to transfer leadership to TS 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:25.832254 19445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
mode: GRACEFUL
new_leader_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:43526
I20260709 13:20:25.832701 19445 raft_consensus.cc:606] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Received request to transfer leadership to TS ad07500f78b44548bedd957abeb97fee
I20260709 13:20:25.833876  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:25.834378  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:25.834936  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:25.837024 19650 raft_consensus.cc:993] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: : Instructing follower ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:25.837497 19760 raft_consensus.cc:1081] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Signalling peer ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:25.838802 19518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:20:25.839198 19518 raft_consensus.cc:493] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:25.839452 19518 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.844550 19518 raft_consensus.cc:515] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.845919 19518 leader_election.cc:290] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:25.846773 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:25.846803 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:25.847419 19445 raft_consensus.cc:3055] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:25.847461 19706 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.847710 19445 raft_consensus.cc:740] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:25.848505 19445 consensus_queue.cc:260] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.849460 19445 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.852989 19706 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 2.
I20260709 13:20:25.854053 19485 leader_election.cc:304] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:25.854049 19445 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 2.
I20260709 13:20:25.854790 19595 raft_consensus.cc:2804] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:25.855229 19595 raft_consensus.cc:697] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:25.855865 19595 consensus_queue.cc:237] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:25.862191 19266 catalog_manager.cc:5697] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 1 to 2, leader changed from 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194) to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 2 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.010680 19762 raft_consensus.cc:993] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: : Instructing follower 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:26.011114 19595 raft_consensus.cc:1081] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Signalling peer 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:26.012472 19445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:43518
I20260709 13:20:26.012864 19445 raft_consensus.cc:493] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:26.013083 19445 raft_consensus.cc:3060] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.017510 19445 raft_consensus.cc:515] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:26.018783 19445 leader_election.cc:290] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:26.019675 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:26.019819 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b999ccda0e34f48bc4b3306902160eb" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:26.020429 19705 raft_consensus.cc:3060] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.020473 19518 raft_consensus.cc:3055] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:26.020848 19518 raft_consensus.cc:740] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:26.021478 19518 consensus_queue.cc:260] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:26.022392 19518 raft_consensus.cc:3060] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.026425 19705 raft_consensus.cc:2468] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:26.027408 19411 leader_election.cc:304] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:26.027763 19518 raft_consensus.cc:2468] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 2.
I20260709 13:20:26.028065 19650 raft_consensus.cc:2804] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:26.028589 19650 raft_consensus.cc:697] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:26.029371 19650 consensus_queue.cc:237] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:26.035859 19266 catalog_manager.cc:5697] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 1 to 2, leader changed from ad07500f78b44548bedd957abeb97fee (127.8.186.195) to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.294740 19705 raft_consensus.cc:1275] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:26.296065 19793 consensus_queue.cc:1048] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:26.308151 19445 raft_consensus.cc:1275] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:26.309393 19793 consensus_queue.cc:1048] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:26.449572 19518 raft_consensus.cc:1275] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:26.450862 19650 consensus_queue.cc:1048] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:26.459288 19706 raft_consensus.cc:1275] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:26.461294 19752 consensus_queue.cc:1048] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:26.687011 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:26.842252  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:26.852491 19518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
mode: GRACEFUL
new_leader_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:51350
I20260709 13:20:26.853154 19518 raft_consensus.cc:606] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Received request to transfer leadership to TS 57695c4e300e40e2a33e5db1ae797439
I20260709 13:20:26.856356 19445 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
mode: GRACEFUL
new_leader_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:43526
I20260709 13:20:26.857015 19445 raft_consensus.cc:606] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Received request to transfer leadership to TS ad07500f78b44548bedd957abeb97fee
I20260709 13:20:26.858812  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:26.859326  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:26.860090  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:26.960876 19650 raft_consensus.cc:993] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: : Instructing follower ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:26.961504 19752 raft_consensus.cc:1081] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Signalling peer ad07500f78b44548bedd957abeb97fee to start an election
I20260709 13:20:26.963150 19518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c"
dest_uuid: "ad07500f78b44548bedd957abeb97fee"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:20:26.963636 19518 raft_consensus.cc:493] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:26.963974 19518 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:26.972648 19518 raft_consensus.cc:515] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:26.974395 19518 leader_election.cc:290] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 3 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453)
I20260709 13:20:26.975499 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:26.975548 19445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9cf8cbeaa44332a57a5e5339586a1c" candidate_uuid: "ad07500f78b44548bedd957abeb97fee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
I20260709 13:20:26.976416 19705 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:26.976477 19445 raft_consensus.cc:3055] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:26.976886 19445 raft_consensus.cc:740] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:26.977835 19445 consensus_queue.cc:260] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:26.979048 19445 raft_consensus.cc:3060] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:26.984035 19705 raft_consensus.cc:2468] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 3.
I20260709 13:20:26.985733 19485 leader_election.cc:304] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad07500f78b44548bedd957abeb97fee, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:26.986614 19793 raft_consensus.cc:2804] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:26.986760 19445 raft_consensus.cc:2468] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad07500f78b44548bedd957abeb97fee in term 3.
I20260709 13:20:26.987008 19793 raft_consensus.cc:697] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 3 LEADER]: Becoming Leader. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:26.988349 19793 consensus_queue.cc:237] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:26.996692 19266 catalog_manager.cc:5697] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee reported cstate change: term changed from 2 to 3, leader changed from 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194) to ad07500f78b44548bedd957abeb97fee (127.8.186.195). New cstate: current_term: 3 leader_uuid: "ad07500f78b44548bedd957abeb97fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.265223 19595 raft_consensus.cc:993] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: : Instructing follower 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:27.265667 19595 raft_consensus.cc:1081] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Signalling peer 57695c4e300e40e2a33e5db1ae797439 to start an election
I20260709 13:20:27.267200 19445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7"
dest_uuid: "57695c4e300e40e2a33e5db1ae797439"
 from {username='slave'} at 127.0.0.1:43518
I20260709 13:20:27.267639 19445 raft_consensus.cc:493] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.267959 19445 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.273425 19445 raft_consensus.cc:515] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:27.274989 19445 leader_election.cc:290] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 3 election: Requested vote from peers b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219), ad07500f78b44548bedd957abeb97fee (127.8.186.195:40149)
I20260709 13:20:27.276192 19518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad07500f78b44548bedd957abeb97fee"
I20260709 13:20:27.276199 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40424916b95848bd97d2e30a1def1fd7" candidate_uuid: "57695c4e300e40e2a33e5db1ae797439" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5c5c5bd5d0043b1a81647121e3622dc"
I20260709 13:20:27.276985 19518 raft_consensus.cc:3055] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:27.277163 19705 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.277307 19518 raft_consensus.cc:740] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad07500f78b44548bedd957abeb97fee, State: Running, Role: LEADER
I20260709 13:20:27.278368 19518 consensus_queue.cc:260] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:27.279435 19518 raft_consensus.cc:3060] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.283535 19705 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 3.
I20260709 13:20:27.284868 19411 leader_election.cc:304] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57695c4e300e40e2a33e5db1ae797439, b5c5c5bd5d0043b1a81647121e3622dc; no voters: 
I20260709 13:20:27.285653 19752 raft_consensus.cc:2804] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:27.285799 19518 raft_consensus.cc:2468] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57695c4e300e40e2a33e5db1ae797439 in term 3.
I20260709 13:20:27.286247 19752 raft_consensus.cc:697] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 3 LEADER]: Becoming Leader. State: Replica: 57695c4e300e40e2a33e5db1ae797439, State: Running, Role: LEADER
I20260709 13:20:27.287424 19752 consensus_queue.cc:237] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } }
I20260709 13:20:27.294454 19266 catalog_manager.cc:5697] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 reported cstate change: term changed from 2 to 3, leader changed from ad07500f78b44548bedd957abeb97fee (127.8.186.195) to 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "57695c4e300e40e2a33e5db1ae797439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.534196 19705 raft_consensus.cc:1275] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:27.535468 19595 consensus_queue.cc:1048] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:27.546945 19445 raft_consensus.cc:1275] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Refusing update from remote peer ad07500f78b44548bedd957abeb97fee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:27.548586 19595 consensus_queue.cc:1048] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "57695c4e300e40e2a33e5db1ae797439" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:27.688444 19317 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:27.754060 19705 raft_consensus.cc:1275] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:27.755673 19752 consensus_queue.cc:1048] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5c5c5bd5d0043b1a81647121e3622dc" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:27.768064 19518 raft_consensus.cc:1275] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Refusing update from remote peer 57695c4e300e40e2a33e5db1ae797439: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:27.770104 19815 consensus_queue.cc:1048] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad07500f78b44548bedd957abeb97fee" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:27.866209  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:27.899085  8939 tablet_server.cc:179] TabletServer@127.8.186.193:39219 shutting down...
W20260709 13:20:27.917234 19485 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 93 similar messages]
I20260709 13:20:27.930584  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:20:27.930665 19485 consensus_peers.cc:597] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.931581  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.932399  8939 raft_consensus.cc:2243] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.932929  8939 raft_consensus.cc:2272] T 6d9cf8cbeaa44332a57a5e5339586a1c P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.935990  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.936638  8939 raft_consensus.cc:2243] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.937172  8939 raft_consensus.cc:2272] T 7ff73d14242f4e7688ff86e8299602d9 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.939895  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.940511  8939 raft_consensus.cc:2243] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.941051  8939 raft_consensus.cc:2272] T 9dbe992d3d7c4c4db03e643990d99939 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.943455  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.944090  8939 raft_consensus.cc:2243] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.944528  8939 raft_consensus.cc:2272] T 760b76838bc745b78197c565c851b817 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.947086  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.947685  8939 raft_consensus.cc:2243] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.948231  8939 raft_consensus.cc:2272] T e1231680e561412fbea1243b9729f527 P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.950839  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.951404  8939 raft_consensus.cc:2243] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.951944  8939 raft_consensus.cc:2272] T c4e48ec95c684c2394436df2e199c413 P b5c5c5bd5d0043b1a81647121e3622dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.954767  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.955374  8939 raft_consensus.cc:2243] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.956038  8939 raft_consensus.cc:2272] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:27.957747 19411 consensus_peers.cc:597] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.960100  8939 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:27.960402 19485 consensus_peers.cc:597] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.961067  8939 raft_consensus.cc:2243] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.961748  8939 raft_consensus.cc:2272] T 40424916b95848bd97d2e30a1def1fd7 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.965664  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.966271  8939 raft_consensus.cc:2243] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.966840  8939 raft_consensus.cc:2272] T d6a450e1da164221b76494bca73d5ab0 P b5c5c5bd5d0043b1a81647121e3622dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.969322  8939 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:27.969821  8939 raft_consensus.cc:2243] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.970337  8939 raft_consensus.cc:2272] T 1b999ccda0e34f48bc4b3306902160eb P b5c5c5bd5d0043b1a81647121e3622dc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:27.980501 19411 consensus_peers.cc:597] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:27.994036  8939 tablet_server.cc:196] TabletServer@127.8.186.193:39219 shutdown complete.
W20260709 13:20:28.007887 19485 consensus_peers.cc:597] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:28.023990 19485 consensus_peers.cc:597] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee -> Peer b5c5c5bd5d0043b1a81647121e3622dc (127.8.186.193:39219): Couldn't send request to peer b5c5c5bd5d0043b1a81647121e3622dc. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:39219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:28.028797  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
I20260709 13:20:28.051155  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:28.052017  8939 tablet_replica.cc:333] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.053159  8939 raft_consensus.cc:2243] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.054315  8939 raft_consensus.cc:2272] T 1b999ccda0e34f48bc4b3306902160eb P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.056806  8939 tablet_replica.cc:333] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.057407  8939 raft_consensus.cc:2243] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.057894  8939 raft_consensus.cc:2272] T 7ff73d14242f4e7688ff86e8299602d9 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.060385  8939 tablet_replica.cc:333] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.060954  8939 raft_consensus.cc:2243] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.061880  8939 raft_consensus.cc:2272] T d6a450e1da164221b76494bca73d5ab0 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.064198  8939 tablet_replica.cc:333] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.064726  8939 raft_consensus.cc:2243] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.065528  8939 raft_consensus.cc:2272] T 40424916b95848bd97d2e30a1def1fd7 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.068361  8939 tablet_replica.cc:333] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.068904  8939 raft_consensus.cc:2243] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.069291  8939 raft_consensus.cc:2272] T 6d9cf8cbeaa44332a57a5e5339586a1c P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.072031  8939 tablet_replica.cc:333] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.072582  8939 raft_consensus.cc:2243] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.073468  8939 raft_consensus.cc:2272] T e1231680e561412fbea1243b9729f527 P 57695c4e300e40e2a33e5db1ae797439 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.075800  8939 tablet_replica.cc:333] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.076290  8939 raft_consensus.cc:2243] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.076758  8939 raft_consensus.cc:2272] T 760b76838bc745b78197c565c851b817 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.079108  8939 tablet_replica.cc:333] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.079635  8939 raft_consensus.cc:2243] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.080116  8939 raft_consensus.cc:2272] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P 57695c4e300e40e2a33e5db1ae797439 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.082325  8939 tablet_replica.cc:333] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.082808  8939 raft_consensus.cc:2243] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.083714  8939 raft_consensus.cc:2272] T c4e48ec95c684c2394436df2e199c413 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.086176  8939 tablet_replica.cc:333] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439: stopping tablet replica
I20260709 13:20:28.086611  8939 raft_consensus.cc:2243] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.087001  8939 raft_consensus.cc:2272] T 9dbe992d3d7c4c4db03e643990d99939 P 57695c4e300e40e2a33e5db1ae797439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.121183  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
W20260709 13:20:28.140307 19486 consensus_peers.cc:597] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee -> Peer 57695c4e300e40e2a33e5db1ae797439 (127.8.186.194:33453): Couldn't send request to peer 57695c4e300e40e2a33e5db1ae797439. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:33453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:28.152323  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
I20260709 13:20:28.177587  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:28.178334  8939 tablet_replica.cc:333] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.179205  8939 raft_consensus.cc:2243] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.179804  8939 raft_consensus.cc:2272] T 1b999ccda0e34f48bc4b3306902160eb P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.182288  8939 tablet_replica.cc:333] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.183010  8939 raft_consensus.cc:2243] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.184098  8939 raft_consensus.cc:2272] T 9dbe992d3d7c4c4db03e643990d99939 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.186507  8939 tablet_replica.cc:333] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.187096  8939 raft_consensus.cc:2243] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.187611  8939 raft_consensus.cc:2272] T d6a450e1da164221b76494bca73d5ab0 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.189833  8939 tablet_replica.cc:333] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.190375  8939 raft_consensus.cc:2243] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.190789  8939 raft_consensus.cc:2272] T 40424916b95848bd97d2e30a1def1fd7 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.193431  8939 tablet_replica.cc:333] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.194016  8939 raft_consensus.cc:2243] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.194869  8939 raft_consensus.cc:2272] T 6d9cf8cbeaa44332a57a5e5339586a1c P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.197391  8939 tablet_replica.cc:333] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.197964  8939 raft_consensus.cc:2243] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.198855  8939 raft_consensus.cc:2272] T 7ff73d14242f4e7688ff86e8299602d9 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.201174  8939 tablet_replica.cc:333] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.201695  8939 raft_consensus.cc:2243] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.202644  8939 raft_consensus.cc:2272] T 7b493ff1c3a34ae8b08fc04bdc4b0e24 P ad07500f78b44548bedd957abeb97fee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.204859  8939 tablet_replica.cc:333] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.205452  8939 raft_consensus.cc:2243] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.205961  8939 raft_consensus.cc:2272] T c4e48ec95c684c2394436df2e199c413 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.208425  8939 tablet_replica.cc:333] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.208930  8939 raft_consensus.cc:2243] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.209817  8939 raft_consensus.cc:2272] T 760b76838bc745b78197c565c851b817 P ad07500f78b44548bedd957abeb97fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.212129  8939 tablet_replica.cc:333] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee: stopping tablet replica
I20260709 13:20:28.212611  8939 raft_consensus.cc:2243] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:28.213276  8939 raft_consensus.cc:2272] T e1231680e561412fbea1243b9729f527 P ad07500f78b44548bedd957abeb97fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.245743  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:20:28.273795  8939 master.cc:562] Master@127.8.186.254:35411 shutting down...
I20260709 13:20:28.298302  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:28.298882  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:28.299219  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P dd6ecd022f2445fcbe5a424c21a6bd1d: stopping tablet replica
I20260709 13:20:28.320596  8939 master.cc:584] Master@127.8.186.254:35411 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12855 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:20:28.367249  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:40383
I20260709 13:20:28.368476  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:28.374157 19825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.374183 19826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.374966 19828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:28.375833  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:28.376735  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:28.376933  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:28.377068  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603228377051 us; error 0 us; skew 500 ppm
I20260709 13:20:28.377559  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:28.379889  8939 webserver.cc:533] Webserver started at http://127.8.186.254:35307/ using document root <none> and password file <none>
I20260709 13:20:28.380369  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:28.380543  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:28.380802  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:28.381937  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "cdea71324ef842d8b47c51ad7500befa"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.386571  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:28.390069 19833 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.390793  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:20:28.391052  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "cdea71324ef842d8b47c51ad7500befa"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.391317  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:28.402981  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:28.404244  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:28.442621  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:40383
I20260709 13:20:28.442767 19884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:40383 every 8 connection(s)
I20260709 13:20:28.446523 19885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.458840 19885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa: Bootstrap starting.
I20260709 13:20:28.463796 19885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:28.468184 19885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa: No bootstrap required, opened a new log
I20260709 13:20:28.470451 19885 raft_consensus.cc:359] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdea71324ef842d8b47c51ad7500befa" member_type: VOTER }
I20260709 13:20:28.470834 19885 raft_consensus.cc:385] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:28.471056 19885 raft_consensus.cc:740] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdea71324ef842d8b47c51ad7500befa, State: Initialized, Role: FOLLOWER
I20260709 13:20:28.471675 19885 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdea71324ef842d8b47c51ad7500befa" member_type: VOTER }
I20260709 13:20:28.472148 19885 raft_consensus.cc:399] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:28.472354 19885 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:28.472597 19885 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:28.477631 19885 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdea71324ef842d8b47c51ad7500befa" member_type: VOTER }
I20260709 13:20:28.478134 19885 leader_election.cc:304] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdea71324ef842d8b47c51ad7500befa; no voters: 
I20260709 13:20:28.479224 19885 leader_election.cc:290] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:28.479679 19888 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:28.481108 19888 raft_consensus.cc:697] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 1 LEADER]: Becoming Leader. State: Replica: cdea71324ef842d8b47c51ad7500befa, State: Running, Role: LEADER
I20260709 13:20:28.481756 19888 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdea71324ef842d8b47c51ad7500befa" member_type: VOTER }
I20260709 13:20:28.482136 19885 sys_catalog.cc:565] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:28.488169 19889 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdea71324ef842d8b47c51ad7500befa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdea71324ef842d8b47c51ad7500befa" member_type: VOTER } }
I20260709 13:20:28.488067 19890 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdea71324ef842d8b47c51ad7500befa. Latest consensus state: current_term: 1 leader_uuid: "cdea71324ef842d8b47c51ad7500befa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdea71324ef842d8b47c51ad7500befa" member_type: VOTER } }
I20260709 13:20:28.488983 19889 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:28.489157 19890 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:28.490844 19898 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:28.495672 19898 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:28.497283  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:28.504555 19898 catalog_manager.cc:1383] Generated new cluster ID: 126946c18aec4d1bb0fae38e50f7242e
I20260709 13:20:28.504873 19898 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:28.523402 19898 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:28.524776 19898 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:28.536767 19898 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa: Generated new TSK 0
I20260709 13:20:28.537395 19898 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:28.563712  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:28.569921 19906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.570850 19907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.572224 19909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:28.572988  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:28.573971  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:28.574152  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:28.574278  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603228574266 us; error 0 us; skew 500 ppm
I20260709 13:20:28.574784  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:28.576973  8939 webserver.cc:533] Webserver started at http://127.8.186.193:37047/ using document root <none> and password file <none>
I20260709 13:20:28.577409  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:28.577556  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:28.577761  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:28.578785  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "26508b382af34e7892bddf2664f29aa6"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.583179  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:20:28.586632 19914 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.587342  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:20:28.587659  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "26508b382af34e7892bddf2664f29aa6"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.587975  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:28.601883  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:28.603050  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:28.604604  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:28.606923  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:28.607095  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.607283  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:28.607416  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.646382  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:44783
I20260709 13:20:28.646479 19976 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:44783 every 8 connection(s)
I20260709 13:20:28.651335  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:28.658972 19981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.660513 19982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.663316 19984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:28.663813  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:28.664451 19977 heartbeater.cc:344] Connected to a master server at 127.8.186.254:40383
I20260709 13:20:28.664861 19977 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:28.665123  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:28.665388  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:28.665537  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603228665520 us; error 0 us; skew 500 ppm
I20260709 13:20:28.665656 19977 heartbeater.cc:507] Master 127.8.186.254:40383 requested a full tablet report, sending...
I20260709 13:20:28.666157  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:28.668033 19850 ts_manager.cc:194] Registered new tserver with Master: 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783)
I20260709 13:20:28.668699  8939 webserver.cc:533] Webserver started at http://127.8.186.194:35139/ using document root <none> and password file <none>
I20260709 13:20:28.669206  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:28.669370  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:28.669601  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:28.669945 19850 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54616
I20260709 13:20:28.670795  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "11506540476f404ebae61fb1f046e3e7"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.675179  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:28.678426 19989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.679136  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:28.679404  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "11506540476f404ebae61fb1f046e3e7"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.679644  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:28.702546  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:28.703773  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:28.705217  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:28.707407  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:28.707580  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.707832  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:28.707973  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.746721  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:34595
I20260709 13:20:28.746881 20051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:34595 every 8 connection(s)
I20260709 13:20:28.751730  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:28.759164 20055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:28.760525 20056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:28.763582  8939 server_base.cc:1061] running on GCE node
W20260709 13:20:28.763672 20058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:28.764521 20052 heartbeater.cc:344] Connected to a master server at 127.8.186.254:40383
I20260709 13:20:28.764905 20052 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:28.764941  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:28.765244  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:28.765420  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603228765404 us; error 0 us; skew 500 ppm
I20260709 13:20:28.765749 20052 heartbeater.cc:507] Master 127.8.186.254:40383 requested a full tablet report, sending...
I20260709 13:20:28.766193  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:28.767812 19850 ts_manager.cc:194] Registered new tserver with Master: 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595)
I20260709 13:20:28.768986  8939 webserver.cc:533] Webserver started at http://127.8.186.195:42753/ using document root <none> and password file <none>
I20260709 13:20:28.769312 19850 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54630
I20260709 13:20:28.769490  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:28.769770  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:28.770013  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:28.771147  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "08bfad1becd9437aa9f9a261e4ed757d"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.775357  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:28.778481 20063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.779202  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:28.779480  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "08bfad1becd9437aa9f9a261e4ed757d"
format_stamp: "Formatted at 2026-07-09 13:20:28 on dist-test-slave-mq27"
I20260709 13:20:28.779767  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:28.812270  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:28.813467  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:28.814873  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:28.817077  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:28.817271  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.817493  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:28.817649  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:28.856495  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:41183
I20260709 13:20:28.856604 20125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:41183 every 8 connection(s)
I20260709 13:20:28.869971 20126 heartbeater.cc:344] Connected to a master server at 127.8.186.254:40383
I20260709 13:20:28.870398 20126 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:28.871101 20126 heartbeater.cc:507] Master 127.8.186.254:40383 requested a full tablet report, sending...
I20260709 13:20:28.872970 19850 ts_manager.cc:194] Registered new tserver with Master: 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:28.873103  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013539935s
I20260709 13:20:28.874320 19850 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54634
I20260709 13:20:28.897845 19850 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54646:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:28.899984 19850 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:28.953361 20017 tablet_service.cc:1511] Processing CreateTablet for tablet 8826a0923882408b85810db9a23fa2d1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f4def21f09764ba7aab7405c0f4e3f1c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:28.954706 20017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8826a0923882408b85810db9a23fa2d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.956382 20016 tablet_service.cc:1511] Processing CreateTablet for tablet 22ca2a4de9be41abb464267596c7b164 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f4def21f09764ba7aab7405c0f4e3f1c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:28.957563 20016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ca2a4de9be41abb464267596c7b164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.957293 20091 tablet_service.cc:1511] Processing CreateTablet for tablet 8826a0923882408b85810db9a23fa2d1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f4def21f09764ba7aab7405c0f4e3f1c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:28.957718 19942 tablet_service.cc:1511] Processing CreateTablet for tablet 8826a0923882408b85810db9a23fa2d1 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f4def21f09764ba7aab7405c0f4e3f1c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:28.958832 20091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8826a0923882408b85810db9a23fa2d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.959004 19942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8826a0923882408b85810db9a23fa2d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.960916 20090 tablet_service.cc:1511] Processing CreateTablet for tablet 22ca2a4de9be41abb464267596c7b164 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f4def21f09764ba7aab7405c0f4e3f1c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:28.962091 20090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ca2a4de9be41abb464267596c7b164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.964953 19941 tablet_service.cc:1511] Processing CreateTablet for tablet 22ca2a4de9be41abb464267596c7b164 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f4def21f09764ba7aab7405c0f4e3f1c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:28.966320 19941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ca2a4de9be41abb464267596c7b164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.984675 20141 tablet_bootstrap.cc:492] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d: Bootstrap starting.
I20260709 13:20:28.994733 20141 tablet_bootstrap.cc:654] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:28.992874 20142 tablet_bootstrap.cc:492] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7: Bootstrap starting.
I20260709 13:20:29.001600 20143 tablet_bootstrap.cc:492] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6: Bootstrap starting.
I20260709 13:20:29.004051 20142 tablet_bootstrap.cc:654] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.009171 20142 tablet_bootstrap.cc:492] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7: No bootstrap required, opened a new log
I20260709 13:20:29.009634 20142 ts_tablet_manager.cc:1403] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:20:29.009783 20143 tablet_bootstrap.cc:654] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.009006 20141 tablet_bootstrap.cc:492] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d: No bootstrap required, opened a new log
I20260709 13:20:29.010959 20141 ts_tablet_manager.cc:1403] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:20:29.012176 20142 raft_consensus.cc:359] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.012758 20142 raft_consensus.cc:385] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.013087 20142 raft_consensus.cc:740] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.013984 20142 consensus_queue.cc:260] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.013998 20141 raft_consensus.cc:359] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.014900 20141 raft_consensus.cc:385] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.015216 20141 raft_consensus.cc:740] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.015614 20143 tablet_bootstrap.cc:492] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6: No bootstrap required, opened a new log
I20260709 13:20:29.016243 20143 ts_tablet_manager.cc:1403] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:20:29.016050 20141 consensus_queue.cc:260] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.018715 20126 heartbeater.cc:499] Master 127.8.186.254:40383 was elected leader, sending a full tablet report...
I20260709 13:20:29.019263 20143 raft_consensus.cc:359] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.020129 20143 raft_consensus.cc:385] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.020479 20143 raft_consensus.cc:740] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.020648 20141 ts_tablet_manager.cc:1434] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:20:29.021265 20143 consensus_queue.cc:260] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.021739 20141 tablet_bootstrap.cc:492] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d: Bootstrap starting.
I20260709 13:20:29.030946 20141 tablet_bootstrap.cc:654] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.035650 20052 heartbeater.cc:499] Master 127.8.186.254:40383 was elected leader, sending a full tablet report...
I20260709 13:20:29.036257 20142 ts_tablet_manager.cc:1434] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7: Time spent starting tablet: real 0.026s	user 0.019s	sys 0.008s
I20260709 13:20:29.038832 19977 heartbeater.cc:499] Master 127.8.186.254:40383 was elected leader, sending a full tablet report...
I20260709 13:20:29.039456 20143 ts_tablet_manager.cc:1434] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.010s
I20260709 13:20:29.039860 20142 tablet_bootstrap.cc:492] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7: Bootstrap starting.
I20260709 13:20:29.048781 20142 tablet_bootstrap.cc:654] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.052000 20141 tablet_bootstrap.cc:492] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d: No bootstrap required, opened a new log
I20260709 13:20:29.052739 20141 ts_tablet_manager.cc:1403] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.022s
I20260709 13:20:29.055054 20143 tablet_bootstrap.cc:492] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: Bootstrap starting.
I20260709 13:20:29.056160 20141 raft_consensus.cc:359] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.057185 20141 raft_consensus.cc:385] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.057546 20141 raft_consensus.cc:740] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.058634 20141 consensus_queue.cc:260] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.060977 20141 ts_tablet_manager.cc:1434] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:20:29.061825 20142 tablet_bootstrap.cc:492] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7: No bootstrap required, opened a new log
I20260709 13:20:29.062299 20142 ts_tablet_manager.cc:1403] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:20:29.063874 20143 tablet_bootstrap.cc:654] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.064594 20142 raft_consensus.cc:359] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.065171 20142 raft_consensus.cc:385] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.065456 20142 raft_consensus.cc:740] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.066133 20142 consensus_queue.cc:260] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.068222 20142 ts_tablet_manager.cc:1434] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:29.074590 20143 tablet_bootstrap.cc:492] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: No bootstrap required, opened a new log
I20260709 13:20:29.075229 20143 ts_tablet_manager.cc:1403] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:20:29.077768 20143 raft_consensus.cc:359] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.078351 20143 raft_consensus.cc:385] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.078567 20143 raft_consensus.cc:740] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.079144 20143 consensus_queue.cc:260] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.080839 20143 ts_tablet_manager.cc:1434] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:20:29.169812 20149 raft_consensus.cc:493] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.170401 20149 raft_consensus.cc:515] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.172638 20149 leader_election.cc:290] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.184343 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8826a0923882408b85810db9a23fa2d1" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d" is_pre_election: true
I20260709 13:20:29.184747 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8826a0923882408b85810db9a23fa2d1" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11506540476f404ebae61fb1f046e3e7" is_pre_election: true
I20260709 13:20:29.185051 20101 raft_consensus.cc:2468] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 0.
I20260709 13:20:29.185441 20027 raft_consensus.cc:2468] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 0.
I20260709 13:20:29.186214 19916 leader_election.cc:304] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:29.187038 20149 raft_consensus.cc:2804] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:29.187302 20149 raft_consensus.cc:493] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.187520 20149 raft_consensus.cc:3060] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.193176 20149 raft_consensus.cc:515] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.194797 20149 leader_election.cc:290] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.195639 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8826a0923882408b85810db9a23fa2d1" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11506540476f404ebae61fb1f046e3e7"
I20260709 13:20:29.195828 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8826a0923882408b85810db9a23fa2d1" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
I20260709 13:20:29.196246 20027 raft_consensus.cc:3060] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.196364 20101 raft_consensus.cc:3060] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.201902 20101 raft_consensus.cc:2468] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 1.
I20260709 13:20:29.201905 20027 raft_consensus.cc:2468] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 1.
I20260709 13:20:29.203023 19916 leader_election.cc:304] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:29.203883 20149 raft_consensus.cc:2804] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:29.204715 20149 raft_consensus.cc:697] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Running, Role: LEADER
I20260709 13:20:29.205487 20149 consensus_queue.cc:237] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.212447 19847 catalog_manager.cc:5697] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26508b382af34e7892bddf2664f29aa6 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "26508b382af34e7892bddf2664f29aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:29.230938 20149 raft_consensus.cc:493] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.231443 20149 raft_consensus.cc:515] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.233227 20149 leader_election.cc:290] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.234087 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11506540476f404ebae61fb1f046e3e7" is_pre_election: true
I20260709 13:20:29.234263 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d" is_pre_election: true
I20260709 13:20:29.234889 20027 raft_consensus.cc:2468] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 0.
I20260709 13:20:29.234916 20101 raft_consensus.cc:2468] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 0.
I20260709 13:20:29.236140 19916 leader_election.cc:304] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:29.236775 20149 raft_consensus.cc:2804] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:29.237082 20149 raft_consensus.cc:493] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.237326 20149 raft_consensus.cc:3060] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.242532 20149 raft_consensus.cc:515] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.244096 20149 leader_election.cc:290] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.244915 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11506540476f404ebae61fb1f046e3e7"
I20260709 13:20:29.245023 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
I20260709 13:20:29.245455 20027 raft_consensus.cc:3060] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.245554 20101 raft_consensus.cc:3060] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.250530 20027 raft_consensus.cc:2468] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 1.
I20260709 13:20:29.250622 20101 raft_consensus.cc:2468] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 1.
I20260709 13:20:29.251778 19916 leader_election.cc:304] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:29.252485 20149 raft_consensus.cc:2804] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:29.252857 20149 raft_consensus.cc:697] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Running, Role: LEADER
I20260709 13:20:29.253640 20149 consensus_queue.cc:237] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.260208 19847 catalog_manager.cc:5697] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26508b382af34e7892bddf2664f29aa6 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "26508b382af34e7892bddf2664f29aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:29.294847 19847 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54652:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:29.296947 19847 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:29.319792 19942 tablet_service.cc:1511] Processing CreateTablet for tablet e30a1911a6ef43f5a014f53e1f695cbe (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da6145c63d9b49bcb800a553ababf9d1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:29.321118 19942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30a1911a6ef43f5a014f53e1f695cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.321328 20016 tablet_service.cc:1511] Processing CreateTablet for tablet e30a1911a6ef43f5a014f53e1f695cbe (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da6145c63d9b49bcb800a553ababf9d1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:29.322654 20016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30a1911a6ef43f5a014f53e1f695cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.322551 20090 tablet_service.cc:1511] Processing CreateTablet for tablet e30a1911a6ef43f5a014f53e1f695cbe (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da6145c63d9b49bcb800a553ababf9d1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:29.323925 20090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30a1911a6ef43f5a014f53e1f695cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.326054 19941 tablet_service.cc:1511] Processing CreateTablet for tablet 3475db4b11db40ad99e6ebacaa5b9d9b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da6145c63d9b49bcb800a553ababf9d1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:29.327294 19941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3475db4b11db40ad99e6ebacaa5b9d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.331480 20017 tablet_service.cc:1511] Processing CreateTablet for tablet 3475db4b11db40ad99e6ebacaa5b9d9b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da6145c63d9b49bcb800a553ababf9d1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:29.332793 20017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3475db4b11db40ad99e6ebacaa5b9d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.332858 20091 tablet_service.cc:1511] Processing CreateTablet for tablet 3475db4b11db40ad99e6ebacaa5b9d9b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=da6145c63d9b49bcb800a553ababf9d1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:29.335536 20091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3475db4b11db40ad99e6ebacaa5b9d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:29.340296 20142 tablet_bootstrap.cc:492] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: Bootstrap starting.
I20260709 13:20:29.345041 20143 tablet_bootstrap.cc:492] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: Bootstrap starting.
I20260709 13:20:29.346477 20142 tablet_bootstrap.cc:654] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.352270 20143 tablet_bootstrap.cc:654] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.364202 20143 tablet_bootstrap.cc:492] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: No bootstrap required, opened a new log
I20260709 13:20:29.364729 20143 ts_tablet_manager.cc:1403] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:20:29.365963 20141 tablet_bootstrap.cc:492] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: Bootstrap starting.
I20260709 13:20:29.367662 20142 tablet_bootstrap.cc:492] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: No bootstrap required, opened a new log
I20260709 13:20:29.368410 20142 ts_tablet_manager.cc:1403] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.005s
I20260709 13:20:29.367764 20143 raft_consensus.cc:359] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.371870 20143 raft_consensus.cc:385] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.371855 20142 raft_consensus.cc:359] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.372538 20143 raft_consensus.cc:740] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.373018 20142 raft_consensus.cc:385] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.373234 20141 tablet_bootstrap.cc:654] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.373407 20142 raft_consensus.cc:740] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.373535 20143 consensus_queue.cc:260] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.374220 20142 consensus_queue.cc:260] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.376133 20143 ts_tablet_manager.cc:1434] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:20:29.376329 20142 ts_tablet_manager.cc:1434] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:29.377264 20143 tablet_bootstrap.cc:492] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: Bootstrap starting.
I20260709 13:20:29.377496 20142 tablet_bootstrap.cc:492] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7: Bootstrap starting.
I20260709 13:20:29.384831 20142 tablet_bootstrap.cc:654] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.393347 20143 tablet_bootstrap.cc:654] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.397797 20142 tablet_bootstrap.cc:492] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7: No bootstrap required, opened a new log
I20260709 13:20:29.398155 20141 tablet_bootstrap.cc:492] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: No bootstrap required, opened a new log
I20260709 13:20:29.398332 20142 ts_tablet_manager.cc:1403] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:20:29.398643 20143 tablet_bootstrap.cc:492] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: No bootstrap required, opened a new log
I20260709 13:20:29.398736 20141 ts_tablet_manager.cc:1403] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.014s
I20260709 13:20:29.399123 20143 ts_tablet_manager.cc:1403] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 13:20:29.401494 20142 raft_consensus.cc:359] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.401674 20143 raft_consensus.cc:359] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.402236 20142 raft_consensus.cc:385] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.402462 20143 raft_consensus.cc:385] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.402100 20141 raft_consensus.cc:359] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.402689 20142 raft_consensus.cc:740] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.402977 20141 raft_consensus.cc:385] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.403316 20141 raft_consensus.cc:740] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.403828 20143 raft_consensus.cc:740] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.403528 20142 consensus_queue.cc:260] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.404017 20141 consensus_queue.cc:260] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.404663 20143 consensus_queue.cc:260] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.406286 20141 ts_tablet_manager.cc:1434] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:20:29.407295 20141 tablet_bootstrap.cc:492] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d: Bootstrap starting.
I20260709 13:20:29.408052 20142 ts_tablet_manager.cc:1434] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:29.412325 20143 ts_tablet_manager.cc:1434] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:20:29.413575 20141 tablet_bootstrap.cc:654] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:29.416692 20147 raft_consensus.cc:493] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.417207 20147 raft_consensus.cc:515] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.421360 20147 leader_election.cc:290] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.426172 20141 tablet_bootstrap.cc:492] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d: No bootstrap required, opened a new log
I20260709 13:20:29.428001 20141 ts_tablet_manager.cc:1403] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:20:29.431349 20141 raft_consensus.cc:359] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.432166 20141 raft_consensus.cc:385] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:29.432466 20141 raft_consensus.cc:740] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Initialized, Role: FOLLOWER
I20260709 13:20:29.433332 20141 consensus_queue.cc:260] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.435504 20141 ts_tablet_manager.cc:1434] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:20:29.442575 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "11506540476f404ebae61fb1f046e3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26508b382af34e7892bddf2664f29aa6" is_pre_election: true
I20260709 13:20:29.443388 19952 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11506540476f404ebae61fb1f046e3e7 in term 0.
I20260709 13:20:29.443526 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "11506540476f404ebae61fb1f046e3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d" is_pre_election: true
I20260709 13:20:29.444206 20101 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11506540476f404ebae61fb1f046e3e7 in term 0.
I20260709 13:20:29.444568 19990 leader_election.cc:304] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11506540476f404ebae61fb1f046e3e7, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:29.445490 20147 raft_consensus.cc:2804] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:29.445847 20147 raft_consensus.cc:493] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.446178 20147 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.452517 20147 raft_consensus.cc:515] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.454106 20147 leader_election.cc:290] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [CANDIDATE]: Term 1 election: Requested vote from peers 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.454926 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "11506540476f404ebae61fb1f046e3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26508b382af34e7892bddf2664f29aa6"
I20260709 13:20:29.455096 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "11506540476f404ebae61fb1f046e3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
I20260709 13:20:29.455539 19952 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.455834 20101 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.461277 20101 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11506540476f404ebae61fb1f046e3e7 in term 1.
I20260709 13:20:29.461277 19952 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11506540476f404ebae61fb1f046e3e7 in term 1.
I20260709 13:20:29.462517 19991 leader_election.cc:304] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 11506540476f404ebae61fb1f046e3e7; no voters: 
I20260709 13:20:29.463229 20147 raft_consensus.cc:2804] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:29.464067 20147 raft_consensus.cc:697] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 LEADER]: Becoming Leader. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Running, Role: LEADER
I20260709 13:20:29.464855 20147 consensus_queue.cc:237] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.471671 19848 catalog_manager.cc:5697] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11506540476f404ebae61fb1f046e3e7 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "11506540476f404ebae61fb1f046e3e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:29.492684 19897 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:29.522733 20148 raft_consensus.cc:493] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.523320 20148 raft_consensus.cc:515] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.525713 20148 leader_election.cc:290] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783), 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595)
I20260709 13:20:29.537457 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b" candidate_uuid: "08bfad1becd9437aa9f9a261e4ed757d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11506540476f404ebae61fb1f046e3e7" is_pre_election: true
I20260709 13:20:29.537580 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b" candidate_uuid: "08bfad1becd9437aa9f9a261e4ed757d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26508b382af34e7892bddf2664f29aa6" is_pre_election: true
I20260709 13:20:29.538303 20027 raft_consensus.cc:2468] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08bfad1becd9437aa9f9a261e4ed757d in term 0.
I20260709 13:20:29.538378 19952 raft_consensus.cc:2468] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08bfad1becd9437aa9f9a261e4ed757d in term 0.
I20260709 13:20:29.539449 20066 leader_election.cc:304] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 11506540476f404ebae61fb1f046e3e7; no voters: 
I20260709 13:20:29.540248 20148 raft_consensus.cc:2804] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:29.540604 20148 raft_consensus.cc:493] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.540854 20148 raft_consensus.cc:3060] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.547498 20148 raft_consensus.cc:515] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.549192 20148 leader_election.cc:290] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [CANDIDATE]: Term 1 election: Requested vote from peers 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783), 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595)
I20260709 13:20:29.549911 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b" candidate_uuid: "08bfad1becd9437aa9f9a261e4ed757d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26508b382af34e7892bddf2664f29aa6"
I20260709 13:20:29.550204 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b" candidate_uuid: "08bfad1becd9437aa9f9a261e4ed757d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11506540476f404ebae61fb1f046e3e7"
I20260709 13:20:29.550585 19952 raft_consensus.cc:3060] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.550802 20027 raft_consensus.cc:3060] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:29.556178 20027 raft_consensus.cc:2468] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08bfad1becd9437aa9f9a261e4ed757d in term 1.
I20260709 13:20:29.556180 19952 raft_consensus.cc:2468] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08bfad1becd9437aa9f9a261e4ed757d in term 1.
I20260709 13:20:29.557402 20066 leader_election.cc:304] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 11506540476f404ebae61fb1f046e3e7; no voters: 
I20260709 13:20:29.558161 20148 raft_consensus.cc:2804] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:29.559126 20148 raft_consensus.cc:697] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 LEADER]: Becoming Leader. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Running, Role: LEADER
I20260709 13:20:29.559965 20148 consensus_queue.cc:237] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.567247 19848 catalog_manager.cc:5697] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d reported cstate change: term changed from 0 to 1, leader changed from <none> to 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195). New cstate: current_term: 1 leader_uuid: "08bfad1becd9437aa9f9a261e4ed757d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.610345 19952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164"
dest_uuid: "26508b382af34e7892bddf2664f29aa6"
mode: GRACEFUL
new_leader_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
 from {username='slave'} at 127.0.0.1:53984
I20260709 13:20:29.610881 19952 raft_consensus.cc:606] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Received request to transfer leadership to TS 08bfad1becd9437aa9f9a261e4ed757d
I20260709 13:20:29.625912 20027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe"
dest_uuid: "11506540476f404ebae61fb1f046e3e7"
mode: GRACEFUL
new_leader_uuid: "26508b382af34e7892bddf2664f29aa6"
 from {username='slave'} at 127.0.0.1:52538
I20260709 13:20:29.626590 20027 raft_consensus.cc:606] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 LEADER]: Received request to transfer leadership to TS 26508b382af34e7892bddf2664f29aa6
I20260709 13:20:29.641006 20101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b"
dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
mode: GRACEFUL
new_leader_uuid: "26508b382af34e7892bddf2664f29aa6"
 from {username='slave'} at 127.0.0.1:48294
I20260709 13:20:29.641570 20101 raft_consensus.cc:606] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 LEADER]: Received request to transfer leadership to TS 26508b382af34e7892bddf2664f29aa6
I20260709 13:20:29.684453 20149 consensus_queue.cc:1048] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:29.697717 20149 consensus_queue.cc:1048] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:29.839200 20149 consensus_queue.cc:1048] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:29.846163 20155 raft_consensus.cc:993] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: : Instructing follower 08bfad1becd9437aa9f9a261e4ed757d to start an election
I20260709 13:20:29.846990 20149 raft_consensus.cc:1081] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Signalling peer 08bfad1becd9437aa9f9a261e4ed757d to start an election
I20260709 13:20:29.849411 20100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164"
dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
 from {username='slave'} at 127.0.0.1:48286
I20260709 13:20:29.850062 20100 raft_consensus.cc:493] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.850445 20100 raft_consensus.cc:3060] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.852767 20155 consensus_queue.cc:1048] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:29.859041 20100 raft_consensus.cc:515] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.864570 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164" candidate_uuid: "08bfad1becd9437aa9f9a261e4ed757d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26508b382af34e7892bddf2664f29aa6"
I20260709 13:20:29.865239 19952 raft_consensus.cc:3055] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.865617 19952 raft_consensus.cc:740] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Running, Role: LEADER
I20260709 13:20:29.866470 19952 consensus_queue.cc:260] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.867731 19952 raft_consensus.cc:3060] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.868000 20147 consensus_queue.cc:1048] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:29.873771 20100 leader_election.cc:290] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [CANDIDATE]: Term 2 election: Requested vote from peers 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783), 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595)
I20260709 13:20:29.876742 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ca2a4de9be41abb464267596c7b164" candidate_uuid: "08bfad1becd9437aa9f9a261e4ed757d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11506540476f404ebae61fb1f046e3e7"
I20260709 13:20:29.877291 19952 raft_consensus.cc:2468] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08bfad1becd9437aa9f9a261e4ed757d in term 2.
I20260709 13:20:29.877509 20027 raft_consensus.cc:3060] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.878711 20064 leader_election.cc:304] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08bfad1becd9437aa9f9a261e4ed757d, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:29.879684 20148 raft_consensus.cc:2804] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.880208 20148 raft_consensus.cc:697] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 2 LEADER]: Becoming Leader. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Running, Role: LEADER
I20260709 13:20:29.881062 20148 consensus_queue.cc:237] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.886262 20027 raft_consensus.cc:2468] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08bfad1becd9437aa9f9a261e4ed757d in term 2.
I20260709 13:20:29.887010 20147 raft_consensus.cc:993] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: : Instructing follower 26508b382af34e7892bddf2664f29aa6 to start an election
I20260709 13:20:29.887524 20147 raft_consensus.cc:1081] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 LEADER]: Signalling peer 26508b382af34e7892bddf2664f29aa6 to start an election
I20260709 13:20:29.889587 19951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe"
dest_uuid: "26508b382af34e7892bddf2664f29aa6"
 from {username='slave'} at 127.0.0.1:53958
I20260709 13:20:29.891996 19848 catalog_manager.cc:5697] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d reported cstate change: term changed from 1 to 2, leader changed from 26508b382af34e7892bddf2664f29aa6 (127.8.186.193) to 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195). New cstate: current_term: 2 leader_uuid: "08bfad1becd9437aa9f9a261e4ed757d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.894287 19951 raft_consensus.cc:493] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.894438 20147 consensus_queue.cc:1048] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:29.894970 19951 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.904615 19951 raft_consensus.cc:515] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.911227 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11506540476f404ebae61fb1f046e3e7"
I20260709 13:20:29.912777 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
I20260709 13:20:29.913133 20027 raft_consensus.cc:3055] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.913738 20027 raft_consensus.cc:740] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Running, Role: LEADER
I20260709 13:20:29.914827 20027 consensus_queue.cc:260] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.915373 19951 leader_election.cc:290] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 2 election: Requested vote from peers 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:29.915910 20027 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.922499 20027 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 2.
I20260709 13:20:29.923480 19917 leader_election.cc:304] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11506540476f404ebae61fb1f046e3e7, 26508b382af34e7892bddf2664f29aa6; no voters: 08bfad1becd9437aa9f9a261e4ed757d
I20260709 13:20:29.924418 20155 raft_consensus.cc:2804] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.924896 20155 raft_consensus.cc:697] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Becoming Leader. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Running, Role: LEADER
I20260709 13:20:29.925613 20155 consensus_queue.cc:237] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:29.931516 19848 catalog_manager.cc:5697] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 reported cstate change: term changed from 1 to 2, leader changed from 11506540476f404ebae61fb1f046e3e7 (127.8.186.194) to 26508b382af34e7892bddf2664f29aa6 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "26508b382af34e7892bddf2664f29aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.123911 20148 consensus_queue.cc:1048] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [LEADER]: Connected to new peer: Peer: permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:30.131274 20175 raft_consensus.cc:993] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: : Instructing follower 26508b382af34e7892bddf2664f29aa6 to start an election
I20260709 13:20:30.133100 20148 raft_consensus.cc:1081] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 LEADER]: Signalling peer 26508b382af34e7892bddf2664f29aa6 to start an election
I20260709 13:20:30.136556 19952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b"
dest_uuid: "26508b382af34e7892bddf2664f29aa6"
 from {username='slave'} at 127.0.0.1:53974
I20260709 13:20:30.137171 19952 raft_consensus.cc:493] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.137557 19952 raft_consensus.cc:3060] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.139175 20189 consensus_queue.cc:1048] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [LEADER]: Connected to new peer: Peer: permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:30.145946 19952 raft_consensus.cc:515] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:30.151535 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
I20260709 13:20:30.152097 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3475db4b11db40ad99e6ebacaa5b9d9b" candidate_uuid: "26508b382af34e7892bddf2664f29aa6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11506540476f404ebae61fb1f046e3e7"
I20260709 13:20:30.152288 20100 raft_consensus.cc:3055] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:30.152781 20027 raft_consensus.cc:3060] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.152999 20100 raft_consensus.cc:740] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08bfad1becd9437aa9f9a261e4ed757d, State: Running, Role: LEADER
I20260709 13:20:30.154518 20100 consensus_queue.cc:260] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:30.155675 20100 raft_consensus.cc:3060] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.159260 19952 leader_election.cc:290] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 2 election: Requested vote from peers 11506540476f404ebae61fb1f046e3e7 (127.8.186.194:34595), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:30.159525 20027 raft_consensus.cc:2468] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 2.
I20260709 13:20:30.160712 19917 leader_election.cc:304] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11506540476f404ebae61fb1f046e3e7, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:30.161377 20155 raft_consensus.cc:2804] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:30.161793 20155 raft_consensus.cc:697] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Becoming Leader. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Running, Role: LEADER
I20260709 13:20:30.162523 20155 consensus_queue.cc:237] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:30.163260 20100 raft_consensus.cc:2468] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26508b382af34e7892bddf2664f29aa6 in term 2.
I20260709 13:20:30.168494 19848 catalog_manager.cc:5697] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 reported cstate change: term changed from 1 to 2, leader changed from 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195) to 26508b382af34e7892bddf2664f29aa6 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "26508b382af34e7892bddf2664f29aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.311962 19952 raft_consensus.cc:1275] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Refusing update from remote peer 08bfad1becd9437aa9f9a261e4ed757d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:30.313207 20189 consensus_queue.cc:1048] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [LEADER]: Connected to new peer: Peer: permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.321120 20027 raft_consensus.cc:1275] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Refusing update from remote peer 08bfad1becd9437aa9f9a261e4ed757d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:30.322789 20175 consensus_queue.cc:1048] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [LEADER]: Connected to new peer: Peer: permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.427572  8939 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:20:30.429139  8939 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:20:30.429482  8939 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:20:30.441131 19952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe"
dest_uuid: "26508b382af34e7892bddf2664f29aa6"
mode: GRACEFUL
new_leader_uuid: "11506540476f404ebae61fb1f046e3e7"
 from {username='slave'} at 127.0.0.1:53992
I20260709 13:20:30.441651 19952 raft_consensus.cc:606] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Received request to transfer leadership to TS 11506540476f404ebae61fb1f046e3e7
I20260709 13:20:30.442731  8939 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:20:30.539824 20100 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:30.539922 20027 raft_consensus.cc:1275] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Refusing update from remote peer 26508b382af34e7892bddf2664f29aa6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:30.541407 20149 consensus_queue.cc:1048] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.546355 20155 raft_consensus.cc:993] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: : Instructing follower 11506540476f404ebae61fb1f046e3e7 to start an election
I20260709 13:20:30.546885 20155 raft_consensus.cc:1081] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Signalling peer 11506540476f404ebae61fb1f046e3e7 to start an election
I20260709 13:20:30.547151 20100 raft_consensus.cc:1275] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Refusing update from remote peer 26508b382af34e7892bddf2664f29aa6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:30.548718 20155 consensus_queue.cc:1048] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.549113 20026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe"
dest_uuid: "11506540476f404ebae61fb1f046e3e7"
 from {username='slave'} at 127.0.0.1:52518
I20260709 13:20:30.550573 20026 raft_consensus.cc:493] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.551010 20026 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.560454 20026 raft_consensus.cc:515] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:30.562948 20026 leader_election.cc:290] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [CANDIDATE]: Term 3 election: Requested vote from peers 26508b382af34e7892bddf2664f29aa6 (127.8.186.193:44783), 08bfad1becd9437aa9f9a261e4ed757d (127.8.186.195:41183)
I20260709 13:20:30.563365 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "11506540476f404ebae61fb1f046e3e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26508b382af34e7892bddf2664f29aa6"
I20260709 13:20:30.564113 19952 raft_consensus.cc:3055] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:30.564376 19952 raft_consensus.cc:740] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26508b382af34e7892bddf2664f29aa6, State: Running, Role: LEADER
I20260709 13:20:30.564687 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a1911a6ef43f5a014f53e1f695cbe" candidate_uuid: "11506540476f404ebae61fb1f046e3e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08bfad1becd9437aa9f9a261e4ed757d"
I20260709 13:20:30.565420 20100 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.565143 19952 consensus_queue.cc:260] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:30.567097 19952 raft_consensus.cc:3060] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.573523 20100 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11506540476f404ebae61fb1f046e3e7 in term 3.
I20260709 13:20:30.573734 19952 raft_consensus.cc:2468] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11506540476f404ebae61fb1f046e3e7 in term 3.
I20260709 13:20:30.574891 19990 leader_election.cc:304] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11506540476f404ebae61fb1f046e3e7, 26508b382af34e7892bddf2664f29aa6; no voters: 
I20260709 13:20:30.575714 20147 raft_consensus.cc:2804] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:30.576866 20147 raft_consensus.cc:697] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 3 LEADER]: Becoming Leader. State: Replica: 11506540476f404ebae61fb1f046e3e7, State: Running, Role: LEADER
I20260709 13:20:30.577729 20147 consensus_queue.cc:237] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } }
I20260709 13:20:30.586205 19848 catalog_manager.cc:5697] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 reported cstate change: term changed from 2 to 3, leader changed from 26508b382af34e7892bddf2664f29aa6 (127.8.186.193) to 11506540476f404ebae61fb1f046e3e7 (127.8.186.194). New cstate: current_term: 3 leader_uuid: "11506540476f404ebae61fb1f046e3e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26508b382af34e7892bddf2664f29aa6" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 44783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11506540476f404ebae61fb1f046e3e7" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08bfad1becd9437aa9f9a261e4ed757d" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 41183 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.656915  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
I20260709 13:20:30.676681  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:30.677351  8939 tablet_replica.cc:333] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: stopping tablet replica
I20260709 13:20:30.677903  8939 raft_consensus.cc:2243] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:30.678539  8939 pending_rounds.cc:70] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: Trying to abort 1 pending ops.
I20260709 13:20:30.678730  8939 pending_rounds.cc:77] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638830753431552 op_type: NO_OP noop_request { }
I20260709 13:20:30.679004  8939 raft_consensus.cc:2889] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:30.679273  8939 raft_consensus.cc:2272] T 3475db4b11db40ad99e6ebacaa5b9d9b P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.682113  8939 tablet_replica.cc:333] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6: stopping tablet replica
I20260709 13:20:30.682683  8939 raft_consensus.cc:2243] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.683400  8939 raft_consensus.cc:2272] T 22ca2a4de9be41abb464267596c7b164 P 26508b382af34e7892bddf2664f29aa6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.685746  8939 tablet_replica.cc:333] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6: stopping tablet replica
I20260709 13:20:30.686290  8939 raft_consensus.cc:2243] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.686704  8939 raft_consensus.cc:2272] T e30a1911a6ef43f5a014f53e1f695cbe P 26508b382af34e7892bddf2664f29aa6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.688939  8939 tablet_replica.cc:333] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6: stopping tablet replica
I20260709 13:20:30.689422  8939 raft_consensus.cc:2243] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:30.690290  8939 raft_consensus.cc:2272] T 8826a0923882408b85810db9a23fa2d1 P 26508b382af34e7892bddf2664f29aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.713776  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
I20260709 13:20:30.726665  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
I20260709 13:20:30.743949  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:30.744647  8939 tablet_replica.cc:333] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7: stopping tablet replica
I20260709 13:20:30.745211  8939 raft_consensus.cc:2243] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.745675  8939 raft_consensus.cc:2272] T 3475db4b11db40ad99e6ebacaa5b9d9b P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.748201  8939 tablet_replica.cc:333] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7: stopping tablet replica
I20260709 13:20:30.748736  8939 raft_consensus.cc:2243] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.749174  8939 raft_consensus.cc:2272] T 22ca2a4de9be41abb464267596c7b164 P 11506540476f404ebae61fb1f046e3e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.751446  8939 tablet_replica.cc:333] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: stopping tablet replica
I20260709 13:20:30.752023  8939 raft_consensus.cc:2243] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:30.752679  8939 pending_rounds.cc:70] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: Trying to abort 1 pending ops.
I20260709 13:20:30.752866  8939 pending_rounds.cc:77] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638832456728576 op_type: NO_OP noop_request { }
I20260709 13:20:30.753120  8939 raft_consensus.cc:2889] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:30.753374  8939 raft_consensus.cc:2272] T e30a1911a6ef43f5a014f53e1f695cbe P 11506540476f404ebae61fb1f046e3e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.755507  8939 tablet_replica.cc:333] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7: stopping tablet replica
I20260709 13:20:30.756021  8939 raft_consensus.cc:2243] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.756425  8939 raft_consensus.cc:2272] T 8826a0923882408b85810db9a23fa2d1 P 11506540476f404ebae61fb1f046e3e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.778491  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
I20260709 13:20:30.792238  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
I20260709 13:20:30.810246  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:30.810880  8939 tablet_replica.cc:333] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d: stopping tablet replica
I20260709 13:20:30.811434  8939 raft_consensus.cc:2243] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.811936  8939 raft_consensus.cc:2272] T 3475db4b11db40ad99e6ebacaa5b9d9b P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.814397  8939 tablet_replica.cc:333] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d: stopping tablet replica
I20260709 13:20:30.814963  8939 raft_consensus.cc:2243] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:30.815892  8939 raft_consensus.cc:2272] T 22ca2a4de9be41abb464267596c7b164 P 08bfad1becd9437aa9f9a261e4ed757d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.818676  8939 tablet_replica.cc:333] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d: stopping tablet replica
I20260709 13:20:30.819684  8939 raft_consensus.cc:2243] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.820590  8939 raft_consensus.cc:2272] T e30a1911a6ef43f5a014f53e1f695cbe P 08bfad1becd9437aa9f9a261e4ed757d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.823022  8939 tablet_replica.cc:333] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d: stopping tablet replica
I20260709 13:20:30.823521  8939 raft_consensus.cc:2243] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:30.824002  8939 raft_consensus.cc:2272] T 8826a0923882408b85810db9a23fa2d1 P 08bfad1becd9437aa9f9a261e4ed757d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.846665  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:20:30.860476  8939 master.cc:562] Master@127.8.186.254:40383 shutting down...
I20260709 13:20:30.874647  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:30.875213  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:30.875519  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P cdea71324ef842d8b47c51ad7500befa: stopping tablet replica
I20260709 13:20:30.894474  8939 master.cc:584] Master@127.8.186.254:40383 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2554 ms)
[----------] 6 tests from LeaderRebalancerTest (315004 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:20:30.921916  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:41483
I20260709 13:20:30.923004  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:30.927830 20195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:30.927995 20196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:30.929428 20198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:30.930375  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:30.931195  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:30.931365  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:30.931524  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603230931506 us; error 0 us; skew 500 ppm
I20260709 13:20:30.932265  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:30.934544  8939 webserver.cc:533] Webserver started at http://127.8.186.254:33917/ using document root <none> and password file <none>
I20260709 13:20:30.935025  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:30.935199  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:30.935456  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:30.936584  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1"
format_stamp: "Formatted at 2026-07-09 13:20:30 on dist-test-slave-mq27"
I20260709 13:20:30.941005  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:30.944437 20203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:30.945201  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:30.945492  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1"
format_stamp: "Formatted at 2026-07-09 13:20:30 on dist-test-slave-mq27"
I20260709 13:20:30.945786  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:30.960896  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:30.961928  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:30.998425  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:41483
I20260709 13:20:30.998538 20254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:41483 every 8 connection(s)
I20260709 13:20:31.002283 20255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.014636 20255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1: Bootstrap starting.
I20260709 13:20:31.019301 20255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.023600 20255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1: No bootstrap required, opened a new log
I20260709 13:20:31.025872 20255 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" member_type: VOTER }
I20260709 13:20:31.026250 20255 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.026475 20255 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c44e127cdd4f65ac1acd3b9fbf34e1, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.027069 20255 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" member_type: VOTER }
I20260709 13:20:31.027499 20255 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:31.027710 20255 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:31.027979 20255 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.033174 20255 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" member_type: VOTER }
I20260709 13:20:31.033726 20255 leader_election.cc:304] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3c44e127cdd4f65ac1acd3b9fbf34e1; no voters: 
I20260709 13:20:31.034884 20255 leader_election.cc:290] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:31.035229 20258 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:31.036643 20258 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 1 LEADER]: Becoming Leader. State: Replica: b3c44e127cdd4f65ac1acd3b9fbf34e1, State: Running, Role: LEADER
I20260709 13:20:31.037240 20258 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" member_type: VOTER }
I20260709 13:20:31.037789 20255 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:31.040026 20259 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" member_type: VOTER } }
I20260709 13:20:31.040032 20260 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3c44e127cdd4f65ac1acd3b9fbf34e1. Latest consensus state: current_term: 1 leader_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c44e127cdd4f65ac1acd3b9fbf34e1" member_type: VOTER } }
I20260709 13:20:31.040815 20260 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:31.041349 20259 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:31.045751 20263 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:31.052886 20263 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:31.053941  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:31.061887 20263 catalog_manager.cc:1383] Generated new cluster ID: 5177b728492a4a6c97485874c79aedd0
I20260709 13:20:31.062212 20263 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:31.084498 20263 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:31.085857 20263 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:31.106143 20263 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1: Generated new TSK 0
I20260709 13:20:31.106755 20263 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:31.121202  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:31.127375 20276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:31.128587 20277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:31.129559 20279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:31.129844  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:31.130833  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:31.131038  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:31.131165  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603231131154 us; error 0 us; skew 500 ppm
I20260709 13:20:31.131690  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:31.134034  8939 webserver.cc:533] Webserver started at http://127.8.186.193:36291/ using document root <none> and password file <none>
I20260709 13:20:31.134486  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:31.134650  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:31.134917  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:31.136121  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "90b4ce8af2fc4630929b3af07191b675"
format_stamp: "Formatted at 2026-07-09 13:20:31 on dist-test-slave-mq27"
I20260709 13:20:31.140743  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:20:31.144074 20284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.144877  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:20:31.145155  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "90b4ce8af2fc4630929b3af07191b675"
format_stamp: "Formatted at 2026-07-09 13:20:31 on dist-test-slave-mq27"
I20260709 13:20:31.145473  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:31.158027  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:31.159168  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:31.160897  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:31.163306  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:31.163508  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.163779  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:31.163939  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:31.202781  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:37051
I20260709 13:20:31.202900 20346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:37051 every 8 connection(s)
I20260709 13:20:31.207526  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:31.214999 20351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:31.217743 20352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:31.220765 20355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:31.221721 20347 heartbeater.cc:344] Connected to a master server at 127.8.186.254:41483
I20260709 13:20:31.222158 20347 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:31.222433  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:31.222911 20347 heartbeater.cc:507] Master 127.8.186.254:41483 requested a full tablet report, sending...
I20260709 13:20:31.223984  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:31.224275  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:31.224457  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603231224440 us; error 0 us; skew 500 ppm
I20260709 13:20:31.225159 20220 ts_manager.cc:194] Registered new tserver with Master: 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051)
I20260709 13:20:31.225265  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:31.227712 20220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54690
I20260709 13:20:31.228307  8939 webserver.cc:533] Webserver started at http://127.8.186.194:45181/ using document root <none> and password file <none>
I20260709 13:20:31.228940  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:31.229137  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:31.229449  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:31.230820  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
format_stamp: "Formatted at 2026-07-09 13:20:31 on dist-test-slave-mq27"
I20260709 13:20:31.235114  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:20:31.238441 20359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.239296  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:31.239576  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
format_stamp: "Formatted at 2026-07-09 13:20:31 on dist-test-slave-mq27"
I20260709 13:20:31.239872  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:31.254901  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:31.256009  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:31.257436  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:31.259701  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:31.259902  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.260144  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:31.260285  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.299314  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:42227
I20260709 13:20:31.299429 20421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:42227 every 8 connection(s)
I20260709 13:20:31.304292  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:31.311403 20425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:31.313298 20426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:31.314450 20428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:31.316237  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:31.316594 20422 heartbeater.cc:344] Connected to a master server at 127.8.186.254:41483
I20260709 13:20:31.317065 20422 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:31.317314  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:31.317579  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:31.317741  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603231317728 us; error 0 us; skew 500 ppm
I20260709 13:20:31.317847 20422 heartbeater.cc:507] Master 127.8.186.254:41483 requested a full tablet report, sending...
I20260709 13:20:31.318343  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:31.320142 20220 ts_manager.cc:194] Registered new tserver with Master: 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:31.321552 20220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54704
I20260709 13:20:31.322772  8939 webserver.cc:533] Webserver started at http://127.8.186.195:44077/ using document root <none> and password file <none>
I20260709 13:20:31.323451  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:31.323648  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:31.323920  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:31.325011  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
format_stamp: "Formatted at 2026-07-09 13:20:31 on dist-test-slave-mq27"
I20260709 13:20:31.329581  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:31.333528 20433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.334430  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:20:31.334750  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
format_stamp: "Formatted at 2026-07-09 13:20:31 on dist-test-slave-mq27"
I20260709 13:20:31.335036  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:31.362483  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:31.363879  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:31.365798  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:31.368978  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:31.369277  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.369578  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:31.369789  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:31.415846  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:40477
I20260709 13:20:31.415992 20495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:40477 every 8 connection(s)
I20260709 13:20:31.429812 20496 heartbeater.cc:344] Connected to a master server at 127.8.186.254:41483
I20260709 13:20:31.430320 20496 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:31.431098 20496 heartbeater.cc:507] Master 127.8.186.254:41483 requested a full tablet report, sending...
I20260709 13:20:31.433178 20220 ts_manager.cc:194] Registered new tserver with Master: 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:31.433996  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014805286s
I20260709 13:20:31.434592 20220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54714
I20260709 13:20:31.460075 20220 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54722:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:31.462662 20220 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:31.533953 20312 tablet_service.cc:1511] Processing CreateTablet for tablet ef537db43f0d41e2837791d64bd94f7a (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:31.535393 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef537db43f0d41e2837791d64bd94f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.536199 20308 tablet_service.cc:1511] Processing CreateTablet for tablet 0105ac9286ab4be9a2e839ebaba3d067 (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:31.536803 20311 tablet_service.cc:1511] Processing CreateTablet for tablet c55ab9435e8b476ca4bdd6f956f9d00f (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:31.537722 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0105ac9286ab4be9a2e839ebaba3d067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.539000 20310 tablet_service.cc:1511] Processing CreateTablet for tablet bbab503d13b34aa887b5003be876e11a (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:31.540484 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbab503d13b34aa887b5003be876e11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.544874 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 6016352b674649c09f0e8445b01cf523 (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:31.546361 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6016352b674649c09f0e8445b01cf523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.547726 20387 tablet_service.cc:1511] Processing CreateTablet for tablet ef537db43f0d41e2837791d64bd94f7a (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:31.549093 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55ab9435e8b476ca4bdd6f956f9d00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.549527 20384 tablet_service.cc:1511] Processing CreateTablet for tablet 6016352b674649c09f0e8445b01cf523 (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:31.551697 20383 tablet_service.cc:1511] Processing CreateTablet for tablet 0105ac9286ab4be9a2e839ebaba3d067 (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:31.553939 20385 tablet_service.cc:1511] Processing CreateTablet for tablet bbab503d13b34aa887b5003be876e11a (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:31.549180 20387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef537db43f0d41e2837791d64bd94f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.548251 20386 tablet_service.cc:1511] Processing CreateTablet for tablet c55ab9435e8b476ca4bdd6f956f9d00f (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:31.556999 20386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55ab9435e8b476ca4bdd6f956f9d00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.557899 20385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbab503d13b34aa887b5003be876e11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.559677 20383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0105ac9286ab4be9a2e839ebaba3d067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.560818 20384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6016352b674649c09f0e8445b01cf523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.563812 20307 tablet_service.cc:1511] Processing CreateTablet for tablet a8e6b8eb111f42d7845337f0ac05bbbe (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:31.565310 20307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e6b8eb111f42d7845337f0ac05bbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.576278 20382 tablet_service.cc:1511] Processing CreateTablet for tablet a8e6b8eb111f42d7845337f0ac05bbbe (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:31.577816 20382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e6b8eb111f42d7845337f0ac05bbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.599535 20381 tablet_service.cc:1511] Processing CreateTablet for tablet 3a9755bf638a41beaf150bdd704137aa (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:31.601315 20381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a9755bf638a41beaf150bdd704137aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.606825 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 733500534d214a1082a887479eaac70d (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:31.608310 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733500534d214a1082a887479eaac70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.608742 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 3a9755bf638a41beaf150bdd704137aa (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:31.608886 20510 tablet_bootstrap.cc:492] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:31.614245 20380 tablet_service.cc:1511] Processing CreateTablet for tablet 733500534d214a1082a887479eaac70d (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:31.615644 20380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733500534d214a1082a887479eaac70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.610052 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a9755bf638a41beaf150bdd704137aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.634418 20459 tablet_service.cc:1511] Processing CreateTablet for tablet bbab503d13b34aa887b5003be876e11a (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:31.635177 20510 tablet_bootstrap.cc:654] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.638139 20461 tablet_service.cc:1511] Processing CreateTablet for tablet ef537db43f0d41e2837791d64bd94f7a (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:31.638438 20457 tablet_service.cc:1511] Processing CreateTablet for tablet 0105ac9286ab4be9a2e839ebaba3d067 (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:31.636330 20460 tablet_service.cc:1511] Processing CreateTablet for tablet c55ab9435e8b476ca4bdd6f956f9d00f (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:31.640486 20456 tablet_service.cc:1511] Processing CreateTablet for tablet a8e6b8eb111f42d7845337f0ac05bbbe (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:31.642648 20455 tablet_service.cc:1511] Processing CreateTablet for tablet 3a9755bf638a41beaf150bdd704137aa (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:31.644856 20454 tablet_service.cc:1511] Processing CreateTablet for tablet 733500534d214a1082a887479eaac70d (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:31.636799 20458 tablet_service.cc:1511] Processing CreateTablet for tablet 6016352b674649c09f0e8445b01cf523 (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:31.648644 20459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbab503d13b34aa887b5003be876e11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.649966 20457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0105ac9286ab4be9a2e839ebaba3d067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.651125 20456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e6b8eb111f42d7845337f0ac05bbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.651563 20307 tablet_service.cc:1511] Processing CreateTablet for tablet 4f759c276920467baa15209bb0a49a5e (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:31.652123 20458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6016352b674649c09f0e8445b01cf523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.655637 20387 tablet_service.cc:1511] Processing CreateTablet for tablet 4f759c276920467baa15209bb0a49a5e (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:31.656476 20307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f759c276920467baa15209bb0a49a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.657102 20387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f759c276920467baa15209bb0a49a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.656209 20454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 733500534d214a1082a887479eaac70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.662595 20461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef537db43f0d41e2837791d64bd94f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.665382 20455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a9755bf638a41beaf150bdd704137aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.669936 20460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55ab9435e8b476ca4bdd6f956f9d00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.670616 20511 tablet_bootstrap.cc:492] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.667542 20453 tablet_service.cc:1511] Processing CreateTablet for tablet 4f759c276920467baa15209bb0a49a5e (DEFAULT_TABLE table=test-workload [id=7f1af255e80a4320a8fcf5745030a123]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:31.672801 20453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f759c276920467baa15209bb0a49a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:31.683023 20511 tablet_bootstrap.cc:654] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.713254 20511 tablet_bootstrap.cc:492] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:31.713825 20511 ts_tablet_manager.cc:1403] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.009s
I20260709 13:20:31.714218 20514 tablet_bootstrap.cc:492] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:31.716745 20511 raft_consensus.cc:359] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.718544 20511 raft_consensus.cc:385] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.718837 20511 raft_consensus.cc:740] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.719556 20511 consensus_queue.cc:260] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.722854 20422 heartbeater.cc:499] Master 127.8.186.254:41483 was elected leader, sending a full tablet report...
I20260709 13:20:31.723374 20511 ts_tablet_manager.cc:1434] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:20:31.724623 20511 tablet_bootstrap.cc:492] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.725708 20514 tablet_bootstrap.cc:654] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.730665 20511 tablet_bootstrap.cc:654] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.738832 20510 tablet_bootstrap.cc:492] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:31.739384 20510 ts_tablet_manager.cc:1403] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.010s
I20260709 13:20:31.749488 20510 raft_consensus.cc:359] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.749981 20511 tablet_bootstrap.cc:492] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:31.750279 20510 raft_consensus.cc:385] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.750617 20510 raft_consensus.cc:740] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.750842 20511 ts_tablet_manager.cc:1403] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.005s
I20260709 13:20:31.753961 20511 raft_consensus.cc:359] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.754801 20511 raft_consensus.cc:385] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.755142 20511 raft_consensus.cc:740] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.756134 20511 consensus_queue.cc:260] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.758601 20511 ts_tablet_manager.cc:1434] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:20:31.759650 20511 tablet_bootstrap.cc:492] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.759305 20510 consensus_queue.cc:260] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.766577 20511 tablet_bootstrap.cc:654] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.768558 20347 heartbeater.cc:499] Master 127.8.186.254:41483 was elected leader, sending a full tablet report...
I20260709 13:20:31.769423 20510 ts_tablet_manager.cc:1434] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:20:31.770028 20514 tablet_bootstrap.cc:492] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:31.770563 20514 ts_tablet_manager.cc:1403] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.020s
I20260709 13:20:31.773591 20514 raft_consensus.cc:359] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.774408 20514 raft_consensus.cc:385] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.774737 20514 raft_consensus.cc:740] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.775586 20514 consensus_queue.cc:260] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.770587 20510 tablet_bootstrap.cc:492] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:31.780886 20496 heartbeater.cc:499] Master 127.8.186.254:41483 was elected leader, sending a full tablet report...
I20260709 13:20:31.781492 20514 ts_tablet_manager.cc:1434] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:20:31.782802 20514 tablet_bootstrap.cc:492] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:31.783814 20510 tablet_bootstrap.cc:654] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.789119 20514 tablet_bootstrap.cc:654] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.792605 20510 tablet_bootstrap.cc:492] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:31.792919 20511 tablet_bootstrap.cc:492] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:31.793141 20510 ts_tablet_manager.cc:1403] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:20:31.793565 20511 ts_tablet_manager.cc:1403] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.003s
I20260709 13:20:31.796202 20510 raft_consensus.cc:359] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.797066 20510 raft_consensus.cc:385] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.796770 20511 raft_consensus.cc:359] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.797435 20510 raft_consensus.cc:740] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.797674 20511 raft_consensus.cc:385] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.798194 20511 raft_consensus.cc:740] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.798432 20510 consensus_queue.cc:260] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.799229 20511 consensus_queue.cc:260] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.800786 20510 ts_tablet_manager.cc:1434] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:31.801888 20510 tablet_bootstrap.cc:492] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:31.804953 20511 ts_tablet_manager.cc:1434] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:31.806257 20511 tablet_bootstrap.cc:492] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.809463 20510 tablet_bootstrap.cc:654] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.820705 20511 tablet_bootstrap.cc:654] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.821954 20510 tablet_bootstrap.cc:492] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:31.822551 20510 ts_tablet_manager.cc:1403] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:20:31.825475 20510 raft_consensus.cc:359] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.826186 20510 raft_consensus.cc:385] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.826467 20510 raft_consensus.cc:740] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.827303 20510 consensus_queue.cc:260] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.831319 20510 ts_tablet_manager.cc:1434] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:31.832417 20510 tablet_bootstrap.cc:492] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:31.838210 20511 tablet_bootstrap.cc:492] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:31.838881 20511 ts_tablet_manager.cc:1403] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.005s
I20260709 13:20:31.839766 20510 tablet_bootstrap.cc:654] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.842245 20511 raft_consensus.cc:359] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.843076 20511 raft_consensus.cc:385] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.843364 20511 raft_consensus.cc:740] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.844254 20511 consensus_queue.cc:260] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.848223 20511 ts_tablet_manager.cc:1434] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:20:31.849355 20511 tablet_bootstrap.cc:492] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.849714 20514 tablet_bootstrap.cc:492] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:31.850281 20514 ts_tablet_manager.cc:1403] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.037s
I20260709 13:20:31.850733 20510 tablet_bootstrap.cc:492] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:31.851282 20510 ts_tablet_manager.cc:1403] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:20:31.853175 20514 raft_consensus.cc:359] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.853922 20514 raft_consensus.cc:385] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.854323 20514 raft_consensus.cc:740] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.853964 20510 raft_consensus.cc:359] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.854861 20510 raft_consensus.cc:385] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.855170 20510 raft_consensus.cc:740] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.855286 20514 consensus_queue.cc:260] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.855962 20511 tablet_bootstrap.cc:654] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.857489 20514 ts_tablet_manager.cc:1434] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:31.856035 20510 consensus_queue.cc:260] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.859802 20514 tablet_bootstrap.cc:492] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:31.860944 20510 ts_tablet_manager.cc:1434] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:20:31.862138 20510 tablet_bootstrap.cc:492] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:31.867151 20514 tablet_bootstrap.cc:654] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.867993 20510 tablet_bootstrap.cc:654] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.889490 20510 tablet_bootstrap.cc:492] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:31.889645 20511 tablet_bootstrap.cc:492] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:31.890072 20510 ts_tablet_manager.cc:1403] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.017s
I20260709 13:20:31.890259 20511 ts_tablet_manager.cc:1403] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.014s
I20260709 13:20:31.890353 20514 tablet_bootstrap.cc:492] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:31.891027 20514 ts_tablet_manager.cc:1403] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.011s
I20260709 13:20:31.892700 20510 raft_consensus.cc:359] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.893275 20510 raft_consensus.cc:385] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.893545 20510 raft_consensus.cc:740] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.893580 20511 raft_consensus.cc:359] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.893865 20514 raft_consensus.cc:359] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.894397 20511 raft_consensus.cc:385] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.894618 20514 raft_consensus.cc:385] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.894309 20510 consensus_queue.cc:260] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.894951 20511 raft_consensus.cc:740] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.895013 20514 raft_consensus.cc:740] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.895889 20514 consensus_queue.cc:260] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.896092 20511 consensus_queue.cc:260] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.896643 20510 ts_tablet_manager.cc:1434] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:31.897759 20510 tablet_bootstrap.cc:492] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:31.901772 20511 ts_tablet_manager.cc:1434] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:20:31.902311 20514 ts_tablet_manager.cc:1434] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:31.902978 20511 tablet_bootstrap.cc:492] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.903409 20514 tablet_bootstrap.cc:492] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:31.904126 20510 tablet_bootstrap.cc:654] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.910351 20511 tablet_bootstrap.cc:654] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.911433 20520 raft_consensus.cc:493] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.910351 20514 tablet_bootstrap.cc:654] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:31.911989 20520 raft_consensus.cc:515] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.928167 20520 leader_election.cc:290] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:31.928747 20520 raft_consensus.cc:493] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.929198 20520 raft_consensus.cc:515] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.931144 20520 leader_election.cc:290] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:31.933938 20514 tablet_bootstrap.cc:492] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:31.935557 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:31.936380 20322 raft_consensus.cc:2468] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:31.937943 20510 tablet_bootstrap.cc:492] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:31.938694 20436 leader_election.cc:304] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:31.938139 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:31.939656 20520 raft_consensus.cc:2804] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:31.940109 20514 ts_tablet_manager.cc:1403] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 13:20:31.940119 20520 raft_consensus.cc:493] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.940184 20322 raft_consensus.cc:2468] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:31.938706 20510 ts_tablet_manager.cc:1403] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 13:20:31.942071 20436 leader_election.cc:304] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:31.942951 20531 raft_consensus.cc:2804] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:31.940953 20520 raft_consensus.cc:3060] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.943411 20531 raft_consensus.cc:493] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.943928 20531 raft_consensus.cc:3060] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.943598 20514 raft_consensus.cc:359] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.944494 20514 raft_consensus.cc:385] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.944818 20514 raft_consensus.cc:740] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.945595 20514 consensus_queue.cc:260] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.946885 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:31.947652 20397 raft_consensus.cc:2468] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:31.943116 20511 tablet_bootstrap.cc:492] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:31.948726 20511 ts_tablet_manager.cc:1403] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.016s
I20260709 13:20:31.948958 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:31.949661 20396 raft_consensus.cc:2468] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:31.952226 20511 raft_consensus.cc:359] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.953053 20511 raft_consensus.cc:385] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.953377 20511 raft_consensus.cc:740] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.954218 20511 consensus_queue.cc:260] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.955093 20510 raft_consensus.cc:359] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.955817 20510 raft_consensus.cc:385] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:31.956097 20510 raft_consensus.cc:740] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:31.952898 20531 raft_consensus.cc:515] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.958665 20531 leader_election.cc:290] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:31.960391 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:31.961023 20322 raft_consensus.cc:3060] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.963649 20520 raft_consensus.cc:515] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.964965 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:31.965583 20396 raft_consensus.cc:3060] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.965926 20520 leader_election.cc:290] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:31.956578 20511 ts_tablet_manager.cc:1434] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:31.967674 20322 raft_consensus.cc:2468] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:31.971412 20396 raft_consensus.cc:2468] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:31.973668 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:31.981720 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:31.974320 20510 consensus_queue.cc:260] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.978343 20514 ts_tablet_manager.cc:1434] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.038s	user 0.015s	sys 0.020s
I20260709 13:20:31.982146 20397 raft_consensus.cc:3060] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.982348 20322 raft_consensus.cc:3060] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:31.974390 20436 leader_election.cc:304] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:31.984120 20534 raft_consensus.cc:2804] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:31.984615 20534 raft_consensus.cc:697] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:31.985445 20534 consensus_queue.cc:237] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.987067 20518 raft_consensus.cc:493] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.987551 20518 raft_consensus.cc:515] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.989737 20322 raft_consensus.cc:2468] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:31.990108 20397 raft_consensus.cc:2468] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:31.991477 20436 leader_election.cc:304] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:31.991788 20514 tablet_bootstrap.cc:492] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:31.992303 20531 raft_consensus.cc:2804] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:31.992779 20531 raft_consensus.cc:697] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:31.993559 20531 consensus_queue.cc:237] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:31.994728 20518 leader_election.cc:290] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:31.976052 20511 tablet_bootstrap.cc:492] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:31.995445 20518 raft_consensus.cc:493] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.998914 20520 raft_consensus.cc:493] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.999473 20520 raft_consensus.cc:515] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.001579 20520 leader_election.cc:290] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:31.998580 20514 tablet_bootstrap.cc:654] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.023295 20515 raft_consensus.cc:493] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.003317 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:31.998999 20518 raft_consensus.cc:515] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.032390 20515 raft_consensus.cc:515] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
W20260709 13:20:32.033700 20436 leader_election.cc:343] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.034576 20518 leader_election.cc:290] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.036031 20511 tablet_bootstrap.cc:654] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.030599 20510 ts_tablet_manager.cc:1434] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.004s
I20260709 13:20:32.038820 20510 tablet_bootstrap.cc:492] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:32.042788 20515 leader_election.cc:290] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
W20260709 13:20:32.048733 20268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:32.049911 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:32.050608 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.051066 20515 raft_consensus.cc:493] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.051553 20515 raft_consensus.cc:515] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.052295 20511 tablet_bootstrap.cc:492] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:32.052767 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.053622 20515 leader_election.cc:290] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.052883 20511 ts_tablet_manager.cc:1403] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.011s
I20260709 13:20:32.063196 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:32.064009 20397 raft_consensus.cc:2468] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
W20260709 13:20:32.064625 20287 leader_election.cc:343] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.065099 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:32.067166 20396 raft_consensus.cc:2468] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
W20260709 13:20:32.065881 20436 leader_election.cc:343] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.063175 20511 raft_consensus.cc:359] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.068367 20436 leader_election.cc:304] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.068600 20511 raft_consensus.cc:385] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.069903 20531 raft_consensus.cc:2749] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:32.068969 20511 raft_consensus.cc:740] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
W20260709 13:20:32.071162 20287 leader_election.cc:343] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.071761 20511 consensus_queue.cc:260] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.073092 20287 leader_election.cc:304] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:32.075505 20537 raft_consensus.cc:2804] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.075964 20537 raft_consensus.cc:493] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.076342 20537 raft_consensus.cc:3060] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.076635 20511 ts_tablet_manager.cc:1434] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:20:32.076710 20514 tablet_bootstrap.cc:492] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:32.077426 20514 ts_tablet_manager.cc:1403] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.045s
I20260709 13:20:32.077850 20511 tablet_bootstrap.cc:492] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:32.080525 20514 raft_consensus.cc:359] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.081266 20514 raft_consensus.cc:385] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.081595 20514 raft_consensus.cc:740] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.082512 20514 consensus_queue.cc:260] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.081772 20287 leader_election.cc:304] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:32.085942 20518 raft_consensus.cc:2804] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.086391 20518 raft_consensus.cc:493] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.086810 20518 raft_consensus.cc:3060] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.094549 20510 tablet_bootstrap.cc:654] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.095041 20514 ts_tablet_manager.cc:1434] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.006s
I20260709 13:20:32.095615 20511 tablet_bootstrap.cc:654] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.099236 20218 catalog_manager.cc:5697] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.100909 20514 tablet_bootstrap.cc:492] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:32.097149 20537 raft_consensus.cc:515] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.107861 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:32.108454 20396 raft_consensus.cc:3060] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.108145 20514 tablet_bootstrap.cc:654] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.110445 20518 raft_consensus.cc:515] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.115200 20534 raft_consensus.cc:493] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.115759 20534 raft_consensus.cc:515] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.116619 20518 leader_election.cc:290] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.118098 20534 leader_election.cc:290] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:32.119832 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:32.121086 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:32.121768 20537 leader_election.cc:290] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.122035 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:32.120420 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:32.123483 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:32.123515 20397 raft_consensus.cc:3060] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.124321 20395 raft_consensus.cc:2468] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:32.125615 20436 leader_election.cc:304] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:32.126358 20534 raft_consensus.cc:2804] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.126740 20534 raft_consensus.cc:493] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.127058 20534 raft_consensus.cc:3060] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.126565 20396 raft_consensus.cc:2468] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
W20260709 13:20:32.129097 20436 leader_election.cc:343] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.129928 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:32.130767 20321 raft_consensus.cc:2468] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:32.129482 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.129153 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:32.131583 20471 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:32.131907 20322 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:32.131561 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.132412 20362 leader_election.cc:304] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:32.135854 20515 raft_consensus.cc:2804] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.136250 20515 raft_consensus.cc:493] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.136938 20515 raft_consensus.cc:3060] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.138695 20511 tablet_bootstrap.cc:492] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:32.139242 20511 ts_tablet_manager.cc:1403] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.004s
I20260709 13:20:32.140136 20397 raft_consensus.cc:2468] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:32.141114 20362 leader_election.cc:304] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
W20260709 13:20:32.127156 20287 leader_election.cc:343] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:32.143364 20287 leader_election.cc:343] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.144052 20287 leader_election.cc:304] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:32.145263 20287 leader_election.cc:304] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:32.145843 20534 raft_consensus.cc:515] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.146301 20518 raft_consensus.cc:2804] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.146447 20511 raft_consensus.cc:359] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.147428 20511 raft_consensus.cc:385] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.147706 20511 raft_consensus.cc:740] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.146734 20537 raft_consensus.cc:2804] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.146808 20515 raft_consensus.cc:515] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.149745 20511 consensus_queue.cc:260] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.151813 20534 leader_election.cc:290] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:32.152830 20515 leader_election.cc:290] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.153365 20515 raft_consensus.cc:2804] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.153703 20515 raft_consensus.cc:493] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.153844 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
W20260709 13:20:32.155313 20436 leader_election.cc:343] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.157445 20510 tablet_bootstrap.cc:492] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:32.155464 20518 raft_consensus.cc:697] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:32.158510 20510 ts_tablet_manager.cc:1403] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.006s
I20260709 13:20:32.158793 20515 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.159005 20518 consensus_queue.cc:237] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.153828 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:32.162957 20510 raft_consensus.cc:359] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.165414 20511 ts_tablet_manager.cc:1434] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.003s
I20260709 13:20:32.166206 20511 tablet_bootstrap.cc:492] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:32.166932 20397 raft_consensus.cc:3060] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.170164 20514 tablet_bootstrap.cc:492] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:32.170666 20514 ts_tablet_manager.cc:1403] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.004s
I20260709 13:20:32.164609 20510 raft_consensus.cc:385] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.171881 20510 raft_consensus.cc:740] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.172803 20510 consensus_queue.cc:260] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.163714 20537 raft_consensus.cc:697] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:32.178704 20537 consensus_queue.cc:237] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.181833 20551 raft_consensus.cc:493] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.182839 20551 raft_consensus.cc:515] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.186685 20515 raft_consensus.cc:515] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.191443 20511 tablet_bootstrap.cc:654] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.182049 20514 raft_consensus.cc:359] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.193802 20514 raft_consensus.cc:385] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.192456 20551 leader_election.cc:290] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
W20260709 13:20:32.175953 20362 leader_election.cc:343] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.196875 20514 raft_consensus.cc:740] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.197494 20515 leader_election.cc:290] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.198650 20514 consensus_queue.cc:260] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.198908 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:32.199577 20322 raft_consensus.cc:3060] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.200904 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:32.195959 20397 raft_consensus.cc:2468] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
W20260709 13:20:32.202246 20362 leader_election.cc:343] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.203372 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:32.203979 20471 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.204097 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:32.204604 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.204772 20321 raft_consensus.cc:2468] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:32.205251 20470 raft_consensus.cc:2468] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:32.205744 20514 ts_tablet_manager.cc:1434] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:20:32.206115 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:32.206398 20436 leader_election.cc:304] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.206907 20514 tablet_bootstrap.cc:492] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:32.210880 20322 raft_consensus.cc:2468] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:32.206728 20321 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.216610 20534 raft_consensus.cc:2804] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.217092 20534 raft_consensus.cc:697] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:32.217882 20534 consensus_queue.cc:237] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.218807 20321 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:32.220146 20362 leader_election.cc:304] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:32.221038 20515 raft_consensus.cc:2804] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.221390 20515 raft_consensus.cc:493] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.221733 20515 raft_consensus.cc:3060] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.199451 20219 catalog_manager.cc:5697] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.226173 20471 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:32.227625 20514 tablet_bootstrap.cc:654] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.232885 20510 ts_tablet_manager.cc:1434] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.011s
I20260709 13:20:32.234215 20510 tablet_bootstrap.cc:492] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:32.235105 20515 raft_consensus.cc:515] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.237285 20515 leader_election.cc:290] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.238755 20362 leader_election.cc:304] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:32.239988 20362 leader_election.cc:304] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:32.241284 20552 raft_consensus.cc:2804] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.241947 20551 raft_consensus.cc:2804] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.241721 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:32.243659 20321 raft_consensus.cc:3060] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.244067 20510 tablet_bootstrap.cc:654] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.241786 20552 raft_consensus.cc:697] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:32.249979 20552 consensus_queue.cc:237] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.253654 20551 raft_consensus.cc:697] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:32.254607 20551 consensus_queue.cc:237] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.255908 20321 raft_consensus.cc:2468] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:32.257076 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:32.257174 20362 leader_election.cc:304] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:32.257815 20471 raft_consensus.cc:3060] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.258271 20559 raft_consensus.cc:2804] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.259044 20559 raft_consensus.cc:697] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:32.259934 20559 consensus_queue.cc:237] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.262064 20510 tablet_bootstrap.cc:492] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:32.262624 20510 ts_tablet_manager.cc:1403] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:20:32.270313 20510 raft_consensus.cc:359] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.271090 20510 raft_consensus.cc:385] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.271358 20510 raft_consensus.cc:740] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.275045 20510 consensus_queue.cc:260] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.279084 20510 ts_tablet_manager.cc:1434] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:20:32.288985 20219 catalog_manager.cc:5697] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.289848 20514 tablet_bootstrap.cc:492] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:32.290602 20514 ts_tablet_manager.cc:1403] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.008s
I20260709 13:20:32.290983 20219 catalog_manager.cc:5697] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.294133 20514 raft_consensus.cc:359] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.294921 20510 tablet_bootstrap.cc:492] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:32.295037 20514 raft_consensus.cc:385] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.295504 20514 raft_consensus.cc:740] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.296494 20514 consensus_queue.cc:260] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.300828 20531 raft_consensus.cc:493] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.301170 20510 tablet_bootstrap.cc:654] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.301312 20531 raft_consensus.cc:515] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.310436 20471 raft_consensus.cc:2468] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:32.311388 20537 raft_consensus.cc:493] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.311904 20537 raft_consensus.cc:515] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.313753 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:32.313992 20537 leader_election.cc:290] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.315331 20531 leader_election.cc:290] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:32.316596 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:32.317385 20397 raft_consensus.cc:2393] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90b4ce8af2fc4630929b3af07191b675 in current term 1: Already voted for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in this term.
I20260709 13:20:32.317190 20218 catalog_manager.cc:5697] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.318397 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.320300 20511 tablet_bootstrap.cc:492] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:32.320191 20287 leader_election.cc:304] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90b4ce8af2fc4630929b3af07191b675; no voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:32.321765 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
W20260709 13:20:32.320642 20436 leader_election.cc:343] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.320964 20511 ts_tablet_manager.cc:1403] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.155s	user 0.052s	sys 0.065s
W20260709 13:20:32.323105 20436 leader_election.cc:343] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:32.322525 20217 catalog_manager.cc:5697] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.323428 20436 leader_election.cc:304] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.324059 20531 raft_consensus.cc:2749] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:32.324442 20537 raft_consensus.cc:3060] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.325784 20511 raft_consensus.cc:359] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.326627 20511 raft_consensus.cc:385] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.326936 20511 raft_consensus.cc:740] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.327803 20511 consensus_queue.cc:260] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.330113 20511 ts_tablet_manager.cc:1434] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:32.333351 20537 raft_consensus.cc:2749] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:32.337760 20510 tablet_bootstrap.cc:492] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:32.338281 20510 ts_tablet_manager.cc:1403] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.008s
I20260709 13:20:32.339514 20217 catalog_manager.cc:5697] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.341024 20514 ts_tablet_manager.cc:1434] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:20:32.340962 20510 raft_consensus.cc:359] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.342197 20510 raft_consensus.cc:385] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.341332 20217 catalog_manager.cc:5697] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.342475 20510 raft_consensus.cc:740] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.342692 20514 tablet_bootstrap.cc:492] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:32.343246 20510 consensus_queue.cc:260] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.344992 20510 ts_tablet_manager.cc:1434] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:32.349879 20514 tablet_bootstrap.cc:654] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.354813 20514 tablet_bootstrap.cc:492] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:32.355340 20514 ts_tablet_manager.cc:1403] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:20:32.357820 20514 raft_consensus.cc:359] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.358536 20514 raft_consensus.cc:385] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.358852 20514 raft_consensus.cc:740] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.359537 20514 consensus_queue.cc:260] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.361447 20514 ts_tablet_manager.cc:1434] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:32.362601 20514 tablet_bootstrap.cc:492] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:32.367498 20514 tablet_bootstrap.cc:654] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:32.370868 20531 consensus_queue.cc:1048] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.372406 20514 tablet_bootstrap.cc:492] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:32.372918 20514 ts_tablet_manager.cc:1403] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.011s	user 0.001s	sys 0.007s
I20260709 13:20:32.375403 20514 raft_consensus.cc:359] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.376085 20514 raft_consensus.cc:385] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:32.376338 20514 raft_consensus.cc:740] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:32.377012 20514 consensus_queue.cc:260] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.378906 20514 ts_tablet_manager.cc:1434] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:32.385607 20520 consensus_queue.cc:1048] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.490885 20520 consensus_queue.cc:1048] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.502194 20531 consensus_queue.cc:1048] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.591849 20537 consensus_queue.cc:1048] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.600955 20470 raft_consensus.cc:3060] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.604868 20549 raft_consensus.cc:493] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.605437 20549 raft_consensus.cc:515] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.607317 20549 leader_election.cc:290] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.608400 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:32.608351 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:32.609153 20397 raft_consensus.cc:2468] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:32.609282 20471 raft_consensus.cc:2468] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:32.610169 20287 leader_election.cc:304] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:32.610765 20549 raft_consensus.cc:2804] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:32.611137 20549 raft_consensus.cc:493] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.611245 20555 consensus_queue.cc:1048] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.611550 20549 raft_consensus.cc:3060] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.617852 20549 raft_consensus.cc:515] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.620963 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:32.621537 20396 raft_consensus.cc:3060] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.626978 20555 consensus_queue.cc:1048] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.628672 20396 raft_consensus.cc:2468] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:32.629134 20549 leader_election.cc:290] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:32.629956 20287 leader_election.cc:304] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:32.630813 20549 raft_consensus.cc:2804] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:32.630293 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:32.632308 20470 raft_consensus.cc:3060] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.632089 20549 raft_consensus.cc:697] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:32.632807 20471 raft_consensus.cc:3060] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.633286 20549 consensus_queue.cc:237] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:32.639493 20470 raft_consensus.cc:2468] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:32.641980 20555 consensus_queue.cc:1048] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.645812 20218 catalog_manager.cc:5697] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.649217 20531 consensus_queue.cc:1048] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.665352 20551 consensus_queue.cc:1048] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.667778 20520 consensus_queue.cc:1048] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.688282 20470 raft_consensus.cc:3060] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:32.696409 20551 consensus_queue.cc:1048] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.744868 20551 consensus_queue.cc:1048] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.756850 20552 consensus_queue.cc:1048] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.850874 20552 consensus_queue.cc:1048] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.856886 20552 consensus_queue.cc:1048] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:32.913659 20470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:44418
I20260709 13:20:32.914199 20470 raft_consensus.cc:606] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.919612 20470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:44418
I20260709 13:20:32.920212 20470 raft_consensus.cc:606] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.933813 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:33858
I20260709 13:20:32.934332 20397 raft_consensus.cc:606] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.940173 20397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6016352b674649c09f0e8445b01cf523"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:33858
I20260709 13:20:32.940739 20397 raft_consensus.cc:606] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:32.954715 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:32.955261 20322 raft_consensus.cc:606] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 5f2a0ad7034e4d3a820fe81d09c58b44
I20260709 13:20:32.960386 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:32.960886 20322 raft_consensus.cc:606] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 5f2a0ad7034e4d3a820fe81d09c58b44
I20260709 13:20:32.969623 20470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "733500534d214a1082a887479eaac70d"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
mode: GRACEFUL
new_leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:44418
I20260709 13:20:32.970183 20470 raft_consensus.cc:606] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Received request to transfer leadership to TS 5f2a0ad7034e4d3a820fe81d09c58b44
I20260709 13:20:32.975607 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:32.976114 20322 raft_consensus.cc:606] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:33.021159 20555 consensus_queue.cc:1048] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:33.028513 20549 raft_consensus.cc:993] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:33.029062 20518 raft_consensus.cc:1081] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:33.030751 20471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:55850
I20260709 13:20:33.031344 20471 raft_consensus.cc:493] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.031711 20471 raft_consensus.cc:3060] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.034276 20549 consensus_queue.cc:1048] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:33.039539 20471 raft_consensus.cc:515] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.041846 20471 leader_election.cc:290] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:33.042483 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:33.042997 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f759c276920467baa15209bb0a49a5e" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:33.043145 20322 raft_consensus.cc:3055] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.043185 20470 raft_consensus.cc:1240] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Rejecting Update request from peer 90b4ce8af2fc4630929b3af07191b675 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:33.043613 20322 raft_consensus.cc:740] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.043699 20397 raft_consensus.cc:3060] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.044600 20322 consensus_queue.cc:260] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.045768 20322 raft_consensus.cc:3060] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.051703 20397 raft_consensus.cc:2468] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 2.
I20260709 13:20:33.052989 20436 leader_election.cc:304] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:33.053436 20322 raft_consensus.cc:2468] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 2.
I20260709 13:20:33.053764 20520 raft_consensus.cc:2804] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.054282 20520 raft_consensus.cc:697] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:33.055091 20520 consensus_queue.cc:237] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.062116 20216 catalog_manager.cc:5697] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:33.088011 20559 raft_consensus.cc:993] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.088302 20518 raft_consensus.cc:993] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:33.088464 20552 raft_consensus.cc:1081] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.088819 20549 raft_consensus.cc:1081] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:33.090269 20397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:20:33.090142 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55700
I20260709 13:20:33.090947 20397 raft_consensus.cc:493] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.090981 20322 raft_consensus.cc:493] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.091509 20397 raft_consensus.cc:3060] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.091571 20322 raft_consensus.cc:3060] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.099402 20322 raft_consensus.cc:515] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.099402 20397 raft_consensus.cc:515] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.101840 20397 leader_election.cc:290] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.101866 20322 leader_election.cc:290] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.103480 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.103720 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.104104 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e6b8eb111f42d7845337f0ac05bbbe" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:33.104234 20470 raft_consensus.cc:3060] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.104327 20471 raft_consensus.cc:3060] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.104732 20321 raft_consensus.cc:3055] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.103778 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab503d13b34aa887b5003be876e11a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:33.105273 20321 raft_consensus.cc:740] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.105527 20396 raft_consensus.cc:3055] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.105852 20396 raft_consensus.cc:740] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:33.106204 20321 consensus_queue.cc:260] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.106667 20396 consensus_queue.cc:260] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.107613 20321 raft_consensus.cc:3060] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.108012 20396 raft_consensus.cc:3060] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.112305 20471 raft_consensus.cc:2468] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:33.112337 20470 raft_consensus.cc:2468] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.114001 20362 leader_election.cc:304] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:33.114089 20287 leader_election.cc:304] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:33.114858 20552 raft_consensus.cc:2804] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.114949 20549 raft_consensus.cc:2804] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.115324 20552 raft_consensus.cc:697] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:33.115578 20396 raft_consensus.cc:2468] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.115585 20549 raft_consensus.cc:697] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.116303 20552 consensus_queue.cc:237] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.117321 20549 consensus_queue.cc:237] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.119226 20321 raft_consensus.cc:2468] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:33.124051 20216 catalog_manager.cc:5697] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.126003 20218 catalog_manager.cc:5697] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.190436 20518 raft_consensus.cc:993] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:33.190913 20549 raft_consensus.cc:1081] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:33.192766 20396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:20:33.193356 20396 raft_consensus.cc:493] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.193775 20396 raft_consensus.cc:3060] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.199859 20396 raft_consensus.cc:515] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.201503 20396 leader_election.cc:290] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.202418 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:33.202741 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0105ac9286ab4be9a2e839ebaba3d067" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.203176 20321 raft_consensus.cc:3055] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.203341 20470 raft_consensus.cc:3060] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.203579 20321 raft_consensus.cc:740] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.204507 20321 consensus_queue.cc:260] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.205832 20321 raft_consensus.cc:3060] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.209138 20534 raft_consensus.cc:993] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: : Instructing follower 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:33.209645 20520 raft_consensus.cc:1081] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Signalling peer 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:33.211098 20396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "733500534d214a1082a887479eaac70d"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:20:33.211231 20470 raft_consensus.cc:2468] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:33.211588 20396 raft_consensus.cc:493] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.212009 20396 raft_consensus.cc:3060] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.212788 20362 leader_election.cc:304] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:33.213078 20321 raft_consensus.cc:2468] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:33.213822 20552 raft_consensus.cc:2804] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.214345 20552 raft_consensus.cc:697] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:33.215194 20552 consensus_queue.cc:237] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.219880 20396 raft_consensus.cc:515] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.222128 20396 leader_election.cc:290] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.222798 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:33.223191 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "733500534d214a1082a887479eaac70d" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.224447 20321 raft_consensus.cc:3060] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.224772 20470 raft_consensus.cc:3055] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.223517 20218 catalog_manager.cc:5697] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.225133 20470 raft_consensus.cc:740] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:33.226140 20470 consensus_queue.cc:260] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.227424 20470 raft_consensus.cc:3060] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.232720 20321 raft_consensus.cc:2468] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:33.234247 20362 leader_election.cc:304] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:33.234974 20552 raft_consensus.cc:2804] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.235387 20552 raft_consensus.cc:697] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:33.235468 20470 raft_consensus.cc:2468] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:33.236276 20552 consensus_queue.cc:237] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.243482 20218 catalog_manager.cc:5697] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 1 to 2, leader changed from 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195) to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.357576 20534 raft_consensus.cc:993] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.358036 20520 raft_consensus.cc:1081] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.359788 20321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55692
I20260709 13:20:33.360421 20321 raft_consensus.cc:493] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.360764 20321 raft_consensus.cc:3060] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.362357 20534 raft_consensus.cc:993] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.362864 20520 raft_consensus.cc:1081] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.364714 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55692
I20260709 13:20:33.365202 20322 raft_consensus.cc:493] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.365531 20322 raft_consensus.cc:3060] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.367447 20321 raft_consensus.cc:515] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.369429 20321 leader_election.cc:290] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.370270 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:33.370574 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55ab9435e8b476ca4bdd6f956f9d00f" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.370980 20396 raft_consensus.cc:3060] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.371253 20470 raft_consensus.cc:3055] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.372043 20470 raft_consensus.cc:740] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:33.371286 20322 raft_consensus.cc:515] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.372815 20470 consensus_queue.cc:260] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.373970 20322 leader_election.cc:290] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.374119 20470 raft_consensus.cc:3060] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.374778 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:33.375340 20397 raft_consensus.cc:3060] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.377180 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef537db43f0d41e2837791d64bd94f7a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.377827 20471 raft_consensus.cc:3055] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.378139 20471 raft_consensus.cc:740] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:33.379112 20396 raft_consensus.cc:2468] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.378971 20471 consensus_queue.cc:260] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.380424 20287 leader_election.cc:304] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:33.380894 20471 raft_consensus.cc:3060] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.381273 20549 raft_consensus.cc:2804] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.381796 20549 raft_consensus.cc:697] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.382650 20549 consensus_queue.cc:237] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.383001 20470 raft_consensus.cc:2468] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.383926 20397 raft_consensus.cc:2468] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.385684 20287 leader_election.cc:304] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:33.386339 20518 raft_consensus.cc:2804] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.386742 20518 raft_consensus.cc:697] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.387439 20518 consensus_queue.cc:237] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.389930 20471 raft_consensus.cc:2468] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.392911 20218 catalog_manager.cc:5697] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.404994 20218 catalog_manager.cc:5697] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.476584 20551 raft_consensus.cc:993] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.477031 20552 raft_consensus.cc:1081] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:33.478653 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6016352b674649c09f0e8445b01cf523"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55700
I20260709 13:20:33.479151 20322 raft_consensus.cc:493] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.479439 20322 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.484804 20322 raft_consensus.cc:515] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.486531 20322 leader_election.cc:290] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:33.487579 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:33.487860 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:33.488360 20397 raft_consensus.cc:3055] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:33.488480 20471 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.488795 20397 raft_consensus.cc:740] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:33.489717 20397 consensus_queue.cc:260] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.491081 20397 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:33.496686 20471 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.498024 20287 leader_election.cc:304] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:33.498771 20549 raft_consensus.cc:2804] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:33.498821 20397 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:33.499218 20549 raft_consensus.cc:697] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:33.500205 20549 consensus_queue.cc:237] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:33.506687 20218 catalog_manager.cc:5697] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.527910 20322 raft_consensus.cc:1275] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.529330 20520 consensus_queue.cc:1048] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.540969 20397 raft_consensus.cc:1275] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.542647 20520 consensus_queue.cc:1048] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.554764 20471 raft_consensus.cc:1275] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.556501 20552 consensus_queue.cc:1048] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.564461 20322 raft_consensus.cc:1275] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.565877 20552 consensus_queue.cc:1048] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.622901 20322 raft_consensus.cc:1275] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.624269 20552 consensus_queue.cc:1048] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.634544 20471 raft_consensus.cc:1275] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.636294 20551 consensus_queue.cc:1048] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.643165 20397 raft_consensus.cc:1275] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.644961 20549 consensus_queue.cc:1048] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.654163 20471 raft_consensus.cc:1275] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.656046 20518 consensus_queue.cc:1048] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.759636 20322 raft_consensus.cc:1275] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.761016 20551 consensus_queue.cc:1048] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.768584 20470 raft_consensus.cc:1275] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.770265 20518 consensus_queue.cc:1048] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.770488 20471 raft_consensus.cc:1275] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.772794 20551 consensus_queue.cc:1048] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.784698 20397 raft_consensus.cc:1275] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.786682 20549 consensus_queue.cc:1048] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.870751 20470 raft_consensus.cc:1275] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.872095 20549 consensus_queue.cc:1048] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.882551 20397 raft_consensus.cc:1275] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.883176 20471 raft_consensus.cc:1275] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.885310 20555 consensus_queue.cc:1048] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.885578 20518 consensus_queue.cc:1048] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:33.898795 20397 raft_consensus.cc:1275] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:33.900655 20607 consensus_queue.cc:1048] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:36.001865 20216 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37996:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:36.004215 20216 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:36.055302 20307 tablet_service.cc:1511] Processing CreateTablet for tablet 9b527c4d305f4e70b0036cd36edfea77 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.056658 20307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b527c4d305f4e70b0036cd36edfea77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.056910 20381 tablet_service.cc:1511] Processing CreateTablet for tablet 9b527c4d305f4e70b0036cd36edfea77 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.057946 20381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b527c4d305f4e70b0036cd36edfea77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.062664 20309 tablet_service.cc:1511] Processing CreateTablet for tablet 17c1b41d09f747ce91a4de4bccb01027 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.062959 20453 tablet_service.cc:1511] Processing CreateTablet for tablet 9b527c4d305f4e70b0036cd36edfea77 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.063591 20459 tablet_service.cc:1511] Processing CreateTablet for tablet 17c1b41d09f747ce91a4de4bccb01027 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.064177 20309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c1b41d09f747ce91a4de4bccb01027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.064311 20453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b527c4d305f4e70b0036cd36edfea77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.062664 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:36.065914 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.069501 20387 tablet_service.cc:1511] Processing CreateTablet for tablet 17c1b41d09f747ce91a4de4bccb01027 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.070879 20387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c1b41d09f747ce91a4de4bccb01027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.071806 20459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c1b41d09f747ce91a4de4bccb01027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.074263 20382 tablet_service.cc:1511] Processing CreateTablet for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:36.075029 20457 tablet_service.cc:1511] Processing CreateTablet for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:36.075625 20382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.076327 20457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.085212 20310 tablet_service.cc:1511] Processing CreateTablet for tablet b0f47f69aea4436d82a2f64ebb61d3d0 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.086642 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f47f69aea4436d82a2f64ebb61d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.087567 20380 tablet_service.cc:1511] Processing CreateTablet for tablet b0f47f69aea4436d82a2f64ebb61d3d0 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.089131 20380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f47f69aea4436d82a2f64ebb61d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:36.093336 20268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:36.104197 20458 tablet_service.cc:1511] Processing CreateTablet for tablet b0f47f69aea4436d82a2f64ebb61d3d0 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.105667 20458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f47f69aea4436d82a2f64ebb61d3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.106216 20312 tablet_service.cc:1511] Processing CreateTablet for tablet ba43f7aaaf074198b22c890ea79e1e79 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:36.107497 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba43f7aaaf074198b22c890ea79e1e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.124541 20386 tablet_service.cc:1511] Processing CreateTablet for tablet ba43f7aaaf074198b22c890ea79e1e79 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:36.125969 20386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba43f7aaaf074198b22c890ea79e1e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.128504 20456 tablet_service.cc:1511] Processing CreateTablet for tablet ba43f7aaaf074198b22c890ea79e1e79 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:36.130122 20456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba43f7aaaf074198b22c890ea79e1e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.132809 20308 tablet_service.cc:1511] Processing CreateTablet for tablet 013bdb5de0714691961973642b4b9985 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:36.134137 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013bdb5de0714691961973642b4b9985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.152314 20383 tablet_service.cc:1511] Processing CreateTablet for tablet 013bdb5de0714691961973642b4b9985 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:36.153891 20383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013bdb5de0714691961973642b4b9985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.172770 20623 tablet_bootstrap.cc:492] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.174474 20620 tablet_bootstrap.cc:492] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.178959 20459 tablet_service.cc:1511] Processing CreateTablet for tablet 013bdb5de0714691961973642b4b9985 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:36.181763 20459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 013bdb5de0714691961973642b4b9985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.184940 20620 tablet_bootstrap.cc:654] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.202592 20622 tablet_bootstrap.cc:492] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.203529 20620 tablet_bootstrap.cc:492] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.204212 20620 ts_tablet_manager.cc:1403] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.012s
I20260709 13:20:36.204016 20308 tablet_service.cc:1511] Processing CreateTablet for tablet 3dce7c45de7b465cae760e1493350a3d (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:36.205384 20308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dce7c45de7b465cae760e1493350a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.206841 20386 tablet_service.cc:1511] Processing CreateTablet for tablet 3dce7c45de7b465cae760e1493350a3d (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:36.208220 20386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dce7c45de7b465cae760e1493350a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.211253 20456 tablet_service.cc:1511] Processing CreateTablet for tablet 3dce7c45de7b465cae760e1493350a3d (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:36.213236 20456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dce7c45de7b465cae760e1493350a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.214363 20620 raft_consensus.cc:359] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.215238 20620 raft_consensus.cc:385] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.219579 20620 raft_consensus.cc:740] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.223863 20380 tablet_service.cc:1511] Processing CreateTablet for tablet 41e4a2a9cfad4ff49014c374fb2ba792 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:36.225239 20380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e4a2a9cfad4ff49014c374fb2ba792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.226974 20310 tablet_service.cc:1511] Processing CreateTablet for tablet 97c64541b2794e6d93c42dcb630fb128 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:36.213287 20623 tablet_bootstrap.cc:654] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.229105 20382 tablet_service.cc:1511] Processing CreateTablet for tablet 97c64541b2794e6d93c42dcb630fb128 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:36.230350 20382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c64541b2794e6d93c42dcb630fb128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.225145 20459 tablet_service.cc:1511] Processing CreateTablet for tablet 41e4a2a9cfad4ff49014c374fb2ba792 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:36.231907 20459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e4a2a9cfad4ff49014c374fb2ba792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.232692 20457 tablet_service.cc:1511] Processing CreateTablet for tablet 97c64541b2794e6d93c42dcb630fb128 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:36.233491 20312 tablet_service.cc:1511] Processing CreateTablet for tablet 41e4a2a9cfad4ff49014c374fb2ba792 (DEFAULT_TABLE table=soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:36.233899 20457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c64541b2794e6d93c42dcb630fb128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.234766 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e4a2a9cfad4ff49014c374fb2ba792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.220467 20620 consensus_queue.cc:260] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.238862 20620 ts_tablet_manager.cc:1434] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:20:36.239925 20620 tablet_bootstrap.cc:492] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.240725 20310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c64541b2794e6d93c42dcb630fb128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.258329 20620 tablet_bootstrap.cc:654] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.281090 20622 tablet_bootstrap.cc:654] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.287398 20623 tablet_bootstrap.cc:492] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.288120 20623 ts_tablet_manager.cc:1403] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.028s
I20260709 13:20:36.292726 20620 tablet_bootstrap.cc:492] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.293376 20620 ts_tablet_manager.cc:1403] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.008s
I20260709 13:20:36.292958 20623 raft_consensus.cc:359] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.294432 20623 raft_consensus.cc:385] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.294798 20623 raft_consensus.cc:740] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.295694 20623 consensus_queue.cc:260] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.296507 20620 raft_consensus.cc:359] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.297308 20620 raft_consensus.cc:385] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.297621 20620 raft_consensus.cc:740] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.298069 20623 ts_tablet_manager.cc:1434] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:36.298453 20620 consensus_queue.cc:260] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.299273 20623 tablet_bootstrap.cc:492] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.300902 20620 ts_tablet_manager.cc:1434] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:36.301906 20620 tablet_bootstrap.cc:492] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.308933 20622 tablet_bootstrap.cc:492] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.309206 20620 tablet_bootstrap.cc:654] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.309509 20623 tablet_bootstrap.cc:654] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.309562 20622 ts_tablet_manager.cc:1403] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.107s	user 0.006s	sys 0.007s
I20260709 13:20:36.313767 20622 raft_consensus.cc:359] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.314850 20622 raft_consensus.cc:385] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.315156 20622 raft_consensus.cc:740] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.315860 20622 consensus_queue.cc:260] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.318005 20620 tablet_bootstrap.cc:492] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.318173 20622 ts_tablet_manager.cc:1434] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:20:36.318471 20620 ts_tablet_manager.cc:1403] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 13:20:36.319257 20622 tablet_bootstrap.cc:492] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.321327 20620 raft_consensus.cc:359] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.321908 20623 tablet_bootstrap.cc:492] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.322101 20620 raft_consensus.cc:385] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.322486 20623 ts_tablet_manager.cc:1403] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:20:36.322510 20620 raft_consensus.cc:740] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.323520 20620 consensus_queue.cc:260] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.325951 20620 ts_tablet_manager.cc:1434] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:36.327397 20620 tablet_bootstrap.cc:492] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.327771 20623 raft_consensus.cc:359] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.328573 20623 raft_consensus.cc:385] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.328569 20622 tablet_bootstrap.cc:654] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.329066 20623 raft_consensus.cc:740] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.330058 20623 consensus_queue.cc:260] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.332353 20609 raft_consensus.cc:493] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.332871 20609 raft_consensus.cc:515] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.334956 20620 tablet_bootstrap.cc:654] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.335258 20609 leader_election.cc:290] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:36.337224 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:36.337648 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.338217 20322 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:36.339816 20436 leader_election.cc:304] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.341003 20609 raft_consensus.cc:2804] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.342629 20609 raft_consensus.cc:493] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.343099 20609 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.347466 20622 tablet_bootstrap.cc:492] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.348172 20622 ts_tablet_manager.cc:1403] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.009s
W20260709 13:20:36.349691 20436 leader_election.cc:343] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.351301 20622 raft_consensus.cc:359] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.352102 20622 raft_consensus.cc:385] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.352392 20622 raft_consensus.cc:740] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.353145 20622 consensus_queue.cc:260] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.354063 20620 tablet_bootstrap.cc:492] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.354620 20620 ts_tablet_manager.cc:1403] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 13:20:36.355409 20622 ts_tablet_manager.cc:1434] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:20:36.355340 20609 raft_consensus.cc:515] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.356591 20622 tablet_bootstrap.cc:492] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.357769 20609 leader_election.cc:290] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:36.357609 20620 raft_consensus.cc:359] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.358382 20620 raft_consensus.cc:385] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.358686 20620 raft_consensus.cc:740] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.359386 20620 consensus_queue.cc:260] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.361616 20620 ts_tablet_manager.cc:1434] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:20:36.362387 20622 tablet_bootstrap.cc:654] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.362906 20620 tablet_bootstrap.cc:492] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.369884 20620 tablet_bootstrap.cc:654] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.375566 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.376302 20397 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.379050 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:36.379813 20322 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.384727 20397 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:36.386514 20436 leader_election.cc:304] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:36.387552 20609 raft_consensus.cc:2804] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.388075 20609 raft_consensus.cc:697] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:36.388942 20609 consensus_queue.cc:237] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.392922 20322 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:36.396281 20622 tablet_bootstrap.cc:492] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.398280 20622 ts_tablet_manager.cc:1403] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.020s
I20260709 13:20:36.401600 20623 ts_tablet_manager.cc:1434] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.079s	user 0.012s	sys 0.006s
I20260709 13:20:36.402622 20623 tablet_bootstrap.cc:492] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.402618 20622 raft_consensus.cc:359] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.403324 20551 raft_consensus.cc:493] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.403564 20622 raft_consensus.cc:385] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.403944 20622 raft_consensus.cc:740] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.403889 20551 raft_consensus.cc:515] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.406073 20551 leader_election.cc:290] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.407115 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:36.407781 20620 tablet_bootstrap.cc:492] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.408306 20620 ts_tablet_manager.cc:1403] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.008s
I20260709 13:20:36.407516 20218 catalog_manager.cc:5697] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.408746 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.409081 20623 tablet_bootstrap.cc:654] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.411332 20620 raft_consensus.cc:359] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.412060 20620 raft_consensus.cc:385] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.412122 20607 raft_consensus.cc:493] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.412354 20620 raft_consensus.cc:740] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.412849 20607 raft_consensus.cc:515] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
W20260709 13:20:36.413118 20362 leader_election.cc:343] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.413214 20620 consensus_queue.cc:260] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
W20260709 13:20:36.413900 20362 leader_election.cc:343] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.414316 20362 leader_election.cc:304] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44; no voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:36.404891 20622 consensus_queue.cc:260] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.415656 20551 raft_consensus.cc:2749] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:36.415143 20607 leader_election.cc:290] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.419938 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.415670 20620 ts_tablet_manager.cc:1434] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:36.421132 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.427351 20620 tablet_bootstrap.cc:492] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
W20260709 13:20:36.429641 20287 leader_election.cc:343] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:36.430529 20287 leader_election.cc:343] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.430927 20287 leader_election.cc:304] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90b4ce8af2fc4630929b3af07191b675; no voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:36.434494 20620 tablet_bootstrap.cc:654] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.436769 20621 raft_consensus.cc:2749] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:36.437911 20622 ts_tablet_manager.cc:1434] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.039s	user 0.018s	sys 0.006s
I20260709 13:20:36.439025 20622 tablet_bootstrap.cc:492] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.445338 20622 tablet_bootstrap.cc:654] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.447263 20623 tablet_bootstrap.cc:492] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.447917 20623 ts_tablet_manager.cc:1403] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.012s
I20260709 13:20:36.452768 20623 raft_consensus.cc:359] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.453626 20623 raft_consensus.cc:385] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.453972 20623 raft_consensus.cc:740] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.454946 20623 consensus_queue.cc:260] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.457871 20623 ts_tablet_manager.cc:1434] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:36.460189 20623 tablet_bootstrap.cc:492] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.461450 20620 tablet_bootstrap.cc:492] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.461606 20622 tablet_bootstrap.cc:492] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.462035 20620 ts_tablet_manager.cc:1403] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.012s
I20260709 13:20:36.462160 20622 ts_tablet_manager.cc:1403] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.005s
I20260709 13:20:36.465260 20622 raft_consensus.cc:359] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.465957 20622 raft_consensus.cc:385] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.465627 20620 raft_consensus.cc:359] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.466269 20622 raft_consensus.cc:740] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.466425 20620 raft_consensus.cc:385] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.466777 20620 raft_consensus.cc:740] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.467075 20622 consensus_queue.cc:260] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.467604 20623 tablet_bootstrap.cc:654] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.467965 20620 consensus_queue.cc:260] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.470382 20620 ts_tablet_manager.cc:1434] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:20:36.471446 20620 tablet_bootstrap.cc:492] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.472368 20622 ts_tablet_manager.cc:1434] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:20:36.473380 20622 tablet_bootstrap.cc:492] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.477857 20620 tablet_bootstrap.cc:654] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.479306 20623 tablet_bootstrap.cc:492] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.479529 20622 tablet_bootstrap.cc:654] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.479878 20623 ts_tablet_manager.cc:1403] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.013s
I20260709 13:20:36.483109 20623 raft_consensus.cc:359] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.483829 20623 raft_consensus.cc:385] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.484099 20623 raft_consensus.cc:740] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.484985 20623 consensus_queue.cc:260] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.490087 20623 ts_tablet_manager.cc:1434] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:20:36.491245 20623 tablet_bootstrap.cc:492] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.499240 20623 tablet_bootstrap.cc:654] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.500839 20622 tablet_bootstrap.cc:492] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.501353 20620 tablet_bootstrap.cc:492] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.501401 20622 ts_tablet_manager.cc:1403] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.009s
I20260709 13:20:36.502115 20620 ts_tablet_manager.cc:1403] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.002s
I20260709 13:20:36.504835 20622 raft_consensus.cc:359] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.505681 20622 raft_consensus.cc:385] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.505961 20622 raft_consensus.cc:740] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.506043 20620 raft_consensus.cc:359] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.506820 20620 raft_consensus.cc:385] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.507093 20620 raft_consensus.cc:740] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.507014 20622 consensus_queue.cc:260] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.507993 20620 consensus_queue.cc:260] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.509930 20622 ts_tablet_manager.cc:1434] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:36.508203 20623 tablet_bootstrap.cc:492] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.510943 20623 ts_tablet_manager.cc:1403] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:20:36.511337 20622 tablet_bootstrap.cc:492] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.513829 20623 raft_consensus.cc:359] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.514544 20623 raft_consensus.cc:385] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.514837 20623 raft_consensus.cc:740] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.515309 20620 ts_tablet_manager.cc:1434] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:20:36.515568 20623 consensus_queue.cc:260] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.516501 20620 tablet_bootstrap.cc:492] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.518080 20623 ts_tablet_manager.cc:1434] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:20:36.518524 20622 tablet_bootstrap.cc:654] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.519451 20623 tablet_bootstrap.cc:492] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.527185 20620 tablet_bootstrap.cc:654] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.535887 20622 tablet_bootstrap.cc:492] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.536460 20622 ts_tablet_manager.cc:1403] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:20:36.539317 20622 raft_consensus.cc:359] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.539925 20622 raft_consensus.cc:385] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.540180 20622 raft_consensus.cc:740] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.540504 20623 tablet_bootstrap.cc:654] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.540974 20622 consensus_queue.cc:260] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.543205 20622 ts_tablet_manager.cc:1434] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:36.544400 20622 tablet_bootstrap.cc:492] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.546443 20620 tablet_bootstrap.cc:492] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.547020 20620 ts_tablet_manager.cc:1403] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.013s
I20260709 13:20:36.550060 20620 raft_consensus.cc:359] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.550794 20620 raft_consensus.cc:385] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.551151 20620 raft_consensus.cc:740] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.550680 20622 tablet_bootstrap.cc:654] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.551995 20621 raft_consensus.cc:493] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.552537 20621 raft_consensus.cc:515] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.553508 20623 tablet_bootstrap.cc:492] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.554037 20623 ts_tablet_manager.cc:1403] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 13:20:36.554600 20621 leader_election.cc:290] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.551717 20620 consensus_queue.cc:260] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.556646 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bdb5de0714691961973642b4b9985" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.557471 20397 raft_consensus.cc:2468] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.557119 20623 raft_consensus.cc:359] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.558147 20623 raft_consensus.cc:385] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.558460 20623 raft_consensus.cc:740] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.559114 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bdb5de0714691961973642b4b9985" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.559399 20623 consensus_queue.cc:260] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.560539 20470 raft_consensus.cc:2468] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.562142 20623 ts_tablet_manager.cc:1434] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:36.563374 20623 tablet_bootstrap.cc:492] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.565177 20620 ts_tablet_manager.cc:1434] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.005s
I20260709 13:20:36.569706 20623 tablet_bootstrap.cc:654] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.560073 20287 leader_election.cc:304] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.574419 20620 tablet_bootstrap.cc:492] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: Bootstrap starting.
I20260709 13:20:36.576239 20609 raft_consensus.cc:493] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.576845 20609 raft_consensus.cc:515] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.581259 20620 tablet_bootstrap.cc:654] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.581821 20623 tablet_bootstrap.cc:492] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.582365 20623 ts_tablet_manager.cc:1403] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:20:36.585377 20623 raft_consensus.cc:359] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.586156 20623 raft_consensus.cc:385] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.586431 20623 raft_consensus.cc:740] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.587174 20623 consensus_queue.cc:260] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.588145 20621 raft_consensus.cc:2804] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.588598 20621 raft_consensus.cc:493] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.588917 20621 raft_consensus.cc:3060] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.589860 20623 ts_tablet_manager.cc:1434] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:36.591020 20623 tablet_bootstrap.cc:492] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.593286 20620 tablet_bootstrap.cc:492] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: No bootstrap required, opened a new log
I20260709 13:20:36.593808 20620 ts_tablet_manager.cc:1403] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:20:36.594085 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:36.594801 20322 raft_consensus.cc:2468] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:36.596287 20436 leader_election.cc:304] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.596613 20620 raft_consensus.cc:359] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.597332 20620 raft_consensus.cc:385] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.597537 20623 tablet_bootstrap.cc:654] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.597846 20620 raft_consensus.cc:740] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.597951 20609 leader_election.cc:290] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:36.597209 20630 raft_consensus.cc:2804] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.598716 20630 raft_consensus.cc:493] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.598680 20620 consensus_queue.cc:260] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.599236 20630 raft_consensus.cc:3060] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.605302 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.606045 20397 raft_consensus.cc:2468] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 0.
I20260709 13:20:36.608842 20623 tablet_bootstrap.cc:492] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.609380 20623 ts_tablet_manager.cc:1403] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:20:36.609477 20620 ts_tablet_manager.cc:1434] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:20:36.612221 20623 raft_consensus.cc:359] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.612877 20623 raft_consensus.cc:385] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.613143 20623 raft_consensus.cc:740] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.613884 20623 consensus_queue.cc:260] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.615881 20623 ts_tablet_manager.cc:1434] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:36.616773 20623 tablet_bootstrap.cc:492] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: Bootstrap starting.
I20260709 13:20:36.622159 20623 tablet_bootstrap.cc:654] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.629222 20623 tablet_bootstrap.cc:492] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: No bootstrap required, opened a new log
I20260709 13:20:36.629666 20623 ts_tablet_manager.cc:1403] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:20:36.629896 20630 raft_consensus.cc:515] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.631991 20630 leader_election.cc:290] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:36.632330 20623 raft_consensus.cc:359] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.632894 20623 raft_consensus.cc:385] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.632761 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:36.633251 20623 raft_consensus.cc:740] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.633531 20322 raft_consensus.cc:3060] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.633949 20623 consensus_queue.cc:260] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.635540 20623 ts_tablet_manager.cc:1434] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:36.641064 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.641664 20397 raft_consensus.cc:3060] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.642748 20621 raft_consensus.cc:515] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.644819 20621 leader_election.cc:290] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.647032 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bdb5de0714691961973642b4b9985" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.647830 20396 raft_consensus.cc:3060] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.648388 20397 raft_consensus.cc:2468] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:36.648497 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bdb5de0714691961973642b4b9985" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.649137 20470 raft_consensus.cc:3060] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.647132 20322 raft_consensus.cc:2468] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 1.
I20260709 13:20:36.650339 20436 leader_election.cc:304] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:36.651259 20622 tablet_bootstrap.cc:492] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.656113 20396 raft_consensus.cc:2468] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.656713 20630 raft_consensus.cc:2804] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.657262 20630 raft_consensus.cc:697] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:36.657395 20287 leader_election.cc:304] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.657531 20470 raft_consensus.cc:2468] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.658066 20622 ts_tablet_manager.cc:1403] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.114s	user 0.032s	sys 0.070s
I20260709 13:20:36.658341 20621 raft_consensus.cc:2804] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.658281 20630 consensus_queue.cc:237] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.659806 20621 raft_consensus.cc:697] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:36.660511 20621 consensus_queue.cc:237] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.661253 20622 raft_consensus.cc:359] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.662012 20622 raft_consensus.cc:385] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.662318 20622 raft_consensus.cc:740] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.664283 20622 consensus_queue.cc:260] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.667663 20219 catalog_manager.cc:5697] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.668637 20622 ts_tablet_manager.cc:1434] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:20:36.669691 20622 tablet_bootstrap.cc:492] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.675494 20622 tablet_bootstrap.cc:654] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.679548 20216 catalog_manager.cc:5697] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.680460 20622 tablet_bootstrap.cc:492] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.680907 20622 ts_tablet_manager.cc:1403] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:20:36.682814 20622 raft_consensus.cc:359] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.683274 20622 raft_consensus.cc:385] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.683459 20622 raft_consensus.cc:740] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.683974 20622 consensus_queue.cc:260] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.685415 20622 ts_tablet_manager.cc:1434] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:36.686571 20622 tablet_bootstrap.cc:492] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: Bootstrap starting.
I20260709 13:20:36.690989 20622 tablet_bootstrap.cc:654] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.695096 20622 tablet_bootstrap.cc:492] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: No bootstrap required, opened a new log
I20260709 13:20:36.695497 20622 ts_tablet_manager.cc:1403] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:20:36.697417 20622 raft_consensus.cc:359] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.697861 20622 raft_consensus.cc:385] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.698058 20622 raft_consensus.cc:740] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.698530 20622 consensus_queue.cc:260] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.700397 20622 ts_tablet_manager.cc:1434] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:36.737597 20607 raft_consensus.cc:493] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.739310 20607 raft_consensus.cc:515] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.744405 20621 raft_consensus.cc:493] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.745523 20621 raft_consensus.cc:515] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.748114 20607 leader_election.cc:290] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.750676 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.751350 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.752094 20470 raft_consensus.cc:2468] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.752429 20396 raft_consensus.cc:2468] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.753648 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f47f69aea4436d82a2f64ebb61d3d0" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.754106 20287 leader_election.cc:304] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.754639 20397 raft_consensus.cc:2468] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.755403 20607 raft_consensus.cc:2804] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.755834 20607 raft_consensus.cc:493] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.756520 20621 leader_election.cc:290] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.756309 20287 leader_election.cc:304] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.757232 20607 raft_consensus.cc:3060] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.757786 20621 raft_consensus.cc:2804] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.758291 20621 raft_consensus.cc:493] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.758773 20621 raft_consensus.cc:3060] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.759083 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f47f69aea4436d82a2f64ebb61d3d0" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.760073 20470 raft_consensus.cc:2468] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.770607 20607 raft_consensus.cc:515] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.770676 20621 raft_consensus.cc:515] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.772537 20658 raft_consensus.cc:493] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.773337 20658 raft_consensus.cc:515] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.774111 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f47f69aea4436d82a2f64ebb61d3d0" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.773820 20607 leader_election.cc:290] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.775398 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.775815 20658 leader_election.cc:290] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.776238 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.776767 20397 raft_consensus.cc:3060] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.777336 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.777789 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.778123 20395 raft_consensus.cc:2468] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.778573 20470 raft_consensus.cc:2468] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.774732 20396 raft_consensus.cc:3060] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.779628 20287 leader_election.cc:304] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.779901 20471 raft_consensus.cc:3060] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.782063 20658 raft_consensus.cc:2804] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.782398 20658 raft_consensus.cc:493] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.782691 20658 raft_consensus.cc:3060] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.790037 20397 raft_consensus.cc:2468] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.791429 20287 leader_election.cc:304] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.791658 20621 leader_election.cc:290] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.792548 20621 raft_consensus.cc:2804] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.793167 20621 raft_consensus.cc:697] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:36.793586 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f47f69aea4436d82a2f64ebb61d3d0" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.794695 20470 raft_consensus.cc:3060] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.794759 20621 consensus_queue.cc:237] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.795500 20658 raft_consensus.cc:515] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.798019 20658 leader_election.cc:290] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.800101 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.800727 20395 raft_consensus.cc:3060] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.805059 20470 raft_consensus.cc:2468] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.806020 20471 raft_consensus.cc:2468] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.809751 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.810462 20470 raft_consensus.cc:3060] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.808934 20287 leader_election.cc:304] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.790148 20396 raft_consensus.cc:2468] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.814440 20395 raft_consensus.cc:2468] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.814569 20658 raft_consensus.cc:2804] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.815361 20658 raft_consensus.cc:697] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:36.815946 20287 leader_election.cc:304] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.816861 20607 raft_consensus.cc:2804] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.816416 20658 consensus_queue.cc:237] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.823463 20630 consensus_queue.cc:1048] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:36.823843 20470 raft_consensus.cc:2468] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.829818 20638 raft_consensus.cc:493] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.830516 20638 raft_consensus.cc:515] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.831125 20216 catalog_manager.cc:5697] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.833453 20607 raft_consensus.cc:697] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:36.834538 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dce7c45de7b465cae760e1493350a3d" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:36.834775 20607 consensus_queue.cc:237] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.835345 20322 raft_consensus.cc:2468] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:36.836926 20362 leader_election.cc:304] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.838037 20551 raft_consensus.cc:2804] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.838460 20551 raft_consensus.cc:493] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.838788 20551 raft_consensus.cc:3060] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.853448 20660 raft_consensus.cc:493] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.854328 20660 raft_consensus.cc:515] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.857851 20638 leader_election.cc:290] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.855517 20551 raft_consensus.cc:515] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.859229 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:36.860044 20395 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.861163 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dce7c45de7b465cae760e1493350a3d" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:36.861771 20322 raft_consensus.cc:3060] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.862447 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.863221 20471 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 0.
I20260709 13:20:36.861914 20287 leader_election.cc:304] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.866752 20607 raft_consensus.cc:2804] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.867143 20607 raft_consensus.cc:493] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.867497 20607 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.861158 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dce7c45de7b465cae760e1493350a3d" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.869009 20609 consensus_queue.cc:1048] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:36.869578 20470 raft_consensus.cc:2468] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:36.872148 20322 raft_consensus.cc:2468] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:36.856860 20660 leader_election.cc:290] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.880080 20362 leader_election.cc:304] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.879254 20607 raft_consensus.cc:515] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.882174 20638 raft_consensus.cc:2804] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.884564 20607 leader_election.cc:290] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.885357 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:36.886057 20396 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.886096 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.886792 20470 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.885418 20219 catalog_manager.cc:5697] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.894430 20470 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.895174 20219 catalog_manager.cc:5697] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.895783 20287 leader_election.cc:304] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.900488 20660 raft_consensus.cc:2804] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.901006 20660 raft_consensus.cc:697] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:36.902101 20660 consensus_queue.cc:237] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.906934 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dce7c45de7b465cae760e1493350a3d" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.907503 20470 raft_consensus.cc:3060] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.907829 20551 leader_election.cc:290] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.916021 20396 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 1.
I20260709 13:20:36.910705 20638 raft_consensus.cc:697] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:36.930413 20638 consensus_queue.cc:237] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.931164 20470 raft_consensus.cc:2468] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:36.936203 20219 catalog_manager.cc:5697] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.940093 20216 catalog_manager.cc:5697] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.942641 20638 raft_consensus.cc:493] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.943157 20638 raft_consensus.cc:515] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.945324 20638 leader_election.cc:290] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.946257 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:36.946537 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" is_pre_election: true
I20260709 13:20:36.947206 20470 raft_consensus.cc:2468] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:36.947468 20321 raft_consensus.cc:2468] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 0.
I20260709 13:20:36.948638 20362 leader_election.cc:304] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:36.949260 20638 raft_consensus.cc:2804] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.949609 20638 raft_consensus.cc:493] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.949880 20638 raft_consensus.cc:3060] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.957350 20638 raft_consensus.cc:515] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.958837 20638 leader_election.cc:290] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:36.959635 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:36.959942 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:36.960216 20321 raft_consensus.cc:3060] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.960597 20470 raft_consensus.cc:3060] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.965466 20470 raft_consensus.cc:2468] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:36.966260 20321 raft_consensus.cc:2468] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 1.
I20260709 13:20:36.966310 20362 leader_election.cc:304] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:36.967222 20638 raft_consensus.cc:2804] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.967608 20638 raft_consensus.cc:697] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:36.968319 20638 consensus_queue.cc:237] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:36.975886 20216 catalog_manager.cc:5697] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 1 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.066284 20470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:44418
I20260709 13:20:37.067050 20470 raft_consensus.cc:606] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:37.073120 20470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:44418
I20260709 13:20:37.073701 20470 raft_consensus.cc:606] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:37.078569 20396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
mode: GRACEFUL
new_leader_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:33858
I20260709 13:20:37.079056 20396 raft_consensus.cc:606] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Received request to transfer leadership to TS 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:37.086503 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:37.087023 20321 raft_consensus.cc:606] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 5f2a0ad7034e4d3a820fe81d09c58b44
I20260709 13:20:37.092252 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "013bdb5de0714691961973642b4b9985"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:37.092739 20321 raft_consensus.cc:606] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 5f2a0ad7034e4d3a820fe81d09c58b44
I20260709 13:20:37.101162 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:37.101711 20321 raft_consensus.cc:606] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 5f2a0ad7034e4d3a820fe81d09c58b44
I20260709 13:20:37.105232 20609 consensus_queue.cc:1048] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.108645 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:53542
I20260709 13:20:37.109246 20322 raft_consensus.cc:606] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Received request to transfer leadership to TS 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:37.124696 20630 raft_consensus.cc:993] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:37.125288 20630 raft_consensus.cc:1081] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:37.127614 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55692
I20260709 13:20:37.129025 20322 raft_consensus.cc:493] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.129397 20322 raft_consensus.cc:3060] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.133234 20609 consensus_queue.cc:1048] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.137979 20322 raft_consensus.cc:515] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.140143 20322 leader_election.cc:290] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:37.142011 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:37.142460 20470 raft_consensus.cc:3055] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.142735 20470 raft_consensus.cc:740] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:37.143533 20470 consensus_queue.cc:260] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.143977 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c1b41d09f747ce91a4de4bccb01027" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:37.144729 20470 raft_consensus.cc:3060] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.144800 20395 raft_consensus.cc:3060] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.151101 20470 raft_consensus.cc:2468] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:37.152135 20287 leader_election.cc:304] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:37.152397 20395 raft_consensus.cc:2468] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:37.152808 20660 raft_consensus.cc:2804] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.153316 20660 raft_consensus.cc:697] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.154210 20660 consensus_queue.cc:237] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.161451 20219 catalog_manager.cc:5697] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.165793 20607 consensus_queue.cc:1048] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.173956 20607 raft_consensus.cc:993] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:37.174484 20621 raft_consensus.cc:1081] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:37.176751 20396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "013bdb5de0714691961973642b4b9985"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:20:37.177609 20396 raft_consensus.cc:493] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.178095 20396 raft_consensus.cc:3060] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.183012 20621 consensus_queue.cc:1048] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.187407 20396 raft_consensus.cc:515] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.191146 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bdb5de0714691961973642b4b9985" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:37.191836 20322 raft_consensus.cc:3055] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.192098 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "013bdb5de0714691961973642b4b9985" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:37.192135 20322 raft_consensus.cc:740] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.193725 20322 consensus_queue.cc:260] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.194671 20322 raft_consensus.cc:3060] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.195870 20396 leader_election.cc:290] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:37.202556 20322 raft_consensus.cc:2468] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:37.206620 20362 leader_election.cc:304] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:37.207347 20638 raft_consensus.cc:2804] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.207942 20638 raft_consensus.cc:697] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:37.208864 20638 consensus_queue.cc:237] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.215536 20219 catalog_manager.cc:5697] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.258412 20607 consensus_queue.cc:1048] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.269057 20621 consensus_queue.cc:1048] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.284746 20621 consensus_queue.cc:1048] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.291177 20660 raft_consensus.cc:993] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:37.291684 20658 raft_consensus.cc:1081] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:37.294796 20395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:20:37.295323 20395 raft_consensus.cc:493] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.295632 20395 raft_consensus.cc:3060] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.302222 20621 consensus_queue.cc:1048] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.302672 20395 raft_consensus.cc:515] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.304877 20395 leader_election.cc:290] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:37.305868 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:37.308038 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e4a2a9cfad4ff49014c374fb2ba792" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:37.308219 20322 raft_consensus.cc:3055] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.308655 20322 raft_consensus.cc:740] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.309430 20322 consensus_queue.cc:260] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.310103 20322 raft_consensus.cc:3060] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.315199 20322 raft_consensus.cc:2468] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:37.316211 20362 leader_election.cc:304] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:37.317042 20551 raft_consensus.cc:2804] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.317444 20551 raft_consensus.cc:697] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:37.318266 20551 consensus_queue.cc:237] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.322784 20621 consensus_queue.cc:1048] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.326972 20216 catalog_manager.cc:5697] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.330605 20658 raft_consensus.cc:993] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:37.331248 20660 raft_consensus.cc:1081] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 5f2a0ad7034e4d3a820fe81d09c58b44 to start an election
I20260709 13:20:37.333740 20396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:20:37.336279 20396 raft_consensus.cc:493] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.336848 20396 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.336704 20658 consensus_queue.cc:1048] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.347429 20396 raft_consensus.cc:515] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.349694 20396 leader_election.cc:290] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:37.350759 20470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:37.350797 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:37.351948 20470 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.352409 20322 raft_consensus.cc:3055] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.352739 20322 raft_consensus.cc:740] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.353479 20322 consensus_queue.cc:260] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.354733 20322 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.358165 20470 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:37.359328 20362 leader_election.cc:304] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:37.360184 20551 raft_consensus.cc:2804] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.360678 20551 raft_consensus.cc:697] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Leader. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:37.360637 20638 consensus_queue.cc:1048] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.361074 20322 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f2a0ad7034e4d3a820fe81d09c58b44 in term 2.
I20260709 13:20:37.361994 20551 consensus_queue.cc:237] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.370683 20667 raft_consensus.cc:993] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:37.371214 20551 raft_consensus.cc:1081] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:37.373521 20321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55700
I20260709 13:20:37.374498 20321 raft_consensus.cc:493] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.374874 20321 raft_consensus.cc:3060] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.375391 20219 catalog_manager.cc:5697] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194). New cstate: current_term: 2 leader_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.377549 20551 consensus_queue.cc:1048] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.384174 20321 raft_consensus.cc:515] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.386437 20321 leader_election.cc:290] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:37.387954 20471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:37.388459 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7cacb71ff4c6c94aa737b08fc4d7a" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:37.389335 20396 raft_consensus.cc:3055] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.389716 20396 raft_consensus.cc:740] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:37.390552 20396 consensus_queue.cc:260] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.391701 20396 raft_consensus.cc:3060] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.393527 20638 consensus_queue.cc:1048] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.399063 20396 raft_consensus.cc:2468] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:37.400812 20287 leader_election.cc:304] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:37.402453 20658 raft_consensus.cc:2804] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.402977 20658 raft_consensus.cc:697] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.403919 20658 consensus_queue.cc:237] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.405515 20621 consensus_queue.cc:1048] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.411938 20660 consensus_queue.cc:1048] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.421962 20607 raft_consensus.cc:993] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:37.422500 20607 raft_consensus.cc:1081] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Signalling peer 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:37.425098 20469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:55850
I20260709 13:20:37.425774 20469 raft_consensus.cc:493] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.426189 20469 raft_consensus.cc:3060] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.427644 20638 consensus_queue.cc:1048] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.434654 20469 raft_consensus.cc:515] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.438759 20219 catalog_manager.cc:5697] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.443785 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:37.444473 20321 raft_consensus.cc:3055] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.444806 20321 raft_consensus.cc:740] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.445640 20321 consensus_queue.cc:260] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.446913 20321 raft_consensus.cc:3060] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.452989 20609 raft_consensus.cc:993] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: : Instructing follower 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:37.453532 20630 raft_consensus.cc:1081] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Signalling peer 90b4ce8af2fc4630929b3af07191b675 to start an election
I20260709 13:20:37.455154 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c64541b2794e6d93c42dcb630fb128" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:37.455668 20395 raft_consensus.cc:3060] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.455576 20320 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
 from {username='slave'} at 127.0.0.1:55692
I20260709 13:20:37.459930 20469 leader_election.cc:290] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:37.460076 20320 raft_consensus.cc:493] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.453467 20321 raft_consensus.cc:2468] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 2.
I20260709 13:20:37.461504 20320 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.462201 20436 leader_election.cc:304] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:37.463176 20632 raft_consensus.cc:2804] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.463653 20632 raft_consensus.cc:697] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:37.464877 20395 raft_consensus.cc:2468] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 2.
I20260709 13:20:37.464552 20632 consensus_queue.cc:237] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.470141 20320 raft_consensus.cc:515] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.471953 20320 leader_election.cc:290] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Requested vote from peers 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227), 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195:40477)
I20260709 13:20:37.472949 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:37.473209 20469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "90b4ce8af2fc4630929b3af07191b675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
I20260709 13:20:37.473562 20395 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.473776 20469 raft_consensus.cc:3055] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.474135 20469 raft_consensus.cc:740] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:37.474871 20469 consensus_queue.cc:260] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.475957 20469 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.480440 20395 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:37.479928 20219 catalog_manager.cc:5697] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 1 to 2, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.481729 20287 leader_election.cc:304] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:37.482379 20621 raft_consensus.cc:2804] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.482786 20621 raft_consensus.cc:697] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Leader. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:37.483793 20469 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90b4ce8af2fc4630929b3af07191b675 in term 2.
I20260709 13:20:37.483580 20621 consensus_queue.cc:237] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:37.491248 20216 catalog_manager.cc:5697] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 reported cstate change: term changed from 1 to 2, leader changed from 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195) to 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "90b4ce8af2fc4630929b3af07191b675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.557685 20469 raft_consensus.cc:1275] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.558911 20621 consensus_queue.cc:1048] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.568624 20395 raft_consensus.cc:1275] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.570317 20621 consensus_queue.cc:1048] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.771303 20320 raft_consensus.cc:1275] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.771786 20321 raft_consensus.cc:1275] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.772637 20638 consensus_queue.cc:1048] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.773205 20551 consensus_queue.cc:1048] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.774205 20469 raft_consensus.cc:3060] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.784188 20469 raft_consensus.cc:1275] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.786991 20667 consensus_queue.cc:1048] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.787849 20469 raft_consensus.cc:1275] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.790005 20667 consensus_queue.cc:1048] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.797386 20395 raft_consensus.cc:1275] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.799564 20607 consensus_queue.cc:1048] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.812674 20471 raft_consensus.cc:3060] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.820086 20469 raft_consensus.cc:3060] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.822084 20471 raft_consensus.cc:1275] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.823998 20660 consensus_queue.cc:1048] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.827689 20469 raft_consensus.cc:1275] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.829229 20638 consensus_queue.cc:1048] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.838480 20320 raft_consensus.cc:1275] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 5f2a0ad7034e4d3a820fe81d09c58b44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.840193 20638 consensus_queue.cc:1048] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.980629 20395 raft_consensus.cc:1275] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.981899 20660 consensus_queue.cc:1048] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:37.990450 20471 raft_consensus.cc:1275] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Refusing update from remote peer 90b4ce8af2fc4630929b3af07191b675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:37.993618 20607 consensus_queue.cc:1048] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.017452 20320 raft_consensus.cc:1275] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.018626 20632 consensus_queue.cc:1048] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.028427 20396 raft_consensus.cc:1275] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.030514 20632 consensus_queue.cc:1048] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:40.624936 20694 raft_consensus.cc:493] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 90b4ce8af2fc4630929b3af07191b675)
I20260709 13:20:40.626576 20694 raft_consensus.cc:515] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:40.635818 20694 leader_election.cc:290] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:40.631361 20702 raft_consensus.cc:493] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90b4ce8af2fc4630929b3af07191b675)
I20260709 13:20:40.643486 20702 raft_consensus.cc:515] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:40.645865 20702 leader_election.cc:290] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:40.676101 20393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f47f69aea4436d82a2f64ebb61d3d0" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:40.677105 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" is_pre_election: true
I20260709 13:20:40.679663 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:40.681300 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f47f69aea4436d82a2f64ebb61d3d0" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90b4ce8af2fc4630929b3af07191b675" is_pre_election: true
I20260709 13:20:40.683457 20436 leader_election.cc:304] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:40.684170 20706 raft_consensus.cc:2749] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:40.684541 20436 leader_election.cc:304] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 90b4ce8af2fc4630929b3af07191b675
I20260709 13:20:40.685343 20706 raft_consensus.cc:2749] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:40.702476 20251 debug-util.cc:398] Leaking SignalData structure 0x7b0800245240 after lost signal to thread 8942
W20260709 13:20:40.703604 20251 debug-util.cc:398] Leaking SignalData structure 0x7b080000e200 after lost signal to thread 20254
W20260709 13:20:40.704741 20251 debug-util.cc:398] Leaking SignalData structure 0x7b0800325f80 after lost signal to thread 20346
W20260709 13:20:40.705754 20251 debug-util.cc:398] Leaking SignalData structure 0x7b08002d72e0 after lost signal to thread 20421
W20260709 13:20:40.706717 20251 debug-util.cc:398] Leaking SignalData structure 0x7b0800212f80 after lost signal to thread 20495
I20260709 13:20:40.841387 20219 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37996:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:40.870384 20219 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37996:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:40.929387  8939 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:41.141808 20751 tablet.cc:1724] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:41.184451 20746 log.cc:927] Time spent T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:41.233984 20756 tablet.cc:1724] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:41.240243 20744 log.cc:927] Time spent T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:20:41.248099 20423 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:17c1b41d09f747ce91a4de4bccb01027)
I20260709 13:20:41.178020 20750 tablet.cc:1724] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.254436 20759 tablet.cc:1724] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:41.257315 20423 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:17c1b41d09f747ce91a4de4bccb01027)
W20260709 13:20:41.260118 20754 log.cc:927] Time spent T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:20:41.279119 20765 tablet.cc:1724] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.258919 20757 tablet.cc:1724] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:41.284605 20742 log.cc:927] Time spent T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
W20260709 13:20:41.296689 20423 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:17c1b41d09f747ce91a4de4bccb01027)
I20260709 13:20:41.315418 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:53550
I20260709 13:20:41.316169 20321 raft_consensus.cc:606] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Received request to transfer leadership to TS 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:41.318781 20762 tablet.cc:1724] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.344182 20219 catalog_manager.cc:5789] TS 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051) does not have the latest schema for tablet b0f47f69aea4436d82a2f64ebb61d3d0 (table soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]). Expected version 1 got 0
I20260709 13:20:41.344524 20767 tablet.cc:1724] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.345731 20219 catalog_manager.cc:5789] TS 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051) does not have the latest schema for tablet 00a7cacb71ff4c6c94aa737b08fc4d7a (table soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]). Expected version 1 got 0
I20260709 13:20:41.276742 20764 tablet.cc:1724] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.361954 20759 tablet.cc:1724] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.364210 20750 tablet.cc:1724] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.280903 20763 tablet.cc:1724] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.390182 20701 raft_consensus.cc:993] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.390805 20701 raft_consensus.cc:1081] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Signalling peer 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.376300 20768 tablet.cc:1724] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.396219 20761 tablet.cc:1724] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.401841 20757 tablet.cc:1724] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.401933 20466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:55850
I20260709 13:20:41.409219 20466 raft_consensus.cc:493] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.409830 20466 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.390027 20751 tablet.cc:1724] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.433948 20216 catalog_manager.cc:5789] TS 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227) does not have the latest schema for tablet 41e4a2a9cfad4ff49014c374fb2ba792 (table soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]). Expected version 1 got 0
I20260709 13:20:41.442680 20216 catalog_manager.cc:5789] TS 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227) does not have the latest schema for tablet 013bdb5de0714691961973642b4b9985 (table soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e]). Expected version 1 got 0
I20260709 13:20:41.439170 20767 tablet.cc:1724] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.438612 20756 tablet.cc:1724] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.462083 20394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
mode: GRACEFUL
new_leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:41.462857 20394 raft_consensus.cc:606] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Received request to transfer leadership to TS 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:41.464496  8939 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:20:41.465212 20765 tablet.cc:1724] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.465235  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:41.468631 20764 tablet.cc:1724] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.474985 20750 tablet.cc:1724] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.479655 20757 tablet.cc:1724] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.482852 20762 tablet.cc:1724] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.486397 20466 raft_consensus.cc:515] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.498894 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:41.499550 20318 raft_consensus.cc:3055] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:41.499876 20318 raft_consensus.cc:740] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:41.494838 20768 tablet.cc:1724] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.505111 20394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa"
dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
mode: GRACEFUL
new_leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:41.505541 20318 consensus_queue.cc:260] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.506088 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b527c4d305f4e70b0036cd36edfea77" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:41.506752 20397 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.513890 20397 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 3.
I20260709 13:20:41.515384 20436 leader_election.cc:304] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:41.504998 20466 leader_election.cc:290] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:41.506816 20318 raft_consensus.cc:3060] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.517078 20706 raft_consensus.cc:2804] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:41.519687 20706 raft_consensus.cc:697] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:41.520673 20706 consensus_queue.cc:237] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.521656 20394 raft_consensus.cc:606] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Received request to transfer leadership to TS 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:41.526614 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6016352b674649c09f0e8445b01cf523"
dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
mode: GRACEFUL
new_leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:53550
I20260709 13:20:41.527242 20321 raft_consensus.cc:606] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Received request to transfer leadership to TS 78b17ab8bb41473db2de65bbfcf28ae4
I20260709 13:20:41.530596  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:41.534122  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:41.534866 20318 raft_consensus.cc:2468] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 3.
I20260709 13:20:41.540968 20765 tablet.cc:1724] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.527508 20761 tablet.cc:1724] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.549460 20751 tablet.cc:1724] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:41.549715 20218 catalog_manager.cc:5697] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 2 to 3, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:41.562477 20728 raft_consensus.cc:993] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: : Instructing follower 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.563041 20728 raft_consensus.cc:1081] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Signalling peer 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.568764 20466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:55852
I20260709 13:20:41.569391 20466 raft_consensus.cc:493] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.569787 20466 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.577879 20466 raft_consensus.cc:515] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.579944 20466 leader_election.cc:290] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:41.580745 20318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:41.581542 20318 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.581811 20394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba43f7aaaf074198b22c890ea79e1e79" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:41.582315 20394 raft_consensus.cc:3055] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:41.582523 20394 raft_consensus.cc:740] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:41.583220 20394 consensus_queue.cc:260] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.584553 20394 raft_consensus.cc:3060] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.589320 20318 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 3.
I20260709 13:20:41.590819 20705 raft_consensus.cc:993] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: : Instructing follower 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.590965 20436 leader_election.cc:304] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:41.591534 20705 raft_consensus.cc:1081] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Signalling peer 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.591876 20706 raft_consensus.cc:2804] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:41.592453 20706 raft_consensus.cc:697] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:41.593334 20706 consensus_queue.cc:237] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.593739 20464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6016352b674649c09f0e8445b01cf523"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:55850
I20260709 13:20:41.594187 20219 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1: soft_deleted_table [id=9c7574975abc42d6ad85a44512511d6e] alter complete (version 1)
I20260709 13:20:41.594442 20464 raft_consensus.cc:493] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.594903 20464 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.609750 20464 raft_consensus.cc:515] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.611986 20464 leader_election.cc:290] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:41.615661 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:41.616403 20321 raft_consensus.cc:3055] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:41.616721 20321 raft_consensus.cc:740] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 90b4ce8af2fc4630929b3af07191b675, State: Running, Role: LEADER
I20260709 13:20:41.617599 20321 consensus_queue.cc:260] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.593326 20394 raft_consensus.cc:2468] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 3.
I20260709 13:20:41.619632 20397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016352b674649c09f0e8445b01cf523" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:41.620394 20397 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.622848 20321 raft_consensus.cc:3060] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:41.632265 20321 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 3.
I20260709 13:20:41.632265 20397 raft_consensus.cc:2468] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 3.
I20260709 13:20:41.633589 20436 leader_election.cc:304] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f2a0ad7034e4d3a820fe81d09c58b44, 78b17ab8bb41473db2de65bbfcf28ae4; no voters: 
I20260709 13:20:41.635056 20707 raft_consensus.cc:2804] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:41.635524 20707 raft_consensus.cc:697] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:41.637387 20707 consensus_queue.cc:237] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.639016 20219 catalog_manager.cc:5697] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 2 to 3, leader changed from 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194) to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:41.656711 20699 raft_consensus.cc:993] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: : Instructing follower 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.660187 20728 raft_consensus.cc:1081] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Signalling peer 78b17ab8bb41473db2de65bbfcf28ae4 to start an election
I20260709 13:20:41.663618 20464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa"
dest_uuid: "78b17ab8bb41473db2de65bbfcf28ae4"
 from {username='slave'} at 127.0.0.1:55852
I20260709 13:20:41.664274 20464 raft_consensus.cc:493] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.664660 20464 raft_consensus.cc:3060] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:41.671635 20464 raft_consensus.cc:515] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.673699 20464 leader_election.cc:290] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051), 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227)
I20260709 13:20:41.675259 20394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44"
I20260709 13:20:41.675935 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a9755bf638a41beaf150bdd704137aa" candidate_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90b4ce8af2fc4630929b3af07191b675"
I20260709 13:20:41.676544 20321 raft_consensus.cc:3060] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:41.676102 20394 raft_consensus.cc:3055] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:41.677063 20394 raft_consensus.cc:740] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f2a0ad7034e4d3a820fe81d09c58b44, State: Running, Role: LEADER
I20260709 13:20:41.677932 20394 consensus_queue.cc:260] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.679656 20394 raft_consensus.cc:3060] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:41.685410 20321 raft_consensus.cc:2468] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 2.
I20260709 13:20:41.686599 20436 leader_election.cc:304] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b17ab8bb41473db2de65bbfcf28ae4, 90b4ce8af2fc4630929b3af07191b675; no voters: 
I20260709 13:20:41.687453 20707 raft_consensus.cc:2804] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:41.687951 20707 raft_consensus.cc:697] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 LEADER]: Becoming Leader. State: Replica: 78b17ab8bb41473db2de65bbfcf28ae4, State: Running, Role: LEADER
I20260709 13:20:41.688791 20707 consensus_queue.cc:237] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } }
I20260709 13:20:41.690045 20394 raft_consensus.cc:2468] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b17ab8bb41473db2de65bbfcf28ae4 in term 2.
I20260709 13:20:41.694473 20219 catalog_manager.cc:5697] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 2 to 3, leader changed from 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193) to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:41.710494 20219 catalog_manager.cc:5697] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 reported cstate change: term changed from 1 to 2, leader changed from 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194) to 78b17ab8bb41473db2de65bbfcf28ae4 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78b17ab8bb41473db2de65bbfcf28ae4" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40477 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:41.935580 20394 raft_consensus.cc:1275] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:41.936986 20707 consensus_queue.cc:1048] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:41.946878 20321 raft_consensus.cc:1275] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:41.948967 20707 consensus_queue.cc:1048] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:42.019483 20321 raft_consensus.cc:1275] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:42.020732 20707 consensus_queue.cc:1048] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:42.034008 20394 raft_consensus.cc:1275] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:42.037524 20706 consensus_queue.cc:1048] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:42.096534 20321 raft_consensus.cc:1275] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:42.097780 20706 consensus_queue.cc:1048] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:42.112313 20397 raft_consensus.cc:1275] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:42.114524 20706 consensus_queue.cc:1048] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:42.119263 20394 raft_consensus.cc:1275] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:42.122516 20706 consensus_queue.cc:1048] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f2a0ad7034e4d3a820fe81d09c58b44" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 42227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:42.144536 20321 raft_consensus.cc:1275] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Refusing update from remote peer 78b17ab8bb41473db2de65bbfcf28ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:42.146052 20780 consensus_queue.cc:1048] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90b4ce8af2fc4630929b3af07191b675" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:42.605768  8939 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:42.613934  8939 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:20:42.614627  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:42.622573  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:42.623188  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:43.658372  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
W20260709 13:20:43.667404 20362 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:20:43.673668 20362 consensus_peers.cc:597] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.674391 20362 consensus_peers.cc:597] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.693091 20436 consensus_peers.cc:597] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.694128 20436 consensus_peers.cc:597] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.701104 20362 consensus_peers.cc:597] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.718770  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:43.719852  8939 tablet_replica.cc:333] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.720780  8939 raft_consensus.cc:2243] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.721316  8939 raft_consensus.cc:2272] T 41e4a2a9cfad4ff49014c374fb2ba792 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.723519  8939 tablet_replica.cc:333] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.724210  8939 raft_consensus.cc:2243] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.724774  8939 raft_consensus.cc:2272] T 97c64541b2794e6d93c42dcb630fb128 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.727939  8939 tablet_replica.cc:333] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.728868  8939 raft_consensus.cc:2243] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.729921  8939 raft_consensus.cc:2272] T b0f47f69aea4436d82a2f64ebb61d3d0 P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.732679  8939 tablet_replica.cc:333] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.733295  8939 raft_consensus.cc:2243] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.734105  8939 raft_consensus.cc:2272] T 17c1b41d09f747ce91a4de4bccb01027 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.736501  8939 tablet_replica.cc:333] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.737273  8939 raft_consensus.cc:2243] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.737988  8939 raft_consensus.cc:2272] T 9b527c4d305f4e70b0036cd36edfea77 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.740742  8939 tablet_replica.cc:333] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.741544  8939 raft_consensus.cc:2243] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.741988  8939 raft_consensus.cc:2272] T 6016352b674649c09f0e8445b01cf523 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.745030  8939 tablet_replica.cc:333] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.745679  8939 raft_consensus.cc:2243] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.746184  8939 raft_consensus.cc:2272] T 733500534d214a1082a887479eaac70d P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.748767  8939 tablet_replica.cc:333] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.749341  8939 raft_consensus.cc:2243] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.749810  8939 raft_consensus.cc:2272] T 013bdb5de0714691961973642b4b9985 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.752231  8939 tablet_replica.cc:333] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.752810  8939 raft_consensus.cc:2243] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.753693  8939 raft_consensus.cc:2272] T ef537db43f0d41e2837791d64bd94f7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.756560  8939 tablet_replica.cc:333] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.757136  8939 raft_consensus.cc:2243] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.758069  8939 raft_consensus.cc:2272] T bbab503d13b34aa887b5003be876e11a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.760869  8939 tablet_replica.cc:333] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.761425  8939 raft_consensus.cc:2243] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.761915  8939 raft_consensus.cc:2272] T ba43f7aaaf074198b22c890ea79e1e79 P 90b4ce8af2fc4630929b3af07191b675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.764281  8939 tablet_replica.cc:333] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.764843  8939 raft_consensus.cc:2243] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.765735  8939 raft_consensus.cc:2272] T c55ab9435e8b476ca4bdd6f956f9d00f P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.768656  8939 tablet_replica.cc:333] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.769405  8939 raft_consensus.cc:2243] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.769873  8939 raft_consensus.cc:2272] T 3dce7c45de7b465cae760e1493350a3d P 90b4ce8af2fc4630929b3af07191b675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.772044  8939 tablet_replica.cc:333] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.772657  8939 raft_consensus.cc:2243] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.773123  8939 raft_consensus.cc:2272] T a8e6b8eb111f42d7845337f0ac05bbbe P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.775671  8939 tablet_replica.cc:333] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.776340  8939 raft_consensus.cc:2243] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.776831  8939 raft_consensus.cc:2272] T 4f759c276920467baa15209bb0a49a5e P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.779203  8939 tablet_replica.cc:333] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.779893  8939 raft_consensus.cc:2243] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.780368  8939 raft_consensus.cc:2272] T 3a9755bf638a41beaf150bdd704137aa P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.782647  8939 tablet_replica.cc:333] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.783139  8939 raft_consensus.cc:2243] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.784047  8939 raft_consensus.cc:2272] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.787038  8939 tablet_replica.cc:333] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675: stopping tablet replica
I20260709 13:20:43.787571  8939 raft_consensus.cc:2243] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.788056  8939 raft_consensus.cc:2272] T 0105ac9286ab4be9a2e839ebaba3d067 P 90b4ce8af2fc4630929b3af07191b675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.825083  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
W20260709 13:20:43.850507 20436 consensus_peers.cc:597] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.872164  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
W20260709 13:20:43.901268 20436 consensus_peers.cc:597] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.909703  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:43.910830  8939 tablet_replica.cc:333] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.912056  8939 raft_consensus.cc:2243] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.913230  8939 raft_consensus.cc:2272] T 41e4a2a9cfad4ff49014c374fb2ba792 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.916586  8939 tablet_replica.cc:333] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.917631  8939 raft_consensus.cc:2243] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.918269  8939 raft_consensus.cc:2272] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.921573  8939 tablet_replica.cc:333] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.922384  8939 raft_consensus.cc:2243] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.922957  8939 raft_consensus.cc:2272] T 97c64541b2794e6d93c42dcb630fb128 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:43.923370 20436 consensus_peers.cc:597] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.925791  8939 tablet_replica.cc:333] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.926795  8939 raft_consensus.cc:2243] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.927433  8939 raft_consensus.cc:2272] T b0f47f69aea4436d82a2f64ebb61d3d0 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.930619  8939 tablet_replica.cc:333] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.931514  8939 raft_consensus.cc:2243] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.932142  8939 raft_consensus.cc:2272] T 17c1b41d09f747ce91a4de4bccb01027 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.935192  8939 tablet_replica.cc:333] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.936116  8939 raft_consensus.cc:2243] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.936746  8939 raft_consensus.cc:2272] T 9b527c4d305f4e70b0036cd36edfea77 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.939815  8939 tablet_replica.cc:333] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.940723  8939 raft_consensus.cc:2243] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.941377  8939 raft_consensus.cc:2272] T c55ab9435e8b476ca4bdd6f956f9d00f P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.944583  8939 tablet_replica.cc:333] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.945458  8939 raft_consensus.cc:2243] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.946030  8939 raft_consensus.cc:2272] T ba43f7aaaf074198b22c890ea79e1e79 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.949136  8939 tablet_replica.cc:333] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.949995  8939 raft_consensus.cc:2243] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.950598  8939 raft_consensus.cc:2272] T 6016352b674649c09f0e8445b01cf523 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.953809  8939 tablet_replica.cc:333] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.954562  8939 raft_consensus.cc:2243] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.955860  8939 raft_consensus.cc:2272] T 733500534d214a1082a887479eaac70d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.958948  8939 tablet_replica.cc:333] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.959687  8939 raft_consensus.cc:2243] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.960959  8939 raft_consensus.cc:2272] T 0105ac9286ab4be9a2e839ebaba3d067 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.964151  8939 tablet_replica.cc:333] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.964923  8939 raft_consensus.cc:2243] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.966014  8939 raft_consensus.cc:2272] T 3dce7c45de7b465cae760e1493350a3d P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.968819  8939 tablet_replica.cc:333] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.969576  8939 raft_consensus.cc:2243] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.970709  8939 raft_consensus.cc:2272] T a8e6b8eb111f42d7845337f0ac05bbbe P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.974001  8939 tablet_replica.cc:333] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.974725  8939 raft_consensus.cc:2243] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.975327  8939 raft_consensus.cc:2272] T 4f759c276920467baa15209bb0a49a5e P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.978832  8939 tablet_replica.cc:333] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.979595  8939 raft_consensus.cc:2243] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.980728  8939 raft_consensus.cc:2272] T 013bdb5de0714691961973642b4b9985 P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.983671  8939 tablet_replica.cc:333] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.984479  8939 raft_consensus.cc:2243] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.985105  8939 raft_consensus.cc:2272] T ef537db43f0d41e2837791d64bd94f7a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.988094  8939 tablet_replica.cc:333] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.988760  8939 raft_consensus.cc:2243] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.989406  8939 raft_consensus.cc:2272] T bbab503d13b34aa887b5003be876e11a P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:43.992826  8939 tablet_replica.cc:333] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44: stopping tablet replica
I20260709 13:20:43.993459  8939 raft_consensus.cc:2243] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.993989  8939 raft_consensus.cc:2272] T 3a9755bf638a41beaf150bdd704137aa P 5f2a0ad7034e4d3a820fe81d09c58b44 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:44.015726 20436 consensus_peers.cc:597] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Couldn't send request to peer 5f2a0ad7034e4d3a820fe81d09c58b44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:44.038779 20436 consensus_peers.cc:597] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 90b4ce8af2fc4630929b3af07191b675 (127.8.186.193:37051): Couldn't send request to peer 90b4ce8af2fc4630929b3af07191b675. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.040027  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
W20260709 13:20:44.066987 20436 consensus_peers.cc:597] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Couldn't send request to peer 5f2a0ad7034e4d3a820fe81d09c58b44. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:42227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.089697  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
W20260709 13:20:44.100111 20436 consensus_peers.cc:597] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Couldn't send request to peer 5f2a0ad7034e4d3a820fe81d09c58b44. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:42227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:44.113996 20436 consensus_peers.cc:597] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 -> Peer 5f2a0ad7034e4d3a820fe81d09c58b44 (127.8.186.194:42227): Couldn't send request to peer 5f2a0ad7034e4d3a820fe81d09c58b44. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:42227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.135854  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:44.136931  8939 tablet_replica.cc:333] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.137938  8939 raft_consensus.cc:2243] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.138574  8939 raft_consensus.cc:2272] T 41e4a2a9cfad4ff49014c374fb2ba792 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.141693  8939 tablet_replica.cc:333] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.142587  8939 raft_consensus.cc:2243] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.143191  8939 raft_consensus.cc:2272] T 00a7cacb71ff4c6c94aa737b08fc4d7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.146413  8939 tablet_replica.cc:333] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.147347  8939 raft_consensus.cc:2243] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.148522  8939 raft_consensus.cc:2272] T 9b527c4d305f4e70b0036cd36edfea77 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.151605  8939 tablet_replica.cc:333] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.152400  8939 raft_consensus.cc:2243] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.153023  8939 raft_consensus.cc:2272] T 013bdb5de0714691961973642b4b9985 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.155932  8939 tablet_replica.cc:333] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.156780  8939 raft_consensus.cc:2243] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.157431  8939 raft_consensus.cc:2272] T ef537db43f0d41e2837791d64bd94f7a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.160514  8939 tablet_replica.cc:333] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.161387  8939 raft_consensus.cc:2243] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.161985  8939 raft_consensus.cc:2272] T bbab503d13b34aa887b5003be876e11a P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.165263  8939 tablet_replica.cc:333] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.166109  8939 raft_consensus.cc:2243] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.166690  8939 raft_consensus.cc:2272] T 0105ac9286ab4be9a2e839ebaba3d067 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.169642  8939 tablet_replica.cc:333] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.170480  8939 raft_consensus.cc:2243] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.171591  8939 raft_consensus.cc:2272] T 4f759c276920467baa15209bb0a49a5e P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.175040  8939 tablet_replica.cc:333] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.175700  8939 raft_consensus.cc:2243] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.176362  8939 raft_consensus.cc:2272] T 733500534d214a1082a887479eaac70d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.178731  8939 tablet_replica.cc:333] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.179366  8939 raft_consensus.cc:2243] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.180225  8939 raft_consensus.cc:2272] T 6016352b674649c09f0e8445b01cf523 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.182554  8939 tablet_replica.cc:333] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.183228  8939 raft_consensus.cc:2243] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.184144  8939 raft_consensus.cc:2272] T 97c64541b2794e6d93c42dcb630fb128 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.186488  8939 tablet_replica.cc:333] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.187114  8939 raft_consensus.cc:2243] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.187624  8939 raft_consensus.cc:2272] T b0f47f69aea4436d82a2f64ebb61d3d0 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.189893  8939 tablet_replica.cc:333] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.190486  8939 raft_consensus.cc:2243] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.190960  8939 raft_consensus.cc:2272] T 17c1b41d09f747ce91a4de4bccb01027 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.193183  8939 tablet_replica.cc:333] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.193722  8939 raft_consensus.cc:2243] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.194522  8939 raft_consensus.cc:2272] T 3a9755bf638a41beaf150bdd704137aa P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.196705  8939 tablet_replica.cc:333] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.197258  8939 raft_consensus.cc:2243] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.197697  8939 raft_consensus.cc:2272] T 3dce7c45de7b465cae760e1493350a3d P 78b17ab8bb41473db2de65bbfcf28ae4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.199798  8939 tablet_replica.cc:333] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.200302  8939 raft_consensus.cc:2243] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.200750  8939 raft_consensus.cc:2272] T a8e6b8eb111f42d7845337f0ac05bbbe P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.202872  8939 tablet_replica.cc:333] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.203446  8939 raft_consensus.cc:2243] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.204206  8939 raft_consensus.cc:2272] T ba43f7aaaf074198b22c890ea79e1e79 P 78b17ab8bb41473db2de65bbfcf28ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.206077  8939 tablet_replica.cc:333] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4: stopping tablet replica
I20260709 13:20:44.206554  8939 raft_consensus.cc:2243] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.207026  8939 raft_consensus.cc:2272] T c55ab9435e8b476ca4bdd6f956f9d00f P 78b17ab8bb41473db2de65bbfcf28ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.248860  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:20:44.288058  8939 master.cc:562] Master@127.8.186.254:41483 shutting down...
I20260709 13:20:44.308660  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.309211  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.309509  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3c44e127cdd4f65ac1acd3b9fbf34e1: stopping tablet replica
I20260709 13:20:44.346997  8939 master.cc:584] Master@127.8.186.254:41483 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13483 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:20:44.405550  8939 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.186.254:43561
I20260709 13:20:44.406723  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:44.413924 20795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:44.414057 20792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:44.414255  8939 server_base.cc:1061] running on GCE node
W20260709 13:20:44.414121 20793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:44.415949  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:44.416157  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:44.416294  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603244416278 us; error 0 us; skew 500 ppm
I20260709 13:20:44.416795  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:44.419730  8939 webserver.cc:533] Webserver started at http://127.8.186.254:43169/ using document root <none> and password file <none>
I20260709 13:20:44.420253  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:44.420439  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:44.420696  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:44.421947  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/master-0-root/instance:
uuid: "4c63444d186f40efbfba15507c9daba9"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.426723  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:20:44.430613 20800 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.431819  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:44.432124  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/master-0-root
uuid: "4c63444d186f40efbfba15507c9daba9"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.432408  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:44.449203  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:44.450730  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:44.494812  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.254:43561
I20260709 13:20:44.494956 20851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.254:43561 every 8 connection(s)
I20260709 13:20:44.498960 20852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:44.512356 20852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9: Bootstrap starting.
I20260709 13:20:44.518221 20852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:44.523056 20852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9: No bootstrap required, opened a new log
I20260709 13:20:44.525772 20852 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63444d186f40efbfba15507c9daba9" member_type: VOTER }
I20260709 13:20:44.526187 20852 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:44.526432 20852 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c63444d186f40efbfba15507c9daba9, State: Initialized, Role: FOLLOWER
I20260709 13:20:44.527092 20852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63444d186f40efbfba15507c9daba9" member_type: VOTER }
I20260709 13:20:44.527552 20852 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:44.527817 20852 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:44.528065 20852 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:44.533608 20852 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63444d186f40efbfba15507c9daba9" member_type: VOTER }
I20260709 13:20:44.534291 20852 leader_election.cc:304] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c63444d186f40efbfba15507c9daba9; no voters: 
I20260709 13:20:44.535704 20852 leader_election.cc:290] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:44.536154 20855 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:44.537508 20855 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 1 LEADER]: Becoming Leader. State: Replica: 4c63444d186f40efbfba15507c9daba9, State: Running, Role: LEADER
I20260709 13:20:44.538236 20855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63444d186f40efbfba15507c9daba9" member_type: VOTER }
I20260709 13:20:44.538906 20852 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:44.542518 20857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c63444d186f40efbfba15507c9daba9. Latest consensus state: current_term: 1 leader_uuid: "4c63444d186f40efbfba15507c9daba9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63444d186f40efbfba15507c9daba9" member_type: VOTER } }
I20260709 13:20:44.542526 20856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c63444d186f40efbfba15507c9daba9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63444d186f40efbfba15507c9daba9" member_type: VOTER } }
I20260709 13:20:44.543516 20857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:44.543605 20856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:44.548800 20862 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:44.554136 20862 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:44.555963  8939 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:44.563580 20862 catalog_manager.cc:1383] Generated new cluster ID: b8edcd9f795e4790a69fe4a6f017c612
I20260709 13:20:44.563957 20862 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:44.578105 20862 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:44.579546 20862 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:44.593550 20862 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9: Generated new TSK 0
I20260709 13:20:44.594216 20862 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:44.622802  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:44.629977 20873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:44.630270 20874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:44.632709 20876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:44.634615  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:44.635769  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:44.635985  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:44.636155  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603244636138 us; error 0 us; skew 500 ppm
I20260709 13:20:44.636669  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:44.639776  8939 webserver.cc:533] Webserver started at http://127.8.186.193:37329/ using document root <none> and password file <none>
I20260709 13:20:44.640380  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:44.640638  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:44.641069  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:44.642364  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-0-root/instance:
uuid: "0ad47b763e394f0a98cea588f7707026"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.647281  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:20:44.651293 20881 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.652249  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:44.652575  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-0-root
uuid: "0ad47b763e394f0a98cea588f7707026"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.652854  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:44.676242  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:44.677446  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:44.679020  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:44.681430  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:44.681737  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.682000  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:44.682171  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.724190  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.193:37755
I20260709 13:20:44.724404 20943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.193:37755 every 8 connection(s)
I20260709 13:20:44.729537  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:44.737737 20948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:44.739778 20949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:44.742700 20951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:44.743487 20944 heartbeater.cc:344] Connected to a master server at 127.8.186.254:43561
I20260709 13:20:44.743918 20944 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:44.744213  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:44.744714 20944 heartbeater.cc:507] Master 127.8.186.254:43561 requested a full tablet report, sending...
I20260709 13:20:44.745309  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:44.745565  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:44.745785  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603244745765 us; error 0 us; skew 500 ppm
I20260709 13:20:44.746475  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:44.747046 20817 ts_manager.cc:194] Registered new tserver with Master: 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755)
I20260709 13:20:44.748960 20817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52942
I20260709 13:20:44.749578  8939 webserver.cc:533] Webserver started at http://127.8.186.194:44403/ using document root <none> and password file <none>
I20260709 13:20:44.750500  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:44.750749  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:44.751037  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:44.752334  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-1-root/instance:
uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.757680  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:44.761835 20956 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.762727  8939 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:44.763074  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-1-root
uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.763374  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:44.792347  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:44.793596  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:44.795140  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:44.797472  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:44.797679  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.797909  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:44.798056  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.844729  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.194:38671
I20260709 13:20:44.844926 21018 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.194:38671 every 8 connection(s)
I20260709 13:20:44.849624  8939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:44.857326 21022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:44.859094 21023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:44.866425 21019 heartbeater.cc:344] Connected to a master server at 127.8.186.254:43561
W20260709 13:20:44.866593 21025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:44.867210 21019 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:44.867321  8939 server_base.cc:1061] running on GCE node
I20260709 13:20:44.868386 21019 heartbeater.cc:507] Master 127.8.186.254:43561 requested a full tablet report, sending...
I20260709 13:20:44.868814  8939 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:44.869151  8939 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:44.869339  8939 hybrid_clock.cc:648] HybridClock initialized: now 1783603244869321 us; error 0 us; skew 500 ppm
I20260709 13:20:44.869976  8939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:44.870659 20817 ts_manager.cc:194] Registered new tserver with Master: b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:44.872416 20817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52958
I20260709 13:20:44.872579  8939 webserver.cc:533] Webserver started at http://127.8.186.195:41019/ using document root <none> and password file <none>
I20260709 13:20:44.873144  8939 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:44.873328  8939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:44.873621  8939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:44.875201  8939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-2-root/instance:
uuid: "3244c4c9fe1940aea6040c91014eee47"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.879995  8939 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:44.883317 21030 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.884310  8939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:44.884675  8939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-2-root
uuid: "3244c4c9fe1940aea6040c91014eee47"
format_stamp: "Formatted at 2026-07-09 13:20:44 on dist-test-slave-mq27"
I20260709 13:20:44.884955  8939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0gbjsW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602915752797-8939-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:44.903016  8939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:44.904309  8939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:44.905882  8939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:44.908227  8939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:44.908435  8939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.908675  8939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:44.908826  8939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:44.951128  8939 rpc_server.cc:307] RPC server started. Bound to: 127.8.186.195:40761
I20260709 13:20:44.951327 21092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.186.195:40761 every 8 connection(s)
I20260709 13:20:44.966421 21093 heartbeater.cc:344] Connected to a master server at 127.8.186.254:43561
I20260709 13:20:44.966857 21093 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:44.967612 21093 heartbeater.cc:507] Master 127.8.186.254:43561 requested a full tablet report, sending...
I20260709 13:20:44.969636 20817 ts_manager.cc:194] Registered new tserver with Master: 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:44.970167  8939 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014983499s
I20260709 13:20:44.971439 20817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52972
I20260709 13:20:44.996860 20817 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52982:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:44.999639 20817 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:45.074599 20984 tablet_service.cc:1511] Processing CreateTablet for tablet 84d600f22e244688a7ecac9f8a282c02 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:45.076927 20983 tablet_service.cc:1511] Processing CreateTablet for tablet 409514b8565f4119bbb6e6cac1eeffc1 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:45.079710 20984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d600f22e244688a7ecac9f8a282c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.080119 20980 tablet_service.cc:1511] Processing CreateTablet for tablet 5139d76184f6413c896c55301b10c3cc (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:45.080993 20979 tablet_service.cc:1511] Processing CreateTablet for tablet c190bff4977543b0b13e5c38f62c584d (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:45.079283 20982 tablet_service.cc:1511] Processing CreateTablet for tablet 609685fee0234619a86813214e1f5ecd (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:45.082949 20981 tablet_service.cc:1511] Processing CreateTablet for tablet 720c8fac03ac4e3794755fa0b1777b6d (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:45.083668 20980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5139d76184f6413c896c55301b10c3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.084380 20981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720c8fac03ac4e3794755fa0b1777b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.085366 20978 tablet_service.cc:1511] Processing CreateTablet for tablet 7f559b953dbb4df19d2fd1226a692d9c (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:45.086761 20978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f559b953dbb4df19d2fd1226a692d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.090386 20977 tablet_service.cc:1511] Processing CreateTablet for tablet 0f28f0cbb29746aea6e1f4c2ec8b5733 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:45.091930 20977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f28f0cbb29746aea6e1f4c2ec8b5733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.096529 20979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c190bff4977543b0b13e5c38f62c584d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.098664 20982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609685fee0234619a86813214e1f5ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.103260 20983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409514b8565f4119bbb6e6cac1eeffc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.103374 21058 tablet_service.cc:1511] Processing CreateTablet for tablet 84d600f22e244688a7ecac9f8a282c02 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:45.103600 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb3b977b9274ea9826779b3519819f3 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:45.104979 21058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d600f22e244688a7ecac9f8a282c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.112185 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb3b977b9274ea9826779b3519819f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.113960 21057 tablet_service.cc:1511] Processing CreateTablet for tablet 409514b8565f4119bbb6e6cac1eeffc1 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:45.115726 21057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409514b8565f4119bbb6e6cac1eeffc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.120774 21056 tablet_service.cc:1511] Processing CreateTablet for tablet 609685fee0234619a86813214e1f5ecd (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:45.122828 21056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609685fee0234619a86813214e1f5ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.133445 21107 tablet_bootstrap.cc:492] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.136826 21055 tablet_service.cc:1511] Processing CreateTablet for tablet 720c8fac03ac4e3794755fa0b1777b6d (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:45.138470 21055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720c8fac03ac4e3794755fa0b1777b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.141119 21054 tablet_service.cc:1511] Processing CreateTablet for tablet 5139d76184f6413c896c55301b10c3cc (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:45.142788 21054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5139d76184f6413c896c55301b10c3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.145114 21053 tablet_service.cc:1511] Processing CreateTablet for tablet c190bff4977543b0b13e5c38f62c584d (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:45.147020 21053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c190bff4977543b0b13e5c38f62c584d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.149264 21052 tablet_service.cc:1511] Processing CreateTablet for tablet 7f559b953dbb4df19d2fd1226a692d9c (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:45.150920 21052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f559b953dbb4df19d2fd1226a692d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.156323 21051 tablet_service.cc:1511] Processing CreateTablet for tablet 0f28f0cbb29746aea6e1f4c2ec8b5733 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:45.157974 21051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f28f0cbb29746aea6e1f4c2ec8b5733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.154359 21050 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb3b977b9274ea9826779b3519819f3 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:45.164952 21050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb3b977b9274ea9826779b3519819f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.172674 20909 tablet_service.cc:1511] Processing CreateTablet for tablet 84d600f22e244688a7ecac9f8a282c02 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:45.174364 20909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d600f22e244688a7ecac9f8a282c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.174137 20905 tablet_service.cc:1511] Processing CreateTablet for tablet 5139d76184f6413c896c55301b10c3cc (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:45.176467 20908 tablet_service.cc:1511] Processing CreateTablet for tablet 409514b8565f4119bbb6e6cac1eeffc1 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:45.176802 20904 tablet_service.cc:1511] Processing CreateTablet for tablet c190bff4977543b0b13e5c38f62c584d (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:45.178609 20903 tablet_service.cc:1511] Processing CreateTablet for tablet 7f559b953dbb4df19d2fd1226a692d9c (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:45.180624 20902 tablet_service.cc:1511] Processing CreateTablet for tablet 0f28f0cbb29746aea6e1f4c2ec8b5733 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:45.180447 20906 tablet_service.cc:1511] Processing CreateTablet for tablet 720c8fac03ac4e3794755fa0b1777b6d (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:45.182695 20901 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb3b977b9274ea9826779b3519819f3 (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:45.178807 20907 tablet_service.cc:1511] Processing CreateTablet for tablet 609685fee0234619a86813214e1f5ecd (DEFAULT_TABLE table=test-workload [id=fd8299bd5fad4031b3ec657743430620]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:45.187412 21107 tablet_bootstrap.cc:654] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.175585 20905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5139d76184f6413c896c55301b10c3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.200184 20901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb3b977b9274ea9826779b3519819f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.204193 20906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720c8fac03ac4e3794755fa0b1777b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.212210 20903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f559b953dbb4df19d2fd1226a692d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.216207 20904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c190bff4977543b0b13e5c38f62c584d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.216938 20907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609685fee0234619a86813214e1f5ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.218889 20902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f28f0cbb29746aea6e1f4c2ec8b5733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.218971 21108 tablet_bootstrap.cc:492] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.222805 20908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409514b8565f4119bbb6e6cac1eeffc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:45.231248 21108 tablet_bootstrap.cc:654] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.281750 21107 tablet_bootstrap.cc:492] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.282321 21107 ts_tablet_manager.cc:1403] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.149s	user 0.009s	sys 0.020s
I20260709 13:20:45.285311 21107 raft_consensus.cc:359] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.286062 21107 raft_consensus.cc:385] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.286357 21107 raft_consensus.cc:740] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.290401 21110 tablet_bootstrap.cc:492] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.281756 21108 tablet_bootstrap.cc:492] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.293646 21108 ts_tablet_manager.cc:1403] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.012s
I20260709 13:20:45.296896 21107 consensus_queue.cc:260] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.297765 21110 tablet_bootstrap.cc:654] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.301837 21108 raft_consensus.cc:359] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.302773 21108 raft_consensus.cc:385] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.303153 21108 raft_consensus.cc:740] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.304100 21108 consensus_queue.cc:260] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.306576 21107 ts_tablet_manager.cc:1434] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 13:20:45.307094 21110 tablet_bootstrap.cc:492] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.307646 21110 ts_tablet_manager.cc:1403] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 13:20:45.307809 21107 tablet_bootstrap.cc:492] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.308063 21019 heartbeater.cc:499] Master 127.8.186.254:43561 was elected leader, sending a full tablet report...
I20260709 13:20:45.310632 21110 raft_consensus.cc:359] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.311491 21110 raft_consensus.cc:385] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.312459 21110 raft_consensus.cc:740] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.313493 21110 consensus_queue.cc:260] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.315228 21107 tablet_bootstrap.cc:654] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.317477 21108 ts_tablet_manager.cc:1434] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:20:45.317771 21093 heartbeater.cc:499] Master 127.8.186.254:43561 was elected leader, sending a full tablet report...
I20260709 13:20:45.318661 21108 tablet_bootstrap.cc:492] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.325321 21108 tablet_bootstrap.cc:654] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.329519 20944 heartbeater.cc:499] Master 127.8.186.254:43561 was elected leader, sending a full tablet report...
I20260709 13:20:45.330668 21110 ts_tablet_manager.cc:1434] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.005s
I20260709 13:20:45.332118 21110 tablet_bootstrap.cc:492] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.339581 21110 tablet_bootstrap.cc:654] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.342866 21107 tablet_bootstrap.cc:492] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.343590 21107 ts_tablet_manager.cc:1403] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.015s
I20260709 13:20:45.347004 21107 raft_consensus.cc:359] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.347926 21107 raft_consensus.cc:385] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.348256 21107 raft_consensus.cc:740] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.350244 21107 consensus_queue.cc:260] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.352517 21107 ts_tablet_manager.cc:1434] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:20:45.353036 21110 tablet_bootstrap.cc:492] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.353717 21107 tablet_bootstrap.cc:492] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.353770 21110 ts_tablet_manager.cc:1403] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 13:20:45.357324 21110 raft_consensus.cc:359] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.358073 21110 raft_consensus.cc:385] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.358371 21110 raft_consensus.cc:740] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.359251 21110 consensus_queue.cc:260] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.360996 21107 tablet_bootstrap.cc:654] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.361690 21110 ts_tablet_manager.cc:1434] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:45.362874 21110 tablet_bootstrap.cc:492] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.369674 21110 tablet_bootstrap.cc:654] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.375208 21107 tablet_bootstrap.cc:492] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.375845 21107 ts_tablet_manager.cc:1403] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.008s
I20260709 13:20:45.379460 21110 tablet_bootstrap.cc:492] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.379024 21107 raft_consensus.cc:359] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.380030 21107 raft_consensus.cc:385] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.380224 21110 ts_tablet_manager.cc:1403] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:20:45.380409 21107 raft_consensus.cc:740] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.381608 21107 consensus_queue.cc:260] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.383966 21107 ts_tablet_manager.cc:1434] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:45.384593 21110 raft_consensus.cc:359] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.385097 21107 tablet_bootstrap.cc:492] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.385486 21110 raft_consensus.cc:385] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.385823 21110 raft_consensus.cc:740] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.386693 21110 consensus_queue.cc:260] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.391105 21110 ts_tablet_manager.cc:1434] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:20:45.392277 21110 tablet_bootstrap.cc:492] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.392529 21107 tablet_bootstrap.cc:654] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.398980 21110 tablet_bootstrap.cc:654] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.411238 21110 tablet_bootstrap.cc:492] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.411891 21110 ts_tablet_manager.cc:1403] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:20:45.415087 21110 raft_consensus.cc:359] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.415856 21110 raft_consensus.cc:385] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.416091 21110 raft_consensus.cc:740] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.416755 21108 tablet_bootstrap.cc:492] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.416805 21110 consensus_queue.cc:260] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.417459 21107 tablet_bootstrap.cc:492] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.417451 21108 ts_tablet_manager.cc:1403] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.099s	user 0.054s	sys 0.043s
I20260709 13:20:45.418105 21107 ts_tablet_manager.cc:1403] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.018s
I20260709 13:20:45.419329 21110 ts_tablet_manager.cc:1434] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:45.420399 21110 tablet_bootstrap.cc:492] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.420802 21108 raft_consensus.cc:359] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.421144 21107 raft_consensus.cc:359] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.421597 21108 raft_consensus.cc:385] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.421940 21107 raft_consensus.cc:385] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.421989 21108 raft_consensus.cc:740] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.422353 21107 raft_consensus.cc:740] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.423148 21108 consensus_queue.cc:260] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.423326 21107 consensus_queue.cc:260] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.425778 21107 ts_tablet_manager.cc:1434] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:20:45.426818 21107 tablet_bootstrap.cc:492] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.430474 21108 ts_tablet_manager.cc:1434] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:45.431157 21110 tablet_bootstrap.cc:654] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.431631 21108 tablet_bootstrap.cc:492] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.433243 21107 tablet_bootstrap.cc:654] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.436339 21114 raft_consensus.cc:493] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.436983 21114 raft_consensus.cc:515] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.439016 21108 tablet_bootstrap.cc:654] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.440546 21114 leader_election.cc:290] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755)
I20260709 13:20:45.444085 21110 tablet_bootstrap.cc:492] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.444550 21110 ts_tablet_manager.cc:1403] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:20:45.449501 21107 tablet_bootstrap.cc:492] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.450126 21107 ts_tablet_manager.cc:1403] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.005s
I20260709 13:20:45.453224 21107 raft_consensus.cc:359] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.454201 21107 raft_consensus.cc:385] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.454654 21107 raft_consensus.cc:740] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.456804 21107 consensus_queue.cc:260] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.459872 21110 raft_consensus.cc:359] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.460656 21110 raft_consensus.cc:385] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.460944 21110 raft_consensus.cc:740] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.460805 21107 ts_tablet_manager.cc:1434] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:20:45.461663 21110 consensus_queue.cc:260] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.462989 21107 tablet_bootstrap.cc:492] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.463948 21110 ts_tablet_manager.cc:1434] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:20:45.465008 21110 tablet_bootstrap.cc:492] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.470517 21107 tablet_bootstrap.cc:654] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.472608 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.473358 20994 raft_consensus.cc:2468] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:45.474506 21034 leader_election.cc:304] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.475543 21110 tablet_bootstrap.cc:654] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.476009 21114 raft_consensus.cc:2804] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.475939 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.478142 21114 raft_consensus.cc:493] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.478524 21114 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.481186 21107 tablet_bootstrap.cc:492] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.477555 21108 tablet_bootstrap.cc:492] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.481664 21107 ts_tablet_manager.cc:1403] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:20:45.481787 21108 ts_tablet_manager.cc:1403] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.000s
W20260709 13:20:45.484226 21034 leader_election.cc:343] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.484097 21107 raft_consensus.cc:359] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.484828 21107 raft_consensus.cc:385] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.485296 21107 raft_consensus.cc:740] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.485909 21107 consensus_queue.cc:260] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.487059 21114 raft_consensus.cc:515] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.487967 21107 ts_tablet_manager.cc:1434] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:20:45.489161 21107 tablet_bootstrap.cc:492] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.489843 21128 raft_consensus.cc:493] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.490319 21128 raft_consensus.cc:515] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.490566 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
W20260709 13:20:45.492126 21034 leader_election.cc:343] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.489244 21114 leader_election.cc:290] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755)
I20260709 13:20:45.492445 21128 leader_election.cc:290] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.494051 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.494700 20994 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.493647 21112 raft_consensus.cc:493] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.495951 21107 tablet_bootstrap.cc:654] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.495441 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.496569 20919 raft_consensus.cc:2468] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:45.497074 21112 raft_consensus.cc:515] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.502465 21110 tablet_bootstrap.cc:492] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.503026 21110 ts_tablet_manager.cc:1403] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.006s
I20260709 13:20:45.502415 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.503772 21112 leader_election.cc:290] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.504611 21034 leader_election.cc:304] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:45.507615 21128 raft_consensus.cc:2804] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:45.507786 21034 leader_election.cc:343] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.504730 20994 raft_consensus.cc:2468] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:45.506054 21110 raft_consensus.cc:359] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.507941 21128 raft_consensus.cc:493] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.509892 21128 raft_consensus.cc:3060] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.510326 21034 leader_election.cc:304] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 0ad47b763e394f0a98cea588f7707026
I20260709 13:20:45.511237 21114 raft_consensus.cc:2804] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.484831 21108 raft_consensus.cc:359] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.515882 21108 raft_consensus.cc:385] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.516556 21110 raft_consensus.cc:385] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.517586 21110 raft_consensus.cc:740] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.516986 21114 raft_consensus.cc:697] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:45.518607 21114 consensus_queue.cc:237] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.518781 21128 raft_consensus.cc:515] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.520941 21128 leader_election.cc:290] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.516294 21108 raft_consensus.cc:740] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.522272 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:45.522812 21108 consensus_queue.cc:260] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.523272 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.524036 21110 consensus_queue.cc:260] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.524667 20919 raft_consensus.cc:3060] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.528851 21108 ts_tablet_manager.cc:1434] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:20:45.530117 21108 tablet_bootstrap.cc:492] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
W20260709 13:20:45.532009 21034 leader_election.cc:343] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.533272 20919 raft_consensus.cc:2468] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:45.533926 21110 ts_tablet_manager.cc:1434] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:20:45.534672 21034 leader_election.cc:304] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:45.535871 21128 raft_consensus.cc:2804] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.536341 21128 raft_consensus.cc:697] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:45.537130 21128 consensus_queue.cc:237] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.541930 21110 tablet_bootstrap.cc:492] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.548168 20816 catalog_manager.cc:5697] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:45.550750 20865 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:45.551295 21110 tablet_bootstrap.cc:654] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.558074 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb3b977b9274ea9826779b3519819f3" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
W20260709 13:20:45.559842 20960 leader_election.cc:343] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.563480 21110 tablet_bootstrap.cc:492] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.564136 21110 ts_tablet_manager.cc:1403] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:20:45.566865 21107 tablet_bootstrap.cc:492] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.567472 21107 ts_tablet_manager.cc:1403] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.036s
I20260709 13:20:45.567528 21110 raft_consensus.cc:359] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.568455 21110 raft_consensus.cc:385] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.568794 21110 raft_consensus.cc:740] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.569845 21110 consensus_queue.cc:260] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.570365 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb3b977b9274ea9826779b3519819f3" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.570823 21107 raft_consensus.cc:359] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.571683 21107 raft_consensus.cc:385] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.572018 21107 raft_consensus.cc:740] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
W20260709 13:20:45.572280 20960 leader_election.cc:343] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.572782 20960 leader_election.cc:304] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:45.572926 21107 consensus_queue.cc:260] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.563388 21108 tablet_bootstrap.cc:654] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.574118 21112 raft_consensus.cc:2749] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.576984 21110 ts_tablet_manager.cc:1434] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:20:45.578490 21110 tablet_bootstrap.cc:492] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.584244 21107 ts_tablet_manager.cc:1434] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 13:20:45.585400 21107 tablet_bootstrap.cc:492] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.585989 21108 tablet_bootstrap.cc:492] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.586642 21108 ts_tablet_manager.cc:1403] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.006s
I20260709 13:20:45.590009 21108 raft_consensus.cc:359] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.590763 21108 raft_consensus.cc:385] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.592280 21110 tablet_bootstrap.cc:654] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.591063 21108 raft_consensus.cc:740] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.593341 21108 consensus_queue.cc:260] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.593931 21107 tablet_bootstrap.cc:654] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.596042 21108 ts_tablet_manager.cc:1434] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:20:45.597510 21115 raft_consensus.cc:493] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.597640 21108 tablet_bootstrap.cc:492] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.598114 21115 raft_consensus.cc:515] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:45.605175 21108 tablet_bootstrap.cc:654] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.607005 21107 tablet_bootstrap.cc:492] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.607659 21107 ts_tablet_manager.cc:1403] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.006s
I20260709 13:20:45.610630 21107 raft_consensus.cc:359] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.611347 21107 raft_consensus.cc:385] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.611610 21107 raft_consensus.cc:740] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.606983 20816 catalog_manager.cc:5697] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.618608 21108 tablet_bootstrap.cc:492] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.614954 21110 tablet_bootstrap.cc:492] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.615509 21107 consensus_queue.cc:260] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.619204 21108 ts_tablet_manager.cc:1403] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:20:45.620546 21107 ts_tablet_manager.cc:1434] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:20:45.619270 21110 ts_tablet_manager.cc:1403] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.012s
I20260709 13:20:45.621527 21107 tablet_bootstrap.cc:492] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:45.622283 21108 raft_consensus.cc:359] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.623050 21108 raft_consensus.cc:385] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.623346 21108 raft_consensus.cc:740] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.616716 21115 leader_election.cc:290] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.624047 21110 raft_consensus.cc:359] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.624226 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.624949 21110 raft_consensus.cc:385] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.624228 21108 consensus_queue.cc:260] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.625265 20994 raft_consensus.cc:2393] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ad47b763e394f0a98cea588f7707026 in current term 1: Already voted for candidate 3244c4c9fe1940aea6040c91014eee47 in this term.
I20260709 13:20:45.625844 21110 raft_consensus.cc:740] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.626590 21110 consensus_queue.cc:260] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.627992 21107 tablet_bootstrap.cc:654] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.628717 21108 ts_tablet_manager.cc:1434] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:20:45.629886 21108 tablet_bootstrap.cc:492] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.636845 21108 tablet_bootstrap.cc:654] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.639603 21141 raft_consensus.cc:493] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.640201 21141 raft_consensus.cc:515] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.642472 21141 leader_election.cc:290] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.645179 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190bff4977543b0b13e5c38f62c584d" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.645926 20919 raft_consensus.cc:2468] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 0.
I20260709 13:20:45.646945 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190bff4977543b0b13e5c38f62c584d" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.648413 21128 raft_consensus.cc:493] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.648878 21128 raft_consensus.cc:515] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.651075 21128 leader_election.cc:290] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.652046 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb3b977b9274ea9826779b3519819f3" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.652510 20960 leader_election.cc:304] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.652731 20994 raft_consensus.cc:2468] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
W20260709 13:20:45.653455 20960 leader_election.cc:343] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.653873 21034 leader_election.cc:304] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.654527 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb3b977b9274ea9826779b3519819f3" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.654918 21128 raft_consensus.cc:2804] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.655519 21128 raft_consensus.cc:493] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.656131 21128 raft_consensus.cc:3060] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.655542 21141 raft_consensus.cc:2804] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.657480 21141 raft_consensus.cc:493] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.657820 21141 raft_consensus.cc:3060] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.655210 20919 raft_consensus.cc:2468] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:45.662534 21107 tablet_bootstrap.cc:492] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:45.663116 21107 ts_tablet_manager.cc:1403] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:20:45.664372 21110 ts_tablet_manager.cc:1434] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.018s
I20260709 13:20:45.664716 21147 raft_consensus.cc:493] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.665436 21114 raft_consensus.cc:493] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.665903 21114 raft_consensus.cc:515] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.667618 21107 raft_consensus.cc:359] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.668067 21114 leader_election.cc:290] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.668390 21107 raft_consensus.cc:385] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.665220 21147 raft_consensus.cc:515] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.669389 21107 raft_consensus.cc:740] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.669898 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.670199 21107 consensus_queue.cc:260] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.671890 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.672343 21107 ts_tablet_manager.cc:1434] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:20:45.672487 20994 raft_consensus.cc:2468] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:45.674291 20885 leader_election.cc:304] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.675140 21115 raft_consensus.cc:2804] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.675311 20885 leader_election.cc:304] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026; no voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:45.669021 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.675798 21115 raft_consensus.cc:493] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.676223 21115 raft_consensus.cc:3060] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.676334 20919 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:45.677707 21034 leader_election.cc:304] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:45.673825 21110 tablet_bootstrap.cc:492] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:45.675060 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.679188 20994 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:45.680094 21147 leader_election.cc:290] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.680625 21147 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.681110 21128 raft_consensus.cc:515] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.685173 21115 raft_consensus.cc:515] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.678560 21114 raft_consensus.cc:2804] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.686514 21141 raft_consensus.cc:515] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.687336 21114 raft_consensus.cc:493] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.687773 21114 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.689049 21108 tablet_bootstrap.cc:492] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.689572 21108 ts_tablet_manager.cc:1403] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.024s
I20260709 13:20:45.689484 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190bff4977543b0b13e5c38f62c584d" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:45.690129 20919 raft_consensus.cc:3060] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.692777 21108 raft_consensus.cc:359] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.693526 21108 raft_consensus.cc:385] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.693864 21108 raft_consensus.cc:740] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.694578 21108 consensus_queue.cc:260] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.696342 21147 raft_consensus.cc:2749] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.696910 21108 ts_tablet_manager.cc:1434] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:45.697057 21147 raft_consensus.cc:493] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.697557 21147 raft_consensus.cc:515] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.698021 21108 tablet_bootstrap.cc:492] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.698701 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190bff4977543b0b13e5c38f62c584d" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:45.699203 21128 leader_election.cc:290] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.686719 21110 tablet_bootstrap.cc:654] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.700954 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb3b977b9274ea9826779b3519819f3" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.701648 20994 raft_consensus.cc:3060] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.699442 21147 leader_election.cc:290] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.700012 21114 raft_consensus.cc:515] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.698822 21115 leader_election.cc:290] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.705243 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb3b977b9274ea9826779b3519819f3" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:45.704406 21108 tablet_bootstrap.cc:654] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:45.705082 20960 leader_election.cc:343] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.705621 21141 leader_election.cc:290] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
W20260709 13:20:45.727216 20885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:40761, user_credentials={real_user=slave}} blocked reactor thread for 51977.1us
I20260709 13:20:45.715551 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.767884 20993 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.713900 21114 leader_election.cc:290] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.768637 21141 raft_consensus.cc:493] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.768952 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.769771 21141 raft_consensus.cc:515] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
W20260709 13:20:45.770110 20960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.186.195:40761, user_credentials={real_user=slave}} blocked reactor thread for 65086us
I20260709 13:20:45.716648 20994 raft_consensus.cc:2468] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:45.771813 20992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.727381 21150 raft_consensus.cc:493] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.772539 20992 raft_consensus.cc:3060] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.772657 21034 leader_election.cc:304] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.772809 21150 raft_consensus.cc:515] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.773639 21114 raft_consensus.cc:2804] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.767123 20918 raft_consensus.cc:3060] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.775430 21114 raft_consensus.cc:697] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:45.776083 21108 tablet_bootstrap.cc:492] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.776731 21108 ts_tablet_manager.cc:1403] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.008s
I20260709 13:20:45.776330 21114 consensus_queue.cc:237] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.705219 20919 raft_consensus.cc:2468] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 1.
I20260709 13:20:45.779034 20960 leader_election.cc:304] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:45.780121 21112 raft_consensus.cc:2804] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.780539 20992 raft_consensus.cc:2468] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:45.717680 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:45.781708 20917 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.779326 21141 leader_election.cc:290] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.783849 21108 raft_consensus.cc:359] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.785058 20993 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:45.804402 21034 leader_election.cc:304] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.804579 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.806351 21110 tablet_bootstrap.cc:492] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:45.793509 20885 leader_election.cc:304] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.787444 21128 raft_consensus.cc:493] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.807925 21110 ts_tablet_manager.cc:1403] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.135s	user 0.029s	sys 0.025s
I20260709 13:20:45.786996 21108 raft_consensus.cc:385] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.808451 21108 raft_consensus.cc:740] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.808629 21147 raft_consensus.cc:2804] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.809296 21108 consensus_queue.cc:260] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.810060 21147 raft_consensus.cc:697] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:45.806074 21132 raft_consensus.cc:2804] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.810962 21132 raft_consensus.cc:697] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:45.810865 21110 raft_consensus.cc:359] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.811641 21110 raft_consensus.cc:385] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.811203 21147 consensus_queue.cc:237] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.811956 21110 raft_consensus.cc:740] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
W20260709 13:20:45.812609 20885 leader_election.cc:343] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.812670 21110 consensus_queue.cc:260] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.793100 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:45.814889 21110 ts_tablet_manager.cc:1434] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:45.812011 21108 ts_tablet_manager.cc:1434] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 13:20:45.814925 21132 consensus_queue.cc:237] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.816509 21108 tablet_bootstrap.cc:492] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.815770 20816 catalog_manager.cc:5697] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.812927 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.821821 21128 raft_consensus.cc:515] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.826943 20919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.827674 20919 raft_consensus.cc:2468] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
W20260709 13:20:45.830844 20885 leader_election.cc:343] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.831004 21034 leader_election.cc:304] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:45.832049 21114 raft_consensus.cc:2804] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.832454 21114 raft_consensus.cc:493] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.832793 21114 raft_consensus.cc:3060] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.833209 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720c8fac03ac4e3794755fa0b1777b6d" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.834020 21066 raft_consensus.cc:2468] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:45.800330 21150 leader_election.cc:290] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.836966 20885 leader_election.cc:304] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:45.837937 21150 raft_consensus.cc:2804] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:45.838346 21150 raft_consensus.cc:493] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.838670 21150 raft_consensus.cc:3060] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.841984 21114 raft_consensus.cc:515] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.794438 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.844468 21067 raft_consensus.cc:2393] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ad47b763e394f0a98cea588f7707026 in current term 1: Already voted for candidate 3244c4c9fe1940aea6040c91014eee47 in this term.
I20260709 13:20:45.845264 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720c8fac03ac4e3794755fa0b1777b6d" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.846052 20994 raft_consensus.cc:2468] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:45.793413 20992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.848133 20992 raft_consensus.cc:2468] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:45.849781 20885 leader_election.cc:304] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:45.850848 21115 raft_consensus.cc:2804] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:45.812947 20960 leader_election.cc:343] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.851217 21115 raft_consensus.cc:493] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.851802 21115 raft_consensus.cc:3060] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.851861 21141 raft_consensus.cc:493] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.852434 21141 raft_consensus.cc:515] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.855376 20917 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:45.858466 21141 leader_election.cc:290] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.859539 21128 leader_election.cc:290] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.851174 20918 raft_consensus.cc:2468] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:45.859724 21115 raft_consensus.cc:515] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.858247 21150 raft_consensus.cc:515] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.861871 21114 leader_election.cc:290] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.858556 21108 tablet_bootstrap.cc:654] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.862099 21115 leader_election.cc:290] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:45.863059 21150 leader_election.cc:290] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
W20260709 13:20:45.852173 20960 leader_election.cc:343] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:45.864126 20960 leader_election.cc:304] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:45.864893 21141 raft_consensus.cc:2749] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.866163 20991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720c8fac03ac4e3794755fa0b1777b6d" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.866887 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720c8fac03ac4e3794755fa0b1777b6d" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:45.867491 21066 raft_consensus.cc:3060] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.864784 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.869809 20993 raft_consensus.cc:3060] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.866853 20991 raft_consensus.cc:3060] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.873910 21068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:45.878340 20816 catalog_manager.cc:5697] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.890565 20991 raft_consensus.cc:2468] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:45.880196 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.891650 20917 raft_consensus.cc:2393] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b49eb8f55a2e45f09781dcc72fc3fe0f in current term 1: Already voted for candidate 3244c4c9fe1940aea6040c91014eee47 in this term.
I20260709 13:20:45.888368 21112 raft_consensus.cc:697] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:45.891935 20885 leader_election.cc:304] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:45.892657 21112 consensus_queue.cc:237] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.893056 21147 raft_consensus.cc:2804] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.893150 20960 leader_election.cc:304] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:45.893836 21147 raft_consensus.cc:697] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:45.894716 21147 consensus_queue.cc:237] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.883996 20992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.894610 20814 catalog_manager.cc:5697] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.884898 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:45.897958 21067 raft_consensus.cc:2393] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ad47b763e394f0a98cea588f7707026 in current term 1: Already voted for candidate 3244c4c9fe1940aea6040c91014eee47 in this term.
I20260709 13:20:45.899755 21066 raft_consensus.cc:2468] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:45.885771 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:45.895568 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409514b8565f4119bbb6e6cac1eeffc1" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:45.902309 20918 raft_consensus.cc:2393] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3244c4c9fe1940aea6040c91014eee47 in current term 1: Already voted for candidate 0ad47b763e394f0a98cea588f7707026 in this term.
I20260709 13:20:45.903285 21153 raft_consensus.cc:3060] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.903545 21034 leader_election.cc:304] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47; no voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:45.904520 21132 raft_consensus.cc:2749] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.907766 21108 tablet_bootstrap.cc:492] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.904606 20993 raft_consensus.cc:2468] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:45.908288 21108 ts_tablet_manager.cc:1403] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.005s
I20260709 13:20:45.911096 21108 raft_consensus.cc:359] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.911792 21108 raft_consensus.cc:385] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.912075 21108 raft_consensus.cc:740] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.912467 20885 leader_election.cc:304] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:45.912783 21108 consensus_queue.cc:260] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.913621 21147 raft_consensus.cc:2804] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:45.914551 21147 raft_consensus.cc:697] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:45.914832 21108 ts_tablet_manager.cc:1434] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:45.915557 21147 consensus_queue.cc:237] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.916685 21108 tablet_bootstrap.cc:492] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:45.923115 21153 raft_consensus.cc:2749] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:45.923352 21108 tablet_bootstrap.cc:654] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:45.925987 20815 catalog_manager.cc:5697] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.925845 20817 catalog_manager.cc:5697] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 0 to 1, leader changed from <none> to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 1 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.932183 21132 consensus_queue.cc:1048] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:45.937827 21108 tablet_bootstrap.cc:492] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:45.938409 21108 ts_tablet_manager.cc:1403] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.011s
I20260709 13:20:45.941219 21108 raft_consensus.cc:359] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.941885 21108 raft_consensus.cc:385] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:45.942147 21108 raft_consensus.cc:740] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:45.942812 21108 consensus_queue.cc:260] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.945200 21108 ts_tablet_manager.cc:1434] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:45.949681 21128 consensus_queue.cc:1048] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:45.955848 20817 catalog_manager.cc:5697] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.960692 21114 raft_consensus.cc:493] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.961371 21114 raft_consensus.cc:515] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:45.963400 21114 leader_election.cc:290] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:45.964598 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190bff4977543b0b13e5c38f62c584d" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:45.965523 20918 raft_consensus.cc:2393] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3244c4c9fe1940aea6040c91014eee47 in current term 1: Already voted for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in this term.
I20260709 13:20:45.967376 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c190bff4977543b0b13e5c38f62c584d" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:45.968959 21034 leader_election.cc:304] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47; no voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:45.970012 21114 raft_consensus.cc:3060] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:45.977103 21114 raft_consensus.cc:2749] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:46.059901 21114 consensus_queue.cc:1048] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.070552 21132 consensus_queue.cc:1048] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.162745 21132 consensus_queue.cc:1048] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.167016 21132 consensus_queue.cc:1048] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.230458 21066 raft_consensus.cc:3060] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.236950 21147 consensus_queue.cc:1048] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.248373 21173 consensus_queue.cc:1048] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.266693 21114 consensus_queue.cc:1048] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.279986 21128 consensus_queue.cc:1048] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.309727 21173 raft_consensus.cc:493] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.310284 21173 raft_consensus.cc:515] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.312083 21173 leader_election.cc:290] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.312813 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:46.313164 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:46.313361 20994 raft_consensus.cc:2468] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:46.313803 21066 raft_consensus.cc:2468] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:46.314338 20885 leader_election.cc:304] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:46.314996 21173 raft_consensus.cc:2804] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:46.315342 21173 raft_consensus.cc:493] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.315629 21173 raft_consensus.cc:3060] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.320974 21173 raft_consensus.cc:515] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.322844 21173 leader_election.cc:290] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.323575 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:46.323787 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:46.324174 20994 raft_consensus.cc:3060] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.324350 21066 raft_consensus.cc:3060] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:46.329459 21066 raft_consensus.cc:2468] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:46.329479 20994 raft_consensus.cc:2468] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:46.330474 20885 leader_election.cc:304] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:46.331142 21173 raft_consensus.cc:2804] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:46.331636 21173 raft_consensus.cc:697] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:46.332372 21173 consensus_queue.cc:237] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.340090 20816 catalog_manager.cc:5697] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.345479 21153 consensus_queue.cc:1048] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.356287 21112 consensus_queue.cc:1048] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.368145 21173 consensus_queue.cc:1048] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.381237 21150 consensus_queue.cc:1048] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.402640 21150 consensus_queue.cc:1048] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.413144 21147 consensus_queue.cc:1048] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.543890 21066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
mode: GRACEFUL
new_leader_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:20:46.544488 21066 raft_consensus.cc:606] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Received request to transfer leadership to TS 0ad47b763e394f0a98cea588f7707026
I20260709 13:20:46.552531 21066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "609685fee0234619a86813214e1f5ecd"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
mode: GRACEFUL
new_leader_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:20:46.553046 21066 raft_consensus.cc:606] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Received request to transfer leadership to TS 0ad47b763e394f0a98cea588f7707026
I20260709 13:20:46.569588 20918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:50802
I20260709 13:20:46.570094 20918 raft_consensus.cc:606] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:46.577353 21066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:20:46.577957 21066 raft_consensus.cc:606] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:46.582718 20918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:50802
I20260709 13:20:46.583197 20918 raft_consensus.cc:606] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:46.686159 21114 raft_consensus.cc:993] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:46.686594 21132 raft_consensus.cc:1081] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:46.688082 20994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40182
I20260709 13:20:46.688674 20994 raft_consensus.cc:493] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.688982 20994 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.694689 20994 raft_consensus.cc:515] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.696374 20994 leader_election.cc:290] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.697336 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:46.697626 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:46.697937 20918 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.698210 21066 raft_consensus.cc:3055] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:46.698489 21066 raft_consensus.cc:740] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:46.699150 21066 consensus_queue.cc:260] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.700301 21066 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.704043 20918 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:46.705312 20960 leader_election.cc:304] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:46.705982 21141 raft_consensus.cc:2804] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:46.706372 21141 raft_consensus.cc:697] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:46.706871 21066 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:46.707096 21141 consensus_queue.cc:237] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.713492 20816 catalog_manager.cc:5697] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.760100 21150 raft_consensus.cc:993] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:46.760643 21147 raft_consensus.cc:1081] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:46.762068 20994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40192
I20260709 13:20:46.762555 20994 raft_consensus.cc:493] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.762907 20994 raft_consensus.cc:3060] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.769196 20994 raft_consensus.cc:515] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.771581 20994 leader_election.cc:290] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.772338 21147 consensus_queue.cc:1048] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:46.772859 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:46.772986 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5139d76184f6413c896c55301b10c3cc" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:46.773749 21066 raft_consensus.cc:3060] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.773859 20918 raft_consensus.cc:3055] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:46.809913 20918 raft_consensus.cc:740] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:46.812645 20918 consensus_queue.cc:260] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.816413 20918 raft_consensus.cc:3060] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.830363 21066 raft_consensus.cc:2468] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:46.834164 20960 leader_election.cc:304] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:46.836090 21141 raft_consensus.cc:2804] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:46.836683 21141 raft_consensus.cc:697] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:46.837282 21147 consensus_queue.cc:1048] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:46.838217 20918 raft_consensus.cc:2468] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:46.838407 21141 consensus_queue.cc:237] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.853765 20817 catalog_manager.cc:5697] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 0ad47b763e394f0a98cea588f7707026 (127.8.186.193) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.855306 21150 raft_consensus.cc:993] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:46.856007 21173 raft_consensus.cc:1081] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:46.858345 20993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40192
I20260709 13:20:46.859246 20993 raft_consensus.cc:493] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.859724 20993 raft_consensus.cc:3060] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.873430 20993 raft_consensus.cc:515] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.876065 20993 leader_election.cc:290] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.877105 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:46.877882 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f28f0cbb29746aea6e1f4c2ec8b5733" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:46.877909 20918 raft_consensus.cc:3055] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:46.878489 21066 raft_consensus.cc:3060] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.878520 20918 raft_consensus.cc:740] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:46.879654 20918 consensus_queue.cc:260] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.880772 20918 raft_consensus.cc:3060] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.885123 21066 raft_consensus.cc:2468] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:46.886425 20960 leader_election.cc:304] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:46.886601 20918 raft_consensus.cc:2468] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:46.887126 21141 raft_consensus.cc:2804] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:46.887584 21141 raft_consensus.cc:697] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:46.888479 21141 consensus_queue.cc:237] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.894604 20817 catalog_manager.cc:5697] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 0ad47b763e394f0a98cea588f7707026 (127.8.186.193) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.940698 21114 raft_consensus.cc:993] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: : Instructing follower 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:46.941339 21132 raft_consensus.cc:1081] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Signalling peer 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:46.942924 20918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:50782
I20260709 13:20:46.943396 20918 raft_consensus.cc:493] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.943684 20918 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.949316 20918 raft_consensus.cc:515] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:46.951118 20918 leader_election.cc:290] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.952080 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:46.952343 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:46.952924 20993 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.953040 21066 raft_consensus.cc:3055] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:46.953459 21066 raft_consensus.cc:740] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:46.954398 21066 consensus_queue.cc:260] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:46.955549 21066 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.959833 20993 raft_consensus.cc:2468] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:46.961696 20885 leader_election.cc:304] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:46.962697 21173 raft_consensus.cc:2804] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:46.963346 21173 raft_consensus.cc:697] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:46.964560 21173 consensus_queue.cc:237] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:46.962610 21066 raft_consensus.cc:2468] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:46.973594 20817 catalog_manager.cc:5697] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 1 to 2, leader changed from 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195) to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.980155 21114 raft_consensus.cc:993] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: : Instructing follower 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:46.980892 21132 raft_consensus.cc:1081] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Signalling peer 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:46.983173 20918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "609685fee0234619a86813214e1f5ecd"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:50782
I20260709 13:20:46.983840 20918 raft_consensus.cc:493] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.984237 20918 raft_consensus.cc:3060] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.991106 20918 raft_consensus.cc:515] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.992923 20918 leader_election.cc:290] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:46.993645 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:46.993978 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609685fee0234619a86813214e1f5ecd" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:46.994460 20993 raft_consensus.cc:3060] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.994601 21066 raft_consensus.cc:3055] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:46.995062 21066 raft_consensus.cc:740] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:46.996217 21066 consensus_queue.cc:260] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:46.998386 21066 raft_consensus.cc:3060] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.003541 20993 raft_consensus.cc:2468] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:47.005216 20885 leader_election.cc:304] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:47.006443 21173 raft_consensus.cc:2804] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:47.006767 21066 raft_consensus.cc:2468] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:47.007195 21173 raft_consensus.cc:697] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:47.008853 21173 consensus_queue.cc:237] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:47.015784 20817 catalog_manager.cc:5697] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 1 to 2, leader changed from 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195) to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.126724 21066 raft_consensus.cc:1275] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.128091 21190 consensus_queue.cc:1048] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.137486 20918 raft_consensus.cc:1275] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.139207 21191 consensus_queue.cc:1048] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:47.295717 21066 raft_consensus.cc:1275] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.296888 21191 consensus_queue.cc:1048] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.299089 21066 raft_consensus.cc:1275] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.300663 21191 consensus_queue.cc:1048] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.309176 20918 raft_consensus.cc:1275] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.310652 21190 consensus_queue.cc:1048] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.313083 20918 raft_consensus.cc:1275] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.320168 21191 consensus_queue.cc:1048] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.346102 20993 raft_consensus.cc:1275] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.347394 21173 consensus_queue.cc:1048] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.357894 21066 raft_consensus.cc:1275] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.359359 21173 consensus_queue.cc:1048] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.565482 20993 raft_consensus.cc:1275] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.566852 21173 consensus_queue.cc:1048] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.578186 21066 raft_consensus.cc:1275] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:47.579828 21150 consensus_queue.cc:1048] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:49.621032 20815 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52990:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:49.623988 20815 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:49.676244 20902 tablet_service.cc:1511] Processing CreateTablet for tablet 0f095dfe58404dba9c85a71b7e4fa35f (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:49.677193 20981 tablet_service.cc:1511] Processing CreateTablet for tablet 0f095dfe58404dba9c85a71b7e4fa35f (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:49.678028 20902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f095dfe58404dba9c85a71b7e4fa35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.678821 20981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f095dfe58404dba9c85a71b7e4fa35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.681326 21051 tablet_service.cc:1511] Processing CreateTablet for tablet 0f095dfe58404dba9c85a71b7e4fa35f (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:49.681447 20908 tablet_service.cc:1511] Processing CreateTablet for tablet 51206d639cbb4b56ad5463ca82cda963 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:49.682935 20983 tablet_service.cc:1511] Processing CreateTablet for tablet 51206d639cbb4b56ad5463ca82cda963 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:49.684705 20983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51206d639cbb4b56ad5463ca82cda963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.684897 21054 tablet_service.cc:1511] Processing CreateTablet for tablet 51206d639cbb4b56ad5463ca82cda963 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:49.683014 21051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f095dfe58404dba9c85a71b7e4fa35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.687374 20901 tablet_service.cc:1511] Processing CreateTablet for tablet 8cac2b0f7c4f46a081342bbd5de91bbf (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:49.683036 20908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51206d639cbb4b56ad5463ca82cda963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.690593 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 8cac2b0f7c4f46a081342bbd5de91bbf (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:49.688016 21054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51206d639cbb4b56ad5463ca82cda963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.691856 20901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cac2b0f7c4f46a081342bbd5de91bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.692246 21053 tablet_service.cc:1511] Processing CreateTablet for tablet 8cac2b0f7c4f46a081342bbd5de91bbf (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:49.693645 21053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cac2b0f7c4f46a081342bbd5de91bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.697837 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cac2b0f7c4f46a081342bbd5de91bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.716954 20909 tablet_service.cc:1511] Processing CreateTablet for tablet 08e94dafee8044d49f5ca736133e3634 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:49.718531 20909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e94dafee8044d49f5ca736133e3634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.727754 21210 tablet_bootstrap.cc:492] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:49.729176 21209 tablet_bootstrap.cc:492] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:49.738358 21055 tablet_service.cc:1511] Processing CreateTablet for tablet 08e94dafee8044d49f5ca736133e3634 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:49.737898 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 08e94dafee8044d49f5ca736133e3634 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:49.739787 21055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e94dafee8044d49f5ca736133e3634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.740377 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e94dafee8044d49f5ca736133e3634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.749969 21210 tablet_bootstrap.cc:654] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.755422 21209 tablet_bootstrap.cc:654] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.767216 20909 tablet_service.cc:1511] Processing CreateTablet for tablet b70ec366fff149ddb7c5bb941de00b7e (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:49.768663 20909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70ec366fff149ddb7c5bb941de00b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.771116 21058 tablet_service.cc:1511] Processing CreateTablet for tablet b70ec366fff149ddb7c5bb941de00b7e (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:49.772573 21058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70ec366fff149ddb7c5bb941de00b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.780206 21209 tablet_bootstrap.cc:492] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:49.781008 21209 ts_tablet_manager.cc:1403] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.012s
I20260709 13:20:49.788940 21212 tablet_bootstrap.cc:492] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:49.784730 21209 raft_consensus.cc:359] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.780866 20983 tablet_service.cc:1511] Processing CreateTablet for tablet b70ec366fff149ddb7c5bb941de00b7e (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:49.798785 21209 raft_consensus.cc:385] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.791004 21210 tablet_bootstrap.cc:492] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:49.799176 21209 raft_consensus.cc:740] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.799506 20983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70ec366fff149ddb7c5bb941de00b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.800288 21054 tablet_service.cc:1511] Processing CreateTablet for tablet 27e50a46a17144cb92374a67aaaafe87 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:49.800959 21209 consensus_queue.cc:260] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.799671 21210 ts_tablet_manager.cc:1403] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.005s
I20260709 13:20:49.804206 21209 ts_tablet_manager.cc:1434] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 13:20:49.805347 21209 tablet_bootstrap.cc:492] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:49.805308 21210 raft_consensus.cc:359] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.806299 21210 raft_consensus.cc:385] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.806677 21210 raft_consensus.cc:740] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.807714 21210 consensus_queue.cc:260] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.812932 21209 tablet_bootstrap.cc:654] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.818298 20901 tablet_service.cc:1511] Processing CreateTablet for tablet 27e50a46a17144cb92374a67aaaafe87 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:49.819851 20909 tablet_service.cc:1511] Processing CreateTablet for tablet f5b281eaf1bb4a58b9e92122d3b7ea66 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:49.822448 20981 tablet_service.cc:1511] Processing CreateTablet for tablet f5b281eaf1bb4a58b9e92122d3b7ea66 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:49.822685 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 27e50a46a17144cb92374a67aaaafe87 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:49.801738 21054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e50a46a17144cb92374a67aaaafe87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.824065 20981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b281eaf1bb4a58b9e92122d3b7ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.830621 21212 tablet_bootstrap.cc:654] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.819818 20901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e50a46a17144cb92374a67aaaafe87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.832667 20909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b281eaf1bb4a58b9e92122d3b7ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.835917 21210 ts_tablet_manager.cc:1434] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.006s
I20260709 13:20:49.830753 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e50a46a17144cb92374a67aaaafe87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.838613 21051 tablet_service.cc:1511] Processing CreateTablet for tablet f5b281eaf1bb4a58b9e92122d3b7ea66 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:49.840075 21051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b281eaf1bb4a58b9e92122d3b7ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.846768 21209 tablet_bootstrap.cc:492] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:49.847436 21209 ts_tablet_manager.cc:1403] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.010s
I20260709 13:20:49.849167 21212 tablet_bootstrap.cc:492] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:49.856463 21212 ts_tablet_manager.cc:1403] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.008s
I20260709 13:20:49.851717 21210 tablet_bootstrap.cc:492] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:49.858006 20982 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa9022af8e34f25ab97c145bc6274a9 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:49.854239 20908 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa9022af8e34f25ab97c145bc6274a9 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:49.859529 20982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa9022af8e34f25ab97c145bc6274a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.860044 20908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa9022af8e34f25ab97c145bc6274a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.859789 21212 raft_consensus.cc:359] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.860606 21212 raft_consensus.cc:385] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.860903 21212 raft_consensus.cc:740] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.861685 21212 consensus_queue.cc:260] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.850903 21209 raft_consensus.cc:359] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.866047 21209 raft_consensus.cc:385] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.866354 21209 raft_consensus.cc:740] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.867007 21212 ts_tablet_manager.cc:1434] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:20:49.868252 21212 tablet_bootstrap.cc:492] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:49.874954 21212 tablet_bootstrap.cc:654] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.867183 21209 consensus_queue.cc:260] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.884347 21212 tablet_bootstrap.cc:492] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:49.884914 21212 ts_tablet_manager.cc:1403] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 13:20:49.888010 21212 raft_consensus.cc:359] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.888706 21212 raft_consensus.cc:385] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.889017 21212 raft_consensus.cc:740] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.892019 21209 ts_tablet_manager.cc:1434] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:20:49.893196 21209 tablet_bootstrap.cc:492] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:49.900484 21210 tablet_bootstrap.cc:654] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.889745 21212 consensus_queue.cc:260] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.903874 21212 ts_tablet_manager.cc:1434] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:20:49.906706 21212 tablet_bootstrap.cc:492] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:49.909447 21054 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa9022af8e34f25ab97c145bc6274a9 (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260709 13:20:49.912300 21020 tablet.cc:2406] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:49.917361 21210 tablet_bootstrap.cc:492] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:49.919330 21210 ts_tablet_manager.cc:1403] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.004s
I20260709 13:20:49.913120 21054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa9022af8e34f25ab97c145bc6274a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.922695 21212 tablet_bootstrap.cc:654] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.924386 21210 raft_consensus.cc:359] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.925316 21210 raft_consensus.cc:385] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.925670 21210 raft_consensus.cc:740] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.926625 21210 consensus_queue.cc:260] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.929260 20908 tablet_service.cc:1511] Processing CreateTablet for tablet 4c4dbcf5331b43a3a8ae704ddc2b6e3b (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:49.930874 20908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4dbcf5331b43a3a8ae704ddc2b6e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.925870 20976 tablet_service.cc:1511] Processing CreateTablet for tablet 4c4dbcf5331b43a3a8ae704ddc2b6e3b (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:49.935350 20976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4dbcf5331b43a3a8ae704ddc2b6e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.946372 21210 ts_tablet_manager.cc:1434] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:20:49.948575 21210 tablet_bootstrap.cc:492] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:49.953158 21212 tablet_bootstrap.cc:492] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:49.960299 21210 tablet_bootstrap.cc:654] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.960711 21212 ts_tablet_manager.cc:1403] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.021s
I20260709 13:20:49.962145 21051 tablet_service.cc:1511] Processing CreateTablet for tablet 4c4dbcf5331b43a3a8ae704ddc2b6e3b (DEFAULT_TABLE table=soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:49.968922 21051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c4dbcf5331b43a3a8ae704ddc2b6e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.970273 21210 tablet_bootstrap.cc:492] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:49.960299 21209 tablet_bootstrap.cc:654] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.970923 21210 ts_tablet_manager.cc:1403] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:20:49.971221 21212 raft_consensus.cc:359] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.972095 21212 raft_consensus.cc:385] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.972422 21212 raft_consensus.cc:740] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.973407 21212 consensus_queue.cc:260] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.974534 21210 raft_consensus.cc:359] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.975332 21210 raft_consensus.cc:385] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.975917 21212 ts_tablet_manager.cc:1434] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:20:49.977458 21212 tablet_bootstrap.cc:492] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:49.984200 21212 tablet_bootstrap.cc:654] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.975943 21210 raft_consensus.cc:740] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.985158 21210 consensus_queue.cc:260] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.986584 21209 tablet_bootstrap.cc:492] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:49.987365 21209 ts_tablet_manager.cc:1403] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.003s
I20260709 13:20:49.987629 21210 ts_tablet_manager.cc:1434] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 13:20:49.989219 21210 tablet_bootstrap.cc:492] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:49.990836 21209 raft_consensus.cc:359] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.992111 21209 raft_consensus.cc:385] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.992499 21209 raft_consensus.cc:740] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.993486 21209 consensus_queue.cc:260] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:49.996155 21209 ts_tablet_manager.cc:1434] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:20:49.997289 21209 tablet_bootstrap.cc:492] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:50.003337 21210 tablet_bootstrap.cc:654] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.004061 21209 tablet_bootstrap.cc:654] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.017287 21132 raft_consensus.cc:493] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.017925 21132 raft_consensus.cc:515] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.018885 21209 tablet_bootstrap.cc:492] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:50.019528 21209 ts_tablet_manager.cc:1403] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:20:50.020236 21132 leader_election.cc:290] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:50.022255 21210 tablet_bootstrap.cc:492] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:50.022084 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:50.022817 21210 ts_tablet_manager.cc:1403] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.011s
I20260709 13:20:50.022891 20917 raft_consensus.cc:2468] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:50.023314 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.024048 20993 raft_consensus.cc:2468] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:50.024608 21034 leader_election.cc:304] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.026255 21210 raft_consensus.cc:359] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.027051 21210 raft_consensus.cc:385] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.027469 21210 raft_consensus.cc:740] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.026270 21132 raft_consensus.cc:2804] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.028398 21210 consensus_queue.cc:260] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.029009 21132 raft_consensus.cc:493] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.029400 21132 raft_consensus.cc:3060] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.031185 21210 ts_tablet_manager.cc:1434] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:20:50.032462 21210 tablet_bootstrap.cc:492] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:50.039486 21210 tablet_bootstrap.cc:654] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.041630 21209 raft_consensus.cc:359] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.042519 21209 raft_consensus.cc:385] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.042851 21209 raft_consensus.cc:740] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.050501 21132 raft_consensus.cc:515] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.052199 21209 consensus_queue.cc:260] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.058404 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:50.059309 20917 raft_consensus.cc:3060] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.072556 21209 ts_tablet_manager.cc:1434] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 13:20:50.075071 21132 leader_election.cc:290] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:50.075532 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.076342 20993 raft_consensus.cc:3060] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.078962 20917 raft_consensus.cc:2468] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:50.080713 21034 leader_election.cc:304] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.081936 21132 raft_consensus.cc:2804] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.084812 21132 raft_consensus.cc:697] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
W20260709 13:20:50.070447 20960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:37755, user_credentials={real_user=slave}} blocked reactor thread for 68897.8us
I20260709 13:20:50.086052 21210 tablet_bootstrap.cc:492] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:50.085719 21132 consensus_queue.cc:237] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.086640 21210 ts_tablet_manager.cc:1403] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.031s
I20260709 13:20:50.090324 20993 raft_consensus.cc:2468] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:50.090353 21210 raft_consensus.cc:359] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.094455 21210 raft_consensus.cc:385] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:50.092228 20885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38671, user_credentials={real_user=slave}} blocked reactor thread for 61217.3us
I20260709 13:20:50.093617 21209 tablet_bootstrap.cc:492] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:50.094754 21210 raft_consensus.cc:740] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.099603 21212 tablet_bootstrap.cc:492] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:50.100268 21212 ts_tablet_manager.cc:1403] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.123s	user 0.061s	sys 0.037s
I20260709 13:20:50.096200 21210 consensus_queue.cc:260] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.103545 21210 ts_tablet_manager.cc:1434] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:20:50.104481 21209 tablet_bootstrap.cc:654] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.105587 21210 tablet_bootstrap.cc:492] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:50.103403 21212 raft_consensus.cc:359] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.109802 21212 raft_consensus.cc:385] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.110116 21212 raft_consensus.cc:740] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.103322 20815 catalog_manager.cc:5697] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.110903 21212 consensus_queue.cc:260] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.113934 21210 tablet_bootstrap.cc:654] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.116111 21212 ts_tablet_manager.cc:1434] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:20:50.117444 21212 tablet_bootstrap.cc:492] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:50.121479 21227 raft_consensus.cc:493] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.122120 21227 raft_consensus.cc:515] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.124300 21227 leader_election.cc:290] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.126652 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:50.127600 20917 raft_consensus.cc:2468] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 0.
I20260709 13:20:50.130162 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.130877 21067 raft_consensus.cc:2468] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 0.
I20260709 13:20:50.132356 21212 tablet_bootstrap.cc:654] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.132440 20960 leader_election.cc:304] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.134092 21222 raft_consensus.cc:2804] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.134474 21222 raft_consensus.cc:493] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.134824 21222 raft_consensus.cc:3060] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.137537 21210 tablet_bootstrap.cc:492] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:50.138108 21210 ts_tablet_manager.cc:1403] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 13:20:50.138375 21209 tablet_bootstrap.cc:492] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:50.138993 21209 ts_tablet_manager.cc:1403] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.010s
I20260709 13:20:50.141346 21210 raft_consensus.cc:359] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.142179 21210 raft_consensus.cc:385] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.142393 21209 raft_consensus.cc:359] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.142498 21210 raft_consensus.cc:740] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.143464 21209 raft_consensus.cc:385] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.143966 21209 raft_consensus.cc:740] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.144058 21210 consensus_queue.cc:260] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.144291 21222 raft_consensus.cc:515] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.145298 21209 consensus_queue.cc:260] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.146901 21210 ts_tablet_manager.cc:1434] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:50.145769 21212 tablet_bootstrap.cc:492] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:50.147619 21212 ts_tablet_manager.cc:1403] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.031s	user 0.002s	sys 0.016s
I20260709 13:20:50.148463 21210 tablet_bootstrap.cc:492] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:50.154408 21212 raft_consensus.cc:359] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.156387 21212 raft_consensus.cc:385] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.156812 21212 raft_consensus.cc:740] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.156952 21210 tablet_bootstrap.cc:654] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.155947 21209 ts_tablet_manager.cc:1434] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:20:50.158010 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.158694 21067 raft_consensus.cc:3060] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.159215 21209 tablet_bootstrap.cc:492] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:50.157724 21212 consensus_queue.cc:260] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.155798 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:50.168128 20917 raft_consensus.cc:3060] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.168500 21209 tablet_bootstrap.cc:654] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.169163 21210 tablet_bootstrap.cc:492] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:50.169728 21210 ts_tablet_manager.cc:1403] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:20:50.172982 21210 raft_consensus.cc:359] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.173746 21210 raft_consensus.cc:385] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.174050 21210 raft_consensus.cc:740] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.176914 21173 raft_consensus.cc:493] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.177472 21173 raft_consensus.cc:515] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.180817 21210 consensus_queue.cc:260] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.182996 21212 ts_tablet_manager.cc:1434] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:20:50.183406 21210 ts_tablet_manager.cc:1434] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:20:50.184584 21210 tablet_bootstrap.cc:492] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:50.187837 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.188726 21066 raft_consensus.cc:2468] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.190178 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.191058 20994 raft_consensus.cc:2468] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.194300 21212 tablet_bootstrap.cc:492] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:50.198693 21210 tablet_bootstrap.cc:654] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.198809 20885 leader_election.cc:304] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.199987 21225 raft_consensus.cc:2804] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.201478 21173 leader_election.cc:290] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.201843 21225 raft_consensus.cc:493] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.209944 21225 raft_consensus.cc:3060] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.211455 21212 tablet_bootstrap.cc:654] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.202216 21222 leader_election.cc:290] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.219365 20917 raft_consensus.cc:2468] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 1.
I20260709 13:20:50.220897 20960 leader_election.cc:304] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.221805 21222 raft_consensus.cc:2804] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.222523 21236 raft_consensus.cc:493] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.223116 21236 raft_consensus.cc:515] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.223553 21209 tablet_bootstrap.cc:492] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:50.220990 21067 raft_consensus.cc:2468] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 1.
I20260709 13:20:50.224195 21209 ts_tablet_manager.cc:1403] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.065s	user 0.044s	sys 0.014s
I20260709 13:20:50.224241 21222 raft_consensus.cc:697] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:50.221009 21225 raft_consensus.cc:515] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.228056 21236 leader_election.cc:290] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.228711 21212 tablet_bootstrap.cc:492] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:50.229403 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.230125 20994 raft_consensus.cc:3060] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.230530 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.230726 21209 raft_consensus.cc:359] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.231630 21209 raft_consensus.cc:385] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.231961 21209 raft_consensus.cc:740] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
W20260709 13:20:50.232605 20885 leader_election.cc:343] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.232800 21209 consensus_queue.cc:260] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.233737 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.234031 21236 raft_consensus.cc:493] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.234651 21236 raft_consensus.cc:515] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
W20260709 13:20:50.235438 20885 leader_election.cc:343] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.236024 20885 leader_election.cc:304] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026; no voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:50.237005 21235 raft_consensus.cc:2749] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.238600 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e94dafee8044d49f5ca736133e3634" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.239298 20993 raft_consensus.cc:2468] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.239950 21209 ts_tablet_manager.cc:1434] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:20:50.241255 21209 tablet_bootstrap.cc:492] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:50.241528 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e94dafee8044d49f5ca736133e3634" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.242234 21066 raft_consensus.cc:2468] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.242899 20994 raft_consensus.cc:2468] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.243764 20885 leader_election.cc:304] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.225407 21222 consensus_queue.cc:237] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.244719 21212 ts_tablet_manager.cc:1403] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.011s
I20260709 13:20:50.245039 21235 raft_consensus.cc:2804] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.245456 21235 raft_consensus.cc:493] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.245795 21235 raft_consensus.cc:3060] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.236995 21236 leader_election.cc:290] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.248027 21212 raft_consensus.cc:359] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.248783 21212 raft_consensus.cc:385] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.248821 21225 leader_election.cc:290] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.249030 21210 tablet_bootstrap.cc:492] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:50.249215 21212 raft_consensus.cc:740] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.249888 21210 ts_tablet_manager.cc:1403] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.026s
I20260709 13:20:50.250227 21212 consensus_queue.cc:260] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.252806 21210 raft_consensus.cc:359] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.253535 21210 raft_consensus.cc:385] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.253788 21210 raft_consensus.cc:740] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.255239 21212 ts_tablet_manager.cc:1434] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:50.255785 20885 leader_election.cc:304] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.256402 21212 tablet_bootstrap.cc:492] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:50.257155 21209 tablet_bootstrap.cc:654] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.254626 21210 consensus_queue.cc:260] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.258090 21236 raft_consensus.cc:2804] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.258574 21236 raft_consensus.cc:697] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:50.254611 21235 raft_consensus.cc:515] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.259408 21236 consensus_queue.cc:237] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.260286 21210 ts_tablet_manager.cc:1434] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:50.261533 21210 tablet_bootstrap.cc:492] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: Bootstrap starting.
I20260709 13:20:50.264371 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.265365 21067 raft_consensus.cc:3060] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.266785 21235 leader_election.cc:290] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.267411 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e94dafee8044d49f5ca736133e3634" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.267987 21212 tablet_bootstrap.cc:654] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.268070 20994 raft_consensus.cc:3060] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.269583 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e94dafee8044d49f5ca736133e3634" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.270220 21210 tablet_bootstrap.cc:654] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.273703 21132 raft_consensus.cc:493] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.274290 21132 raft_consensus.cc:515] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.276525 21132 leader_election.cc:290] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:50.281133 20994 raft_consensus.cc:2468] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.283109 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.283847 20993 raft_consensus.cc:2468] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:50.284541 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:50.285224 20885 leader_election.cc:304] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.286252 21235 raft_consensus.cc:2804] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.286715 21235 raft_consensus.cc:697] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:50.285310 20917 raft_consensus.cc:2468] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:50.287531 21235 consensus_queue.cc:237] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.291033 21034 leader_election.cc:304] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.292541 21132 raft_consensus.cc:2804] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.292922 21132 raft_consensus.cc:493] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.293251 21132 raft_consensus.cc:3060] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.302078 21067 raft_consensus.cc:2468] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.285436 21066 raft_consensus.cc:3060] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.309777 21209 tablet_bootstrap.cc:492] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:50.310443 21209 ts_tablet_manager.cc:1403] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.009s
I20260709 13:20:50.314198 21209 raft_consensus.cc:359] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.315264 21209 raft_consensus.cc:385] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.315573 21209 raft_consensus.cc:740] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.316139 21228 raft_consensus.cc:493] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.316672 21228 raft_consensus.cc:515] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.319054 21228 leader_election.cc:290] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:50.319299 20815 catalog_manager.cc:5697] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.311412 20817 catalog_manager.cc:5697] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 0 to 1, leader changed from <none> to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 1 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.325989 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:50.326771 20917 raft_consensus.cc:2468] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 0.
I20260709 13:20:50.329890 21034 leader_election.cc:304] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.328511 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.327594 21066 raft_consensus.cc:2468] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.339885 21228 raft_consensus.cc:2804] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.331067 21225 raft_consensus.cc:493] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.340919 21228 raft_consensus.cc:493] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.340765 21225 raft_consensus.cc:515] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.341418 21228 raft_consensus.cc:3060] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.344166 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.344898 20993 raft_consensus.cc:2468] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.332409 21132 raft_consensus.cc:515] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.350430 20885 leader_election.cc:304] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.351018 21209 consensus_queue.cc:260] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.351922 21236 raft_consensus.cc:2804] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.353089 21236 raft_consensus.cc:493] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.353404 21236 raft_consensus.cc:3060] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.354489 21228 raft_consensus.cc:515] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.351142 21132 leader_election.cc:290] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:50.357551 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:50.358311 20918 raft_consensus.cc:3060] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.358623 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.359285 21209 ts_tablet_manager.cc:1434] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.003s
I20260709 13:20:50.359967 21225 leader_election.cc:290] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
W20260709 13:20:50.360231 20885 leader_election.cc:343] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.360707 21209 tablet_bootstrap.cc:492] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:50.372236 21212 tablet_bootstrap.cc:492] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:50.366003 20918 raft_consensus.cc:2468] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:50.372851 21212 ts_tablet_manager.cc:1403] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.003s
I20260709 13:20:50.373515 21236 raft_consensus.cc:515] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.374147 21210 tablet_bootstrap.cc:492] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: No bootstrap required, opened a new log
I20260709 13:20:50.374683 21210 ts_tablet_manager.cc:1403] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.031s
I20260709 13:20:50.366695 21228 leader_election.cc:290] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:50.367937 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.376492 20993 raft_consensus.cc:3060] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.376225 21212 raft_consensus.cc:359] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.376737 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.377034 21212 raft_consensus.cc:385] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.377352 21212 raft_consensus.cc:740] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.377401 20994 raft_consensus.cc:3060] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.378347 21212 consensus_queue.cc:260] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.368148 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:50.379528 20917 raft_consensus.cc:3060] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.379295 20815 catalog_manager.cc:5697] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.380966 21212 ts_tablet_manager.cc:1434] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:50.382506 21236 leader_election.cc:290] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.369593 20992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.384150 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.384789 21066 raft_consensus.cc:3060] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.388769 20994 raft_consensus.cc:2468] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.390038 20885 leader_election.cc:304] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.390965 21236 raft_consensus.cc:2804] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.391656 21236 raft_consensus.cc:697] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:50.392518 21236 consensus_queue.cc:237] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.393245 21034 leader_election.cc:304] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:50.394145 20917 raft_consensus.cc:2468] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:50.394368 21132 raft_consensus.cc:2804] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.395668 21132 raft_consensus.cc:697] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:50.396601 21132 consensus_queue.cc:237] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.398270 21210 raft_consensus.cc:359] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.394883 20993 raft_consensus.cc:2468] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 1.
I20260709 13:20:50.399868 21212 tablet_bootstrap.cc:492] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:50.399086 21210 raft_consensus.cc:385] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.400626 21210 raft_consensus.cc:740] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Initialized, Role: FOLLOWER
W20260709 13:20:50.394270 21034 leader_election.cc:343] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.401563 21210 consensus_queue.cc:260] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
W20260709 13:20:50.402413 21034 leader_election.cc:343] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.403875 21034 leader_election.cc:304] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:50.404680 21228 raft_consensus.cc:2804] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.405234 21228 raft_consensus.cc:697] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:50.404387 21210 ts_tablet_manager.cc:1434] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:20:50.407961 21066 raft_consensus.cc:2468] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.406044 21228 consensus_queue.cc:237] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.409512 21212 tablet_bootstrap.cc:654] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.415417 20817 catalog_manager.cc:5697] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.420732 21209 tablet_bootstrap.cc:654] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.422134 21212 tablet_bootstrap.cc:492] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:50.422681 21212 ts_tablet_manager.cc:1403] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:20:50.426397 21209 tablet_bootstrap.cc:492] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:50.426967 21209 ts_tablet_manager.cc:1403] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.002s
I20260709 13:20:50.427295 21212 raft_consensus.cc:359] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.428076 21212 raft_consensus.cc:385] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.428333 21212 raft_consensus.cc:740] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.429021 21212 consensus_queue.cc:260] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.430230 21209 raft_consensus.cc:359] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.430997 21209 raft_consensus.cc:385] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.431321 21212 ts_tablet_manager.cc:1434] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:20:50.432410 21212 tablet_bootstrap.cc:492] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: Bootstrap starting.
I20260709 13:20:50.435709 20817 catalog_manager.cc:5697] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.431258 21209 raft_consensus.cc:740] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.437558 20817 catalog_manager.cc:5697] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 1 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.438345 21212 tablet_bootstrap.cc:654] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.438812 21209 consensus_queue.cc:260] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.441108 21209 ts_tablet_manager.cc:1434] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:20:50.442509 21209 tablet_bootstrap.cc:492] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: Bootstrap starting.
I20260709 13:20:50.447837 21209 tablet_bootstrap.cc:654] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.451725 21212 tablet_bootstrap.cc:492] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: No bootstrap required, opened a new log
I20260709 13:20:50.452275 21212 ts_tablet_manager.cc:1403] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:20:50.454561 21209 tablet_bootstrap.cc:492] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: No bootstrap required, opened a new log
I20260709 13:20:50.455117 21209 ts_tablet_manager.cc:1403] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:20:50.455235 21212 raft_consensus.cc:359] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.455987 21212 raft_consensus.cc:385] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.456236 21212 raft_consensus.cc:740] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.456851 21212 consensus_queue.cc:260] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.457832 21209 raft_consensus.cc:359] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.458546 21209 raft_consensus.cc:385] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.458802 21209 raft_consensus.cc:740] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.458914 21212 ts_tablet_manager.cc:1434] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:50.459587 21209 consensus_queue.cc:260] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.460237 21236 raft_consensus.cc:493] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.460739 21236 raft_consensus.cc:515] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.462102 21209 ts_tablet_manager.cc:1434] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:50.462709 21236 leader_election.cc:290] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.464569 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" is_pre_election: true
I20260709 13:20:50.465262 20993 raft_consensus.cc:2468] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.466200 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.466728 21066 raft_consensus.cc:2468] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 0.
I20260709 13:20:50.467676 20885 leader_election.cc:304] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.468461 21236 raft_consensus.cc:2804] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.469491 21236 raft_consensus.cc:493] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.469835 21236 raft_consensus.cc:3060] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.475915 21236 raft_consensus.cc:515] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.477424 21236 leader_election.cc:290] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.478252 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:50.478428 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.478823 20993 raft_consensus.cc:3060] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.478921 21066 raft_consensus.cc:3060] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.484431 20993 raft_consensus.cc:2468] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.485481 20885 leader_election.cc:304] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.485687 21066 raft_consensus.cc:2468] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 1.
I20260709 13:20:50.486290 21236 raft_consensus.cc:2804] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.486985 21236 raft_consensus.cc:697] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:50.487797 21236 consensus_queue.cc:237] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.493927 21132 consensus_queue.cc:1048] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.496680 20816 catalog_manager.cc:5697] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 1 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.511901 21245 consensus_queue.cc:1048] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:50.620093 20865 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:50.629351 21222 raft_consensus.cc:493] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.629949 21222 raft_consensus.cc:515] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.631785 21222 leader_election.cc:290] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.632552 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:50.632866 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.633323 20917 raft_consensus.cc:2468] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 0.
I20260709 13:20:50.633505 21066 raft_consensus.cc:2468] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 0.
I20260709 13:20:50.634460 20960 leader_election.cc:304] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.635103 21222 raft_consensus.cc:2804] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.635401 21222 raft_consensus.cc:493] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.635645 21222 raft_consensus.cc:3060] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.641562 21222 raft_consensus.cc:515] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.643098 21222 leader_election.cc:290] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.644029 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:50.644295 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.644639 20917 raft_consensus.cc:3060] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.644840 21066 raft_consensus.cc:3060] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.649820 21066 raft_consensus.cc:2468] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 1.
I20260709 13:20:50.650225 20917 raft_consensus.cc:2468] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 1.
I20260709 13:20:50.650810 20960 leader_election.cc:304] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.651654 21222 raft_consensus.cc:2804] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.652068 21222 raft_consensus.cc:697] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:50.652801 21222 consensus_queue.cc:237] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.659844 20817 catalog_manager.cc:5697] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 0 to 1, leader changed from <none> to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 1 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.696518 21236 consensus_queue.cc:1048] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.708110 21225 consensus_queue.cc:1048] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.758958 21222 consensus_queue.cc:1048] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.769462 21264 consensus_queue.cc:1048] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:50.774981 21264 raft_consensus.cc:493] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.775481 21264 raft_consensus.cc:515] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.777803 21264 leader_election.cc:290] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.778882 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3244c4c9fe1940aea6040c91014eee47" is_pre_election: true
I20260709 13:20:50.779018 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad47b763e394f0a98cea588f7707026" is_pre_election: true
I20260709 13:20:50.780053 20917 raft_consensus.cc:2393] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b49eb8f55a2e45f09781dcc72fc3fe0f in current term 1: Already voted for candidate 3244c4c9fe1940aea6040c91014eee47 in this term.
I20260709 13:20:50.781049 20960 leader_election.cc:304] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:50.781790 21264 raft_consensus.cc:3060] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.788259 21264 raft_consensus.cc:2749] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.804402 21225 consensus_queue.cc:1048] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.815455 21225 consensus_queue.cc:1048] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.834452 21228 consensus_queue.cc:1048] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.846046 21245 consensus_queue.cc:1048] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.882592 21066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
mode: GRACEFUL
new_leader_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:20:50.883116 21066 raft_consensus.cc:606] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Received request to transfer leadership to TS 0ad47b763e394f0a98cea588f7707026
I20260709 13:20:50.889289 21066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
mode: GRACEFUL
new_leader_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:20:50.889890 21066 raft_consensus.cc:606] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Received request to transfer leadership to TS 0ad47b763e394f0a98cea588f7707026
I20260709 13:20:50.904744 20993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
mode: GRACEFUL
new_leader_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:40194
I20260709 13:20:50.905346 20993 raft_consensus.cc:606] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Received request to transfer leadership to TS 0ad47b763e394f0a98cea588f7707026
I20260709 13:20:50.911626 21225 consensus_queue.cc:1048] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.914311 20917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:50802
I20260709 13:20:50.914937 20917 raft_consensus.cc:606] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:50.925046 21236 consensus_queue.cc:1048] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.926714 21066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:20:50.927474 21066 raft_consensus.cc:606] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:50.933501 20917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:50802
I20260709 13:20:50.934038 20917 raft_consensus.cc:606] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:50.937316 21235 raft_consensus.cc:993] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:50.937886 21274 raft_consensus.cc:1081] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:50.939644 20994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40192
I20260709 13:20:50.940168 20917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
mode: GRACEFUL
new_leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:50802
I20260709 13:20:50.940340 20994 raft_consensus.cc:493] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:50.940930 20917 raft_consensus.cc:606] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Received request to transfer leadership to TS b49eb8f55a2e45f09781dcc72fc3fe0f
I20260709 13:20:50.941040 20994 raft_consensus.cc:3060] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.948151 20993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
mode: GRACEFUL
new_leader_uuid: "3244c4c9fe1940aea6040c91014eee47"
 from {username='slave'} at 127.0.0.1:40194
I20260709 13:20:50.948774 20993 raft_consensus.cc:606] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Received request to transfer leadership to TS 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:50.948621 20994 raft_consensus.cc:515] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.951757 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:50.952797 20994 leader_election.cc:290] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:50.952649 20917 raft_consensus.cc:3055] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:50.952545 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b281eaf1bb4a58b9e92122d3b7ea66" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:50.953745 20917 raft_consensus.cc:740] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:50.954090 21066 raft_consensus.cc:3060] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.954684 20917 consensus_queue.cc:260] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.955883 20917 raft_consensus.cc:3060] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.961333 21066 raft_consensus.cc:2468] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:50.961532 20917 raft_consensus.cc:2468] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:50.962438 20960 leader_election.cc:304] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:50.963225 21264 raft_consensus.cc:2804] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:50.963717 21264 raft_consensus.cc:697] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:50.964468 21264 consensus_queue.cc:237] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:50.971107 20815 catalog_manager.cc:5697] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 0ad47b763e394f0a98cea588f7707026 (127.8.186.193) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.003660 21132 consensus_queue.cc:1048] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.009864 21269 raft_consensus.cc:993] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:51.010382 21228 raft_consensus.cc:1081] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:51.013597 20993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40182
I20260709 13:20:51.014127 20993 raft_consensus.cc:493] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.014487 20993 raft_consensus.cc:3060] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.015105 21132 consensus_queue.cc:1048] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.021526 20993 raft_consensus.cc:515] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.024320 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:51.024911 20918 raft_consensus.cc:3060] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.026695 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27e50a46a17144cb92374a67aaaafe87" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:51.027963 21066 raft_consensus.cc:3055] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.028357 21066 raft_consensus.cc:740] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:51.029172 21066 consensus_queue.cc:260] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.030326 21066 raft_consensus.cc:3060] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.031982 20993 leader_election.cc:290] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:51.032280 21274 consensus_queue.cc:1048] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.032698 20918 raft_consensus.cc:2468] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:51.034147 20960 leader_election.cc:304] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:51.035004 21264 raft_consensus.cc:2804] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.035651 21264 raft_consensus.cc:697] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:51.036476 21264 consensus_queue.cc:237] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.038017 21066 raft_consensus.cc:2468] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:51.043394 21236 raft_consensus.cc:993] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:51.043887 21225 raft_consensus.cc:1081] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:51.046087 20994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40192
I20260709 13:20:51.046667 20994 raft_consensus.cc:493] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.047034 20994 raft_consensus.cc:3060] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.048329 21225 consensus_queue.cc:1048] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.048825 20816 catalog_manager.cc:5697] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.054986 20994 raft_consensus.cc:515] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.056231 20993 raft_consensus.cc:1240] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Rejecting Update request from peer 0ad47b763e394f0a98cea588f7707026 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:51.060108 21225 consensus_queue.cc:1059] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.060554 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:51.060899 21225 raft_consensus.cc:3055] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.061401 21225 raft_consensus.cc:740] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:51.061839 20994 leader_election.cc:290] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:51.062238 21225 consensus_queue.cc:260] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.063640 21225 raft_consensus.cc:3060] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.064011 21066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa9022af8e34f25ab97c145bc6274a9" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:51.064507 21066 raft_consensus.cc:3060] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.070261 21066 raft_consensus.cc:2468] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:51.071928 20960 leader_election.cc:304] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:51.072753 21264 raft_consensus.cc:2804] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.073212 21264 raft_consensus.cc:697] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:51.073989 21264 consensus_queue.cc:237] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.076699 20918 raft_consensus.cc:2468] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:51.082942 21264 consensus_queue.cc:1048] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.084805 20817 catalog_manager.cc:5697] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 0ad47b763e394f0a98cea588f7707026 (127.8.186.193) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.090260 21227 raft_consensus.cc:993] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: : Instructing follower 3244c4c9fe1940aea6040c91014eee47 to start an election
I20260709 13:20:51.090806 21222 raft_consensus.cc:1081] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Signalling peer 3244c4c9fe1940aea6040c91014eee47 to start an election
I20260709 13:20:51.092543 21067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
 from {username='slave'} at 127.0.0.1:49708
I20260709 13:20:51.093142 21067 raft_consensus.cc:493] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.093537 21067 raft_consensus.cc:3060] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.101929 21228 raft_consensus.cc:993] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: : Instructing follower 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:51.102519 21132 raft_consensus.cc:1081] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Signalling peer 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:51.104410 20918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:50782
I20260709 13:20:51.105176 20918 raft_consensus.cc:493] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.105661 20918 raft_consensus.cc:3060] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.107548 21067 raft_consensus.cc:515] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.108886 21065 raft_consensus.cc:1240] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Rejecting Update request from peer b49eb8f55a2e45f09781dcc72fc3fe0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:51.111071 21222 consensus_queue.cc:1059] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.111238 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:51.111965 20917 raft_consensus.cc:3060] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.112694 21227 raft_consensus.cc:3055] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.113085 21227 raft_consensus.cc:740] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:51.114107 21227 consensus_queue.cc:260] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.115000 21227 raft_consensus.cc:3060] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.117439 20918 raft_consensus.cc:515] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.120628 20994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:51.121281 20994 raft_consensus.cc:3060] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.121749 21065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51206d639cbb4b56ad5463ca82cda963" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:51.122390 21065 raft_consensus.cc:3055] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.122709 21065 raft_consensus.cc:740] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:51.122735 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c4dbcf5331b43a3a8ae704ddc2b6e3b" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:51.123672 21065 consensus_queue.cc:260] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.125313 21065 raft_consensus.cc:3060] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.127247 20994 raft_consensus.cc:2468] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:51.128322 20885 leader_election.cc:304] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:51.128975 21225 raft_consensus.cc:2804] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.129431 21225 raft_consensus.cc:697] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:51.129669 20993 raft_consensus.cc:2468] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 2.
I20260709 13:20:51.119457 20917 raft_consensus.cc:2468] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 2.
I20260709 13:20:51.130642 21067 leader_election.cc:290] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:51.130355 21225 consensus_queue.cc:237] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.131038 21034 leader_election.cc:304] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:51.131664 20919 raft_consensus.cc:1240] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Rejecting Update request from peer b49eb8f55a2e45f09781dcc72fc3fe0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:51.133528 21065 raft_consensus.cc:2468] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:51.133957 21132 raft_consensus.cc:2804] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.131868 20918 leader_election.cc:290] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:51.135085 21132 raft_consensus.cc:697] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 2 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:51.135972 21132 consensus_queue.cc:237] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.138954 20817 catalog_manager.cc:5697] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 1 to 2, leader changed from 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195) to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.144333 20816 catalog_manager.cc:5697] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 1 to 2, leader changed from b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194) to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 2 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:51.267838 21282 raft_consensus.cc:993] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: : Instructing follower 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:51.268260 21227 raft_consensus.cc:1081] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Signalling peer 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:51.269590 20917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:20:51.270052 20917 raft_consensus.cc:493] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.270339 20917 raft_consensus.cc:3060] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.275446 20917 raft_consensus.cc:515] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.277002 20917 leader_election.cc:290] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:51.277868 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:51.278149 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cac2b0f7c4f46a081342bbd5de91bbf" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:51.278465 20993 raft_consensus.cc:3055] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.278717 21067 raft_consensus.cc:3060] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.278744 20993 raft_consensus.cc:740] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:51.279467 20993 consensus_queue.cc:260] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.280383 20993 raft_consensus.cc:3060] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.284045 21067 raft_consensus.cc:2468] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:51.284852 20993 raft_consensus.cc:2468] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:51.285312 20885 leader_election.cc:304] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:51.286096 21225 raft_consensus.cc:2804] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.286594 21225 raft_consensus.cc:697] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:51.287226 21225 consensus_queue.cc:237] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.293632 20816 catalog_manager.cc:5697] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 1 to 2, leader changed from b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194) to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.356274 20917 raft_consensus.cc:1275] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.357612 21227 consensus_queue.cc:1048] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.369380 21067 raft_consensus.cc:1275] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.371263 21282 consensus_queue.cc:1048] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.421490 21067 raft_consensus.cc:1275] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.422809 21282 consensus_queue.cc:1048] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.430454 20917 raft_consensus.cc:1275] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.432104 21264 consensus_queue.cc:1048] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.436904 21235 raft_consensus.cc:993] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: : Instructing follower b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:51.437389 21225 raft_consensus.cc:1081] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Signalling peer b49eb8f55a2e45f09781dcc72fc3fe0f to start an election
I20260709 13:20:51.439821 20993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
 from {username='slave'} at 127.0.0.1:40192
I20260709 13:20:51.440636 20993 raft_consensus.cc:493] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.441007 20993 raft_consensus.cc:3060] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.447477 20993 raft_consensus.cc:515] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.448832 20993 leader_election.cc:290] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:51.449707 20917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:51.450378 20917 raft_consensus.cc:3055] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.450654 20917 raft_consensus.cc:740] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:51.450392 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70ec366fff149ddb7c5bb941de00b7e" candidate_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:51.451143 21067 raft_consensus.cc:3060] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.451342 20917 consensus_queue.cc:260] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.452378 20917 raft_consensus.cc:3060] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.456779 21067 raft_consensus.cc:2468] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:51.456907 20917 raft_consensus.cc:2468] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b49eb8f55a2e45f09781dcc72fc3fe0f in term 2.
I20260709 13:20:51.457911 20960 leader_election.cc:304] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:51.458715 21222 raft_consensus.cc:2804] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.459194 21222 raft_consensus.cc:697] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Leader. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:51.459908 21222 consensus_queue.cc:237] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.460623 20917 raft_consensus.cc:1275] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.463526 21264 consensus_queue.cc:1048] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.463760 21228 raft_consensus.cc:993] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: : Instructing follower 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:51.464545 21228 raft_consensus.cc:1081] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Signalling peer 0ad47b763e394f0a98cea588f7707026 to start an election
I20260709 13:20:51.466421 20917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
 from {username='slave'} at 127.0.0.1:50782
I20260709 13:20:51.466929 20917 raft_consensus.cc:493] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.467278 20917 raft_consensus.cc:3060] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.468407 20817 catalog_manager.cc:5697] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f reported cstate change: term changed from 1 to 2, leader changed from 0ad47b763e394f0a98cea588f7707026 (127.8.186.193) to b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194). New cstate: current_term: 2 leader_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.475637 21067 raft_consensus.cc:1275] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.475876 20917 raft_consensus.cc:515] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.477397 21227 consensus_queue.cc:1048] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.478508 20993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:51.479091 20993 raft_consensus.cc:3060] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.485913 20917 leader_election.cc:290] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195:40761)
I20260709 13:20:51.488211 21067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f095dfe58404dba9c85a71b7e4fa35f" candidate_uuid: "0ad47b763e394f0a98cea588f7707026" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
I20260709 13:20:51.488138 20993 raft_consensus.cc:2468] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:51.488917 21067 raft_consensus.cc:3055] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.489301 21067 raft_consensus.cc:740] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:51.489825 20885 leader_election.cc:304] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:51.490101 21067 consensus_queue.cc:260] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.490634 21225 raft_consensus.cc:2804] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.491158 21225 raft_consensus.cc:697] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Becoming Leader. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:51.491986 21225 consensus_queue.cc:237] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:51.493016 21067 raft_consensus.cc:3060] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.498659 21067 raft_consensus.cc:2468] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad47b763e394f0a98cea588f7707026 in term 2.
I20260709 13:20:51.498252 20815 catalog_manager.cc:5697] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 reported cstate change: term changed from 1 to 2, leader changed from 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195) to 0ad47b763e394f0a98cea588f7707026 (127.8.186.193). New cstate: current_term: 2 leader_uuid: "0ad47b763e394f0a98cea588f7707026" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.549858 20993 raft_consensus.cc:1275] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.551219 21225 consensus_queue.cc:1048] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.560453 21067 raft_consensus.cc:1275] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.561960 21225 consensus_queue.cc:1048] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.639881 20918 raft_consensus.cc:1275] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer 3244c4c9fe1940aea6040c91014eee47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.641119 21228 consensus_queue.cc:1048] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.650233 20993 raft_consensus.cc:1275] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Refusing update from remote peer 3244c4c9fe1940aea6040c91014eee47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.652417 21228 consensus_queue.cc:1048] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.758275 20994 raft_consensus.cc:1275] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.759464 21225 consensus_queue.cc:1048] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.766589 21067 raft_consensus.cc:1275] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.768105 21274 consensus_queue.cc:1048] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.874001 21067 raft_consensus.cc:1275] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.875238 21227 consensus_queue.cc:1048] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.884402 20918 raft_consensus.cc:1275] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Refusing update from remote peer b49eb8f55a2e45f09781dcc72fc3fe0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.885726 21222 consensus_queue.cc:1048] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.082147 21067 raft_consensus.cc:1275] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.083441 21274 consensus_queue.cc:1048] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.092001 20994 raft_consensus.cc:1275] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Refusing update from remote peer 0ad47b763e394f0a98cea588f7707026: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.094136 21235 consensus_queue.cc:1048] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:53.952598 20817 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52990:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:53.973729 20817 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52990:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:54.004027  8939 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:54.109737 20885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:40761, user_credentials={real_user=slave}} blocked reactor thread for 50992.2us
W20260709 13:20:54.198211 20885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38671, user_credentials={real_user=slave}} blocked reactor thread for 45432.1us
I20260709 13:20:54.218736 20994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c"
dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
mode: GRACEFUL
new_leader_uuid: "3244c4c9fe1940aea6040c91014eee47"
 from {username='slave'} at 127.0.0.1:52538
I20260709 13:20:54.219631 20994 raft_consensus.cc:606] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Received request to transfer leadership to TS 3244c4c9fe1940aea6040c91014eee47
W20260709 13:20:54.243564 20960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.195:40761, user_credentials={real_user=slave}} blocked reactor thread for 88871.9us
W20260709 13:20:54.287082 20885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.194:38671, user_credentials={real_user=slave}} blocked reactor thread for 88164.4us
I20260709 13:20:54.305213 21342 tablet.cc:1724] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.374161 21351 tablet.cc:1724] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.375948 21360 tablet.cc:1724] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.396368 21355 tablet.cc:1724] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.341928 21347 tablet.cc:1724] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.420358 21362 tablet.cc:1724] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.421823 21363 tablet.cc:1724] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.433485 21360 tablet.cc:1724] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.443573 20919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02"
dest_uuid: "0ad47b763e394f0a98cea588f7707026"
mode: GRACEFUL
new_leader_uuid: "3244c4c9fe1940aea6040c91014eee47"
 from {username='slave'} at 127.0.0.1:40864
I20260709 13:20:54.443167 21361 tablet.cc:1724] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.444300 20919 raft_consensus.cc:606] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Received request to transfer leadership to TS 3244c4c9fe1940aea6040c91014eee47
I20260709 13:20:54.455603  8939 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:54.456398  8939 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:54.455483 21360 tablet.cc:1724] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:54.498567 20960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.186.193:37755, user_credentials={real_user=slave}} blocked reactor thread for 84749.2us
I20260709 13:20:54.516849 21371 tablet.cc:1724] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.464006 21342 tablet.cc:1724] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.528685 21362 tablet.cc:1724] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.529342 21347 tablet.cc:1724] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.541244 21363 tablet.cc:1724] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.544473 21365 tablet.cc:1724] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.551133 21222 raft_consensus.cc:993] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: : Instructing follower 3244c4c9fe1940aea6040c91014eee47 to start an election
I20260709 13:20:54.551704 21222 raft_consensus.cc:1081] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Signalling peer 3244c4c9fe1940aea6040c91014eee47 to start an election
I20260709 13:20:54.524469 21368 tablet.cc:1724] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.563809 21360 tablet.cc:1724] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.569428 21062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
 from {username='slave'} at 127.0.0.1:49708
I20260709 13:20:54.578088 21062 raft_consensus.cc:493] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:54.577557 21368 tablet.cc:1724] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.578644 21062 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:54.587007 21373 tablet.cc:1724] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.515941 21351 tablet.cc:1724] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.596284 21365 tablet.cc:1724] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.601866 21373 tablet.cc:1724] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.607769 21062 raft_consensus.cc:515] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:54.609478 21347 tablet.cc:1724] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.611387 21062 leader_election.cc:290] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 3 election: Requested vote from peers 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755), b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671)
I20260709 13:20:54.611899 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:54.612440 20992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f559b953dbb4df19d2fd1226a692d9c" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:54.613152 20992 raft_consensus.cc:3055] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:54.612515 20918 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:54.613463 20992 raft_consensus.cc:740] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b49eb8f55a2e45f09781dcc72fc3fe0f, State: Running, Role: LEADER
I20260709 13:20:54.613745 21362 tablet.cc:1724] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.615159 20992 consensus_queue.cc:260] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:54.616523 20992 raft_consensus.cc:3060] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:54.625623 21371 tablet.cc:1724] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.627056 20918 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 3.
I20260709 13:20:54.628496 20992 raft_consensus.cc:2468] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 3.
I20260709 13:20:54.614406 21361 tablet.cc:1724] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:54.633806 21034 leader_election.cc:304] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad47b763e394f0a98cea588f7707026, 3244c4c9fe1940aea6040c91014eee47; no voters: 
I20260709 13:20:54.634749 21331 raft_consensus.cc:2804] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:54.635224 21331 raft_consensus.cc:697] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 3 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:54.636602 21331 consensus_queue.cc:237] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } }
I20260709 13:20:54.645864 20816 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9: soft_deleted_table [id=9daacb9735414ffda9ce3aad5c81d5f1] alter complete (version 1)
I20260709 13:20:54.666567 20815 catalog_manager.cc:5697] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 2 to 3, leader changed from b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194) to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.673853 21327 raft_consensus.cc:993] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: : Instructing follower 3244c4c9fe1940aea6040c91014eee47 to start an election
I20260709 13:20:54.674372 21344 raft_consensus.cc:1081] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Signalling peer 3244c4c9fe1940aea6040c91014eee47 to start an election
I20260709 13:20:54.675915 21062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02"
dest_uuid: "3244c4c9fe1940aea6040c91014eee47"
 from {username='slave'} at 127.0.0.1:49724
I20260709 13:20:54.676415 21062 raft_consensus.cc:493] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:54.676694 21062 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:54.683269 21062 raft_consensus.cc:515] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:54.685361 21062 leader_election.cc:290] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 3 election: Requested vote from peers b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671), 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755)
I20260709 13:20:54.686048 20992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f"
I20260709 13:20:54.686367 20918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d600f22e244688a7ecac9f8a282c02" candidate_uuid: "3244c4c9fe1940aea6040c91014eee47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ad47b763e394f0a98cea588f7707026"
I20260709 13:20:54.686839 20992 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:54.686992 20918 raft_consensus.cc:3055] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:54.687420 20918 raft_consensus.cc:740] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ad47b763e394f0a98cea588f7707026, State: Running, Role: LEADER
I20260709 13:20:54.688175 20918 consensus_queue.cc:260] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:54.689325 20918 raft_consensus.cc:3060] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:54.693063 20992 raft_consensus.cc:2468] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 3.
I20260709 13:20:54.694093 21034 leader_election.cc:304] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3244c4c9fe1940aea6040c91014eee47, b49eb8f55a2e45f09781dcc72fc3fe0f; no voters: 
I20260709 13:20:54.694941 21331 raft_consensus.cc:2804] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:54.695334 21331 raft_consensus.cc:697] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 3 LEADER]: Becoming Leader. State: Replica: 3244c4c9fe1940aea6040c91014eee47, State: Running, Role: LEADER
I20260709 13:20:54.695952 20918 raft_consensus.cc:2468] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3244c4c9fe1940aea6040c91014eee47 in term 3.
I20260709 13:20:54.696441 21331 consensus_queue.cc:237] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } }
I20260709 13:20:54.705045 20815 catalog_manager.cc:5697] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 reported cstate change: term changed from 2 to 3, leader changed from 0ad47b763e394f0a98cea588f7707026 (127.8.186.193) to 3244c4c9fe1940aea6040c91014eee47 (127.8.186.195). New cstate: current_term: 3 leader_uuid: "3244c4c9fe1940aea6040c91014eee47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3244c4c9fe1940aea6040c91014eee47" member_type: VOTER last_known_addr { host: "127.8.186.195" port: 40761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.160156 20992 raft_consensus.cc:1275] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Refusing update from remote peer 3244c4c9fe1940aea6040c91014eee47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:55.161628 21331 consensus_queue.cc:1048] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:55.166783 20919 raft_consensus.cc:1275] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Refusing update from remote peer 3244c4c9fe1940aea6040c91014eee47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:55.168804 21331 consensus_queue.cc:1048] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:55.173982 20919 raft_consensus.cc:1275] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Refusing update from remote peer 3244c4c9fe1940aea6040c91014eee47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:55.175691 21380 consensus_queue.cc:1048] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad47b763e394f0a98cea588f7707026" member_type: VOTER last_known_addr { host: "127.8.186.193" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:55.199997 20991 raft_consensus.cc:1275] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Refusing update from remote peer 3244c4c9fe1940aea6040c91014eee47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:55.206213 21380 consensus_queue.cc:1048] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b49eb8f55a2e45f09781dcc72fc3fe0f" member_type: VOTER last_known_addr { host: "127.8.186.194" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:55.514694  8939 tablet_server.cc:179] TabletServer@127.8.186.193:0 shutting down...
W20260709 13:20:55.523911 20960 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 13:20:55.530295 20960 consensus_peers.cc:597] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.532872 20960 consensus_peers.cc:597] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.549288  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:55.550357  8939 tablet_replica.cc:333] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
W20260709 13:20:55.550977 20960 consensus_peers.cc:597] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.551268  8939 raft_consensus.cc:2243] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.552026  8939 raft_consensus.cc:2272] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.554912  8939 tablet_replica.cc:333] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.555486  8939 raft_consensus.cc:2243] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.556003  8939 raft_consensus.cc:2272] T 7fa9022af8e34f25ab97c145bc6274a9 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.558411  8939 tablet_replica.cc:333] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.559005  8939 raft_consensus.cc:2243] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.559430  8939 raft_consensus.cc:2272] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.561864  8939 tablet_replica.cc:333] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.562463  8939 raft_consensus.cc:2243] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.563244  8939 raft_consensus.cc:2272] T 08e94dafee8044d49f5ca736133e3634 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.566058  8939 tablet_replica.cc:333] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.566650  8939 raft_consensus.cc:2243] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.567548  8939 raft_consensus.cc:2272] T 0f095dfe58404dba9c85a71b7e4fa35f P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.569768  8939 tablet_replica.cc:333] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.570390  8939 raft_consensus.cc:2243] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.570886  8939 raft_consensus.cc:2272] T b70ec366fff149ddb7c5bb941de00b7e P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.573339  8939 tablet_replica.cc:333] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.573942  8939 raft_consensus.cc:2243] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.574366  8939 raft_consensus.cc:2272] T 7fb3b977b9274ea9826779b3519819f3 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.576936  8939 tablet_replica.cc:333] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.577546  8939 raft_consensus.cc:2243] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.577970  8939 raft_consensus.cc:2272] T 5139d76184f6413c896c55301b10c3cc P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.580543  8939 tablet_replica.cc:333] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.581413  8939 raft_consensus.cc:2243] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.582485  8939 raft_consensus.cc:2272] T 409514b8565f4119bbb6e6cac1eeffc1 P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.584497 20960 consensus_peers.cc:597] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.585148  8939 tablet_replica.cc:333] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.585801  8939 raft_consensus.cc:2243] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.586210  8939 raft_consensus.cc:2272] T 84d600f22e244688a7ecac9f8a282c02 P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.589087  8939 tablet_replica.cc:333] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.589672  8939 raft_consensus.cc:2243] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.590451  8939 raft_consensus.cc:2272] T 51206d639cbb4b56ad5463ca82cda963 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.592471  8939 tablet_replica.cc:333] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.592990  8939 raft_consensus.cc:2243] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.593509  8939 raft_consensus.cc:2272] T c190bff4977543b0b13e5c38f62c584d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.595791  8939 tablet_replica.cc:333] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.596521  8939 raft_consensus.cc:2243] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.597335  8939 raft_consensus.cc:2272] T 8cac2b0f7c4f46a081342bbd5de91bbf P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.599272  8939 tablet_replica.cc:333] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.599885  8939 raft_consensus.cc:2243] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.600752  8939 raft_consensus.cc:2272] T 720c8fac03ac4e3794755fa0b1777b6d P 0ad47b763e394f0a98cea588f7707026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.603684  8939 tablet_replica.cc:333] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.604387  8939 raft_consensus.cc:2243] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.604979  8939 raft_consensus.cc:2272] T 27e50a46a17144cb92374a67aaaafe87 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.606976  8939 tablet_replica.cc:333] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.607530  8939 raft_consensus.cc:2243] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.608338  8939 raft_consensus.cc:2272] T 609685fee0234619a86813214e1f5ecd P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.610368  8939 tablet_replica.cc:333] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.610860  8939 raft_consensus.cc:2243] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.611271  8939 raft_consensus.cc:2272] T 7f559b953dbb4df19d2fd1226a692d9c P 0ad47b763e394f0a98cea588f7707026 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.613773  8939 tablet_replica.cc:333] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026: stopping tablet replica
I20260709 13:20:55.614286  8939 raft_consensus.cc:2243] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.614725  8939 raft_consensus.cc:2272] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 0ad47b763e394f0a98cea588f7707026 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.655848  8939 tablet_server.cc:196] TabletServer@127.8.186.193:0 shutdown complete.
I20260709 13:20:55.691637  8939 tablet_server.cc:179] TabletServer@127.8.186.194:0 shutting down...
I20260709 13:20:55.725382  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:55.726287  8939 tablet_replica.cc:333] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.727582  8939 raft_consensus.cc:2243] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.728240  8939 raft_consensus.cc:2272] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.730886  8939 tablet_replica.cc:333] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.731448  8939 raft_consensus.cc:2243] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.732503  8939 raft_consensus.cc:2272] T 7fa9022af8e34f25ab97c145bc6274a9 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.734800  8939 tablet_replica.cc:333] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.735383  8939 raft_consensus.cc:2243] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:20:55.736128 21034 consensus_peers.cc:597] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.736275  8939 raft_consensus.cc:2272] T f5b281eaf1bb4a58b9e92122d3b7ea66 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.738955  8939 tablet_replica.cc:333] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
W20260709 13:20:55.739085 21034 consensus_peers.cc:597] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.739614  8939 raft_consensus.cc:2243] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.740286  8939 raft_consensus.cc:2272] T 08e94dafee8044d49f5ca736133e3634 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.742304  8939 tablet_replica.cc:333] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.742882  8939 raft_consensus.cc:2243] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.743299  8939 raft_consensus.cc:2272] T 0f095dfe58404dba9c85a71b7e4fa35f P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.745257  8939 tablet_replica.cc:333] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.745811  8939 raft_consensus.cc:2243] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.746585  8939 raft_consensus.cc:2272] T 5139d76184f6413c896c55301b10c3cc P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.748778  8939 tablet_replica.cc:333] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.749418  8939 raft_consensus.cc:2243] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.749886  8939 raft_consensus.cc:2272] T 409514b8565f4119bbb6e6cac1eeffc1 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.752081  8939 tablet_replica.cc:333] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.752614  8939 raft_consensus.cc:2243] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.753029  8939 raft_consensus.cc:2272] T 8cac2b0f7c4f46a081342bbd5de91bbf P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.754931  8939 tablet_replica.cc:333] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.755534  8939 raft_consensus.cc:2243] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.756022  8939 raft_consensus.cc:2272] T 720c8fac03ac4e3794755fa0b1777b6d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.758145  8939 tablet_replica.cc:333] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.758671  8939 raft_consensus.cc:2243] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.759474  8939 raft_consensus.cc:2272] T 27e50a46a17144cb92374a67aaaafe87 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.761583  8939 tablet_replica.cc:333] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.762159  8939 raft_consensus.cc:2243] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.762579  8939 raft_consensus.cc:2272] T 609685fee0234619a86813214e1f5ecd P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.764591  8939 tablet_replica.cc:333] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.765105  8939 raft_consensus.cc:2243] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.765888  8939 raft_consensus.cc:2272] T b70ec366fff149ddb7c5bb941de00b7e P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.767805  8939 tablet_replica.cc:333] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.768332  8939 raft_consensus.cc:2243] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.768766  8939 raft_consensus.cc:2272] T 7fb3b977b9274ea9826779b3519819f3 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.770802  8939 tablet_replica.cc:333] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.771319  8939 raft_consensus.cc:2243] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.771781  8939 raft_consensus.cc:2272] T 84d600f22e244688a7ecac9f8a282c02 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.774748  8939 tablet_replica.cc:333] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.775323  8939 raft_consensus.cc:2243] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.775812  8939 raft_consensus.cc:2272] T 51206d639cbb4b56ad5463ca82cda963 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.777704  8939 tablet_replica.cc:333] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.778216  8939 raft_consensus.cc:2243] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.779048  8939 raft_consensus.cc:2272] T c190bff4977543b0b13e5c38f62c584d P b49eb8f55a2e45f09781dcc72fc3fe0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.781217  8939 tablet_replica.cc:333] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.781687  8939 raft_consensus.cc:2243] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.782423  8939 raft_consensus.cc:2272] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P b49eb8f55a2e45f09781dcc72fc3fe0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.784358  8939 tablet_replica.cc:333] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f: stopping tablet replica
I20260709 13:20:55.784814  8939 raft_consensus.cc:2243] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.785223  8939 raft_consensus.cc:2272] T 7f559b953dbb4df19d2fd1226a692d9c P b49eb8f55a2e45f09781dcc72fc3fe0f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:55.802177 21034 consensus_peers.cc:597] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 -> Peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Couldn't send request to peer b49eb8f55a2e45f09781dcc72fc3fe0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.816677  8939 tablet_server.cc:196] TabletServer@127.8.186.194:0 shutdown complete.
I20260709 13:20:55.849604  8939 tablet_server.cc:179] TabletServer@127.8.186.195:0 shutting down...
W20260709 13:20:55.869120 21034 consensus_peers.cc:597] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 -> Peer 0ad47b763e394f0a98cea588f7707026 (127.8.186.193:37755): Couldn't send request to peer 0ad47b763e394f0a98cea588f7707026. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.193:37755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.875993  8939 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:55.876789  8939 tablet_replica.cc:333] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.877386  8939 raft_consensus.cc:2243] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.878340  8939 raft_consensus.cc:2272] T 4c4dbcf5331b43a3a8ae704ddc2b6e3b P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.880632  8939 tablet_replica.cc:333] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.881237  8939 raft_consensus.cc:2243] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.881699  8939 raft_consensus.cc:2272] T 7fa9022af8e34f25ab97c145bc6274a9 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.883828  8939 tablet_replica.cc:333] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.884586  8939 raft_consensus.cc:2243] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.885142  8939 raft_consensus.cc:2272] T f5b281eaf1bb4a58b9e92122d3b7ea66 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.887347  8939 tablet_replica.cc:333] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.888186  8939 raft_consensus.cc:2243] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:55.888705 21034 consensus_peers.cc:597] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 -> Peer b49eb8f55a2e45f09781dcc72fc3fe0f (127.8.186.194:38671): Couldn't send request to peer b49eb8f55a2e45f09781dcc72fc3fe0f. Status: Network error: Client connection negotiation failed: client connection to 127.8.186.194:38671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.888738  8939 raft_consensus.cc:2272] T 08e94dafee8044d49f5ca736133e3634 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.891013  8939 tablet_replica.cc:333] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.891588  8939 raft_consensus.cc:2243] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.892084  8939 raft_consensus.cc:2272] T 0f095dfe58404dba9c85a71b7e4fa35f P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.894026  8939 tablet_replica.cc:333] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.894603  8939 raft_consensus.cc:2243] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.895023  8939 raft_consensus.cc:2272] T 0f28f0cbb29746aea6e1f4c2ec8b5733 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.897028  8939 tablet_replica.cc:333] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.897570  8939 raft_consensus.cc:2243] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.897985  8939 raft_consensus.cc:2272] T 409514b8565f4119bbb6e6cac1eeffc1 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.900089  8939 tablet_replica.cc:333] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.900615  8939 raft_consensus.cc:2243] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.901022  8939 raft_consensus.cc:2272] T 5139d76184f6413c896c55301b10c3cc P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.902971  8939 tablet_replica.cc:333] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.903514  8939 raft_consensus.cc:2243] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.903985  8939 raft_consensus.cc:2272] T 51206d639cbb4b56ad5463ca82cda963 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.905921  8939 tablet_replica.cc:333] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.906474  8939 raft_consensus.cc:2243] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.906875  8939 raft_consensus.cc:2272] T c190bff4977543b0b13e5c38f62c584d P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.909545  8939 tablet_replica.cc:333] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.910326  8939 raft_consensus.cc:2243] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.910844  8939 raft_consensus.cc:2272] T b70ec366fff149ddb7c5bb941de00b7e P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.912868  8939 tablet_replica.cc:333] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.913455  8939 raft_consensus.cc:2243] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.914309  8939 raft_consensus.cc:2272] T 7fb3b977b9274ea9826779b3519819f3 P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.916532  8939 tablet_replica.cc:333] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.917107  8939 raft_consensus.cc:2243] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.917897  8939 raft_consensus.cc:2272] T 7f559b953dbb4df19d2fd1226a692d9c P 3244c4c9fe1940aea6040c91014eee47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.920356  8939 tablet_replica.cc:333] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.920964  8939 raft_consensus.cc:2243] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.921422  8939 raft_consensus.cc:2272] T 8cac2b0f7c4f46a081342bbd5de91bbf P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.923422  8939 tablet_replica.cc:333] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.924026  8939 raft_consensus.cc:2243] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.924458  8939 raft_consensus.cc:2272] T 720c8fac03ac4e3794755fa0b1777b6d P 3244c4c9fe1940aea6040c91014eee47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.926743  8939 tablet_replica.cc:333] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.927271  8939 raft_consensus.cc:2243] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.927731  8939 raft_consensus.cc:2272] T 27e50a46a17144cb92374a67aaaafe87 P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.929677  8939 tablet_replica.cc:333] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.930176  8939 raft_consensus.cc:2243] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:55.930804  8939 raft_consensus.cc:2272] T 609685fee0234619a86813214e1f5ecd P 3244c4c9fe1940aea6040c91014eee47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.933207  8939 tablet_replica.cc:333] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47: stopping tablet replica
I20260709 13:20:55.933712  8939 raft_consensus.cc:2243] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:55.934559  8939 raft_consensus.cc:2272] T 84d600f22e244688a7ecac9f8a282c02 P 3244c4c9fe1940aea6040c91014eee47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:55.965219  8939 tablet_server.cc:196] TabletServer@127.8.186.195:0 shutdown complete.
I20260709 13:20:55.997179  8939 master.cc:562] Master@127.8.186.254:43561 shutting down...
I20260709 13:20:56.018662  8939 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.019260  8939 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.019595  8939 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4c63444d186f40efbfba15507c9daba9: stopping tablet replica
I20260709 13:20:56.039237  8939 master.cc:584] Master@127.8.186.254:43561 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11684 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25167 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (340173 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:20:56.093214  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 387 messages since previous log ~14 seconds ago
I20260709 13:20:56.093457  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 387 messages since previous log ~14 seconds ago
I20260709 13:20:56.093628  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 378 messages since previous log ~14 seconds ago
I20260709 13:20:56.093815  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:20:56.093993  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:20:56.094179  8939 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~194 seconds ago
I20260709 13:20:56.094350  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~195 seconds ago
I20260709 13:20:56.094538  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~190 seconds ago
I20260709 13:20:56.094779  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:20:56.095078  8939 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
